Annotation of XML/TODO, revision 1.44

1.1       daniel      1: 
1.16      daniel      2:            TODO for the XML parser and stuff:
                      3:           ==================================
                      4: 
1.31      daniel      5: 
1.24      daniel      6: TODO:
                      7: =====
                      8: 
1.39      daniel      9: - If the internal encoding is not UTF8 saving to a given encoding doesn't
1.43      veillard   10:   work => fix to force UTF8 encoding ...
1.38      daniel     11: - problem when parsing hrefs with & with the HTML parser (IRC ac)
1.34      daniel     12: - DOM needs
                     13:   xmlAttrPtr xmlNewDocProp(xmlDocPtr doc, const xmlChar *name, const xmlChar *value)
                     14:   int xmlPruneProp(xmlNodePtr node, xmlAtttrPtr attr);
1.39      daniel     15: - General checking of DTD validation in presence of namespaces ... hairy
1.40      daniel     16:   mostly done
1.33      daniel     17: - Fix DTD + namespace validity problem
                     18:   "Not valid: root and DtD name do not match 'ROOT' and 'prefix:ROOT'"
1.40      daniel     19:   mostly done
1.25      daniel     20: - Correct standalone checking/emitting (hard)
                     21:   2.9 Standalone Document Declaration
1.27      daniel     22: - Better checking of external parsed entities TAG 1234
                     23: - Find way of representing PERefs in the Dtd so that %entity; can
                     24:   be saved back.
1.28      daniel     25: - Go through erratas and do the cleanup.
                     26:   http://www.w3.org/XML/xml-19980210-errata ... bummmer 
1.31      daniel     27: - Handle undefined namespaces in entity contents better ... at least
                     28:   issue a warning
1.36      daniel     29: - fix --disable-corba configure switch handling, and use XML_WITHOUT_CORBA
                     30:   not WITHOUT_CORBA flag
1.44    ! veillard   31: - Add an ASCII I/O encoder (simple)
1.18      daniel     32: 
                     33: TODO:
                     34: =====
                     35: 
1.24      daniel     36: - Get OASIS testsuite to a more friendly result, check all the results
1.37      daniel     37:   once stable. Current state at:
1.24      daniel     38:   http://xmlsoft.org/conf/result.html
                     39: 
1.29      daniel     40: - Optimization of tag strings allocation ?
1.24      daniel     41: 
                     42: - maintain coherency of namespace when doing cut'n paste operations
                     43:   => the functions are coded, but need testing
                     44: 
1.29      daniel     45: - function to rebuild the ID table
                     46: - functions to rebuild the DTD hash tables (after DTD changes).
1.24      daniel     47:    
                     48: 
                     49: EXTENSIONS:
                     50: ===========
1.29      daniel     51: 
1.21      daniel     52: - Tools to produce man pages from the SGML docs.
1.16      daniel     53: - Finish XPath
1.18      daniel     54:   => attributes addressing troubles
1.19      daniel     55:   => defaulted attributes handling
                     56:   => namespace axis ?
1.16      daniel     57: 
                     58: - Add Xpointer recognition/API
                     59: 
                     60: - Add Xlink recognition/API
1.18      daniel     61:   => started adding an xlink.[ch] with a unified API for XML and HTML.
1.37      daniel     62:      it's crap :-(
1.16      daniel     63: 
                     64: - Implement XSLT
1.19      daniel     65:   => seems that someone volunteered ?!?
1.16      daniel     66: 
1.18      daniel     67: - Implement XSchemas
1.37      daniel     68:   => Really need to be done <grin/>
1.18      daniel     69: 
1.16      daniel     70: - O2K parsing;
                     71:   => this is a somewhat ugly mix of HTML and XML, adding a specific
                     72:      routine in the comment parsing code of HTML and plug the XML 
                     73:      parsing one in-there should not be too hard. Key point is to get
                     74:      XSL to transform all this to something decent ...
                     75: 
1.18      daniel     76: - extend the shell with:
                     77:    - edit
                     78:    - load/save
                     79:    - mv (yum, yum, but it's harder because directories are ordered in
                     80:      our case, mvup and mvdown would be required)
1.16      daniel     81: 
1.20      daniel     82: - Add HTML validation using the XHTML DTD
                     83:   - problem: do we want to keep and maintain the code for handling
                     84:     DTD/System ID cache directly in libxml ?
                     85: 
                     86: - Add a DTD cache prefilled with xhtml DTDs and entities and a program to
                     87:   manage them -> like the /usr/bin/install-catalog from SGML
                     88:   right place seems $datadir/xmldtds
1.31      daniel     89:   Maybe this is better left to user apps
1.16      daniel     90: 
1.19      daniel     91: - Add output to XHTML in case of HTML documents.
                     92: 
1.24      daniel     93: 
                     94: Done:
                     95: =====
                     96: 
1.43      veillard   97: - Issue warning when using non-absolute namespaces URI.
                     98: - the html parser should add <head> and <body> if they don't exist
                     99:   started, not finished.
                    100:   Done, the automatic closing is added and 3 testcases were inserted
1.42      daniel    101: - Command to force the parser to stop parsing and ignore the rest of the file.
1.43      veillard  102:   xmlStopParser() should allow this, mostly untested
1.41      daniel    103: - support for HTML empty attributes like <hr noshade>
1.38      daniel    104: - plugged iconv() in for support of a large set of encodings.
                    105: - xmlSwitchToEncoding() rewrite done
1.37      daniel    106: - URI checkings (no fragments) rfc2396.txt
1.35      daniel    107: - Added a clean mechanism for overload or added input methods:
                    108:   xmlRegisterInputCallbacks()
1.31      daniel    109: - dynamically adapt the alloc entry point to use g_alloc()/g_free()
                    110:   if the programmer wants it: 
                    111:     - use xmlMemSetup() to reset the routines used.
                    112: - Check attribute normalization especially xmlGetProp()
                    113: - Validity checking problems for NOTATIONS attributes
                    114: - Validity checking problems for ENTITY ENTITIES attributes
                    115: - Parsing of a well balanced chunk xmlParseBalancedChunkMemory()
                    116: - URI module: validation, base, etc ... see uri.[ch]
                    117: - turn tester into a generic program xmllint installed with libxml
1.30      daniel    118: - extend validity checks to go through entities content instead of
                    119:   just labelling them PCDATA
1.27      daniel    120: - Save Dtds using the children list instead of dumping the tables,
                    121:   order is preserved as well as comments and PIs
                    122: - Wrote a notice of changes requires to go from 1.x to 2.x
                    123: - make sure that all SAX callbacks are disabled if a WF error is detected
                    124: - checking/handling of newline normalization
                    125:   http://localhost/www.xml.com/axml/target.html#sec-line-ends
1.25      daniel    126: - correct checking of '&' '%' on entities content.
                    127: - checking of PE/Nesting on entities declaration
                    128: - checking/handling of xml:space
                    129:    - checking done.
                    130:    - handling done, not well tested
1.24      daniel    131: - Language identification code, productions [33] to [38]
                    132:   => done, the check has been added and report WFness errors
                    133: - Conditional sections in DTDs [61] to [65]
                    134:   => should this crap be really implemented ???
                    135:   => Yep OASIS testsuite uses them
                    136: - Allow parsed entities defined in the internal subset to override
                    137:   the ones defined in the external subset (DtD customization).
                    138:   => This mean that the entity content should be computed only at
                    139:      use time, i.e. keep the orig string only at parse time and expand
                    140:      only when referenced from the external subset :-(
                    141:      Needed for complete use of most DTD from Eve Maler
                    142: - Add regression tests for all WFC errors
                    143:   => did some in test/WFC
                    144:   => added OASIS testsuite routines
                    145:      http://xmlsoft.org/conf/result.html
1.22      daniel    146: 
1.23      daniel    147: - I18N: http://wap.trondheim.com/vaer/index.phtml is not XML and accepted
                    148:   by the XML parser, UTF-8 should be checked when there is no "encoding"
                    149:   declared !
1.24      daniel    150: - Support for UTF-8 and UTF-16 encoding
                    151:   => added some convertion routines provided by Martin Durst
                    152:      patched them, got fixes from @@@
                    153:      I plan to keep everything internally as UTF-8 (or ISO-Latin-X)
                    154:      this is slightly more costly but more compact, and recent processors
                    155:      efficiency is cache related. The key for good performances is keeping
                    156:      the data set small, so will I.
                    157:   => the new progressive reading routines call the detection code
                    158:      is enabled, tested the ISO->UTF-8 stuff
1.20      daniel    159: - External entities loading: 
                    160:    - allow override by client code
                    161:    - make sure it is alled for all external entities referenced
                    162:   Done, client code should use xmlSetExternalEntityLoader() to set
                    163:   the default loading routine. It will be called each time an external
                    164:   entity entity resolution is triggered.
                    165: - maintain ID coherency when removing/changing attributes
                    166:   The function used to deallocate attributes now check for it being an
                    167:   ID and removes it from the table.
                    168: - push mode parsing i.e. non-blocking state based parser
                    169:   done, both for XML and HTML parsers. Use xmlCreatePushParserCtxt()
                    170:   and xmlParseChunk() and html counterparts.
                    171:   The tester program now has a --push option to select that parser 
                    172:   front-end. Douplicated tests to use both and check results are similar.
                    173: 
1.18      daniel    174: - Most of XPath, still see some troubles and occasionnal memleaks.
                    175: - an XML shell, allowing to traverse/manipulate an XML document with
                    176:   a shell like interface, and using XPath for the anming syntax
1.20      daniel    177:   - use of readline and history added when available
                    178:   - the shell interface has been cleanly separated and moved to debugXML.c
1.18      daniel    179: - HTML parser, should be fairly stable now
                    180: - API to search the lang of an attribute
                    181: - Collect IDs at parsing and maintain a table. 
                    182:    PBM: maintain the table coherency
                    183:    PBM: how to detect ID types in absence of DtD !
                    184: - Use it for XPath ID support
                    185: - Add validity checking
                    186:   Should be finished now !
1.16      daniel    187: - Add regression tests with entity substitutions
                    188: 
                    189: - External Parsed entities, either XML or external Subset [78] and [79]
                    190:   parsing the xmllang DtD now works, so it should be sufficient for
                    191:   most cases !
                    192: 
                    193: - progressive reading. The entity support is a first step toward
1.7       daniel    194:   asbtraction of an input stream. A large part of the context is still
                    195:   located on the stack, moving to a state machine and putting everyting
                    196:   in the parsing context should provide an adequate solution.
1.8       daniel    197:   => Rather than progressive parsing, give more power to the SAX-like
                    198:      interface. Currently the DOM-like representation is built but
1.18      daniel    199:      => it should be possible to define that only as a set of SAX callbacks
                    200:        and remove the tree creation from the parser code.
                    201:        DONE
1.8       daniel    202: 
1.1       daniel    203: - DOM support, instead of using a proprietary in memory
                    204:   format for the document representation, the parser should
                    205:   call a DOM API to actually build the resulting document.
                    206:   Then the parser becomes independent of the in-memory
                    207:   representation of the document. Even better using RPC's
                    208:   the parser can actually build the document in another
                    209:   program.
1.8       daniel    210:   => Work started, now the internal representation is by default
                    211:      very near a direct DOM implementation. The DOM glue is implemented
1.16      daniel    212:      as a separate module. See the GNOME gdome module.
                    213: 
1.2       daniel    214: - C++ support : John Ehresman <jehresma@dsg.harvard.edu>
1.6       daniel    215: - Updated code to follow more recent specs, added compatibility flag
1.7       daniel    216: - Better error handling, use a dedicated, overridable error
                    217:   handling function.
                    218: - Support for CDATA.
                    219: - Keep track of line numbers for better error reporting.
                    220: - Support for PI (SAX one).
1.8       daniel    221: - Support for Comments (bad, should be in ASAP, they are parsed
                    222:   but not stored), should be configurable.
                    223: - Improve the support of entities on save (+SAX).
1.2       daniel    224: 

Webmaster