Annotation of XML/TODO, revision 1.24

1.1       daniel      1: 
1.16      daniel      2:            TODO for the XML parser and stuff:
                      3:           ==================================
                      4: 
1.24    ! daniel      5: TODO:
        !             6: =====
        !             7: 
        !             8: - checking of PE/Nesting on entities declaration
1.18      daniel      9: 
                     10: TODO:
                     11: =====
                     12: 
1.24    ! daniel     13: - Get OASIS testsuite to a more friendly result, check all the results
        !            14:   once stable.
        !            15:   http://xmlsoft.org/conf/result.html
        !            16: 
        !            17: - Optimization of tag strings allocation.
        !            18: 
        !            19: - maintain coherency of namespace when doing cut'n paste operations
        !            20:   => the functions are coded, but need testing
        !            21: 
        !            22: - function to rebuild the ID table ?
        !            23: 
        !            24: - Parsing of a well balanced chunk
        !            25: 
        !            26: - dynamically adapt the alloc entry point to use g_alloc()/g_free()
        !            27:   if the programmer wants it
        !            28: 
        !            29: - Validity checking problems for ENTITY ENTITIES attributes
        !            30: 
        !            31: - Validity checking problems for NOTATIONS attributes
        !            32:    
        !            33: - Check attribute normalization especially xmlGetProp()
        !            34: 
        !            35: EXTENSIONS:
        !            36: ===========
1.21      daniel     37: - Tools to produce man pages from the SGML docs.
1.17      daniel     38: 
1.16      daniel     39: - Finish XPath
1.18      daniel     40:   => attributes addressing troubles
1.19      daniel     41:   => defaulted attributes handling
                     42:   => namespace axis ?
1.16      daniel     43: 
                     44: - Add Xpointer recognition/API
                     45: 
                     46: - Add Xlink recognition/API
1.18      daniel     47:   => started adding an xlink.[ch] with a unified API for XML and HTML.
1.16      daniel     48: 
                     49: - Implement XSLT
1.19      daniel     50:   => seems that someone volunteered ?!?
1.16      daniel     51: 
1.18      daniel     52: - Implement XSchemas
                     53: 
1.16      daniel     54: - O2K parsing;
                     55:   => this is a somewhat ugly mix of HTML and XML, adding a specific
                     56:      routine in the comment parsing code of HTML and plug the XML 
                     57:      parsing one in-there should not be too hard. Key point is to get
                     58:      XSL to transform all this to something decent ...
                     59: 
1.18      daniel     60: - extend the shell with:
                     61:    - edit
                     62:    - load/save
                     63:    - mv (yum, yum, but it's harder because directories are ordered in
                     64:      our case, mvup and mvdown would be required)
1.16      daniel     65: 
1.20      daniel     66: - Add HTML validation using the XHTML DTD
                     67:   - problem: do we want to keep and maintain the code for handling
                     68:     DTD/System ID cache directly in libxml ?
                     69: 
                     70: - Add a DTD cache prefilled with xhtml DTDs and entities and a program to
                     71:   manage them -> like the /usr/bin/install-catalog from SGML
                     72:   right place seems $datadir/xmldtds
                     73: 
                     74: - turn tester into a generic program xml-test installed with xml-devel
1.16      daniel     75: 
1.19      daniel     76: - Add output to XHTML in case of HTML documents.
                     77: 
1.24    ! daniel     78: 
        !            79: Done:
        !            80: =====
        !            81: 
        !            82: - Language identification code, productions [33] to [38]
        !            83:   => done, the check has been added and report WFness errors
        !            84: - Conditional sections in DTDs [61] to [65]
        !            85:   => should this crap be really implemented ???
        !            86:   => Yep OASIS testsuite uses them
        !            87: - Allow parsed entities defined in the internal subset to override
        !            88:   the ones defined in the external subset (DtD customization).
        !            89:   => This mean that the entity content should be computed only at
        !            90:      use time, i.e. keep the orig string only at parse time and expand
        !            91:      only when referenced from the external subset :-(
        !            92:      Needed for complete use of most DTD from Eve Maler
        !            93: - Add regression tests for all WFC errors
        !            94:   => did some in test/WFC
        !            95:   => added OASIS testsuite routines
        !            96:      http://xmlsoft.org/conf/result.html
1.22      daniel     97: 
1.23      daniel     98: - I18N: http://wap.trondheim.com/vaer/index.phtml is not XML and accepted
                     99:   by the XML parser, UTF-8 should be checked when there is no "encoding"
                    100:   declared !
1.24    ! daniel    101: - Support for UTF-8 and UTF-16 encoding
        !           102:   => added some convertion routines provided by Martin Durst
        !           103:      patched them, got fixes from @@@
        !           104:      I plan to keep everything internally as UTF-8 (or ISO-Latin-X)
        !           105:      this is slightly more costly but more compact, and recent processors
        !           106:      efficiency is cache related. The key for good performances is keeping
        !           107:      the data set small, so will I.
        !           108:   => the new progressive reading routines call the detection code
        !           109:      is enabled, tested the ISO->UTF-8 stuff
1.20      daniel    110: - External entities loading: 
                    111:    - allow override by client code
                    112:    - make sure it is alled for all external entities referenced
                    113:   Done, client code should use xmlSetExternalEntityLoader() to set
                    114:   the default loading routine. It will be called each time an external
                    115:   entity entity resolution is triggered.
                    116: - maintain ID coherency when removing/changing attributes
                    117:   The function used to deallocate attributes now check for it being an
                    118:   ID and removes it from the table.
                    119: - push mode parsing i.e. non-blocking state based parser
                    120:   done, both for XML and HTML parsers. Use xmlCreatePushParserCtxt()
                    121:   and xmlParseChunk() and html counterparts.
                    122:   The tester program now has a --push option to select that parser 
                    123:   front-end. Douplicated tests to use both and check results are similar.
                    124: 
1.18      daniel    125: - Most of XPath, still see some troubles and occasionnal memleaks.
                    126: - an XML shell, allowing to traverse/manipulate an XML document with
                    127:   a shell like interface, and using XPath for the anming syntax
1.20      daniel    128:   - use of readline and history added when available
                    129:   - the shell interface has been cleanly separated and moved to debugXML.c
1.18      daniel    130: - HTML parser, should be fairly stable now
                    131: - API to search the lang of an attribute
                    132: - Collect IDs at parsing and maintain a table. 
                    133:    PBM: maintain the table coherency
                    134:    PBM: how to detect ID types in absence of DtD !
                    135: - Use it for XPath ID support
                    136: - Add validity checking
                    137:   Should be finished now !
1.16      daniel    138: - Add regression tests with entity substitutions
                    139: 
                    140: - External Parsed entities, either XML or external Subset [78] and [79]
                    141:   parsing the xmllang DtD now works, so it should be sufficient for
                    142:   most cases !
                    143: 
                    144: - progressive reading. The entity support is a first step toward
1.7       daniel    145:   asbtraction of an input stream. A large part of the context is still
                    146:   located on the stack, moving to a state machine and putting everyting
                    147:   in the parsing context should provide an adequate solution.
1.8       daniel    148:   => Rather than progressive parsing, give more power to the SAX-like
                    149:      interface. Currently the DOM-like representation is built but
1.18      daniel    150:      => it should be possible to define that only as a set of SAX callbacks
                    151:        and remove the tree creation from the parser code.
                    152:        DONE
1.8       daniel    153: 
1.1       daniel    154: - DOM support, instead of using a proprietary in memory
                    155:   format for the document representation, the parser should
                    156:   call a DOM API to actually build the resulting document.
                    157:   Then the parser becomes independent of the in-memory
                    158:   representation of the document. Even better using RPC's
                    159:   the parser can actually build the document in another
                    160:   program.
1.8       daniel    161:   => Work started, now the internal representation is by default
                    162:      very near a direct DOM implementation. The DOM glue is implemented
1.16      daniel    163:      as a separate module. See the GNOME gdome module.
                    164: 
1.2       daniel    165: - C++ support : John Ehresman <jehresma@dsg.harvard.edu>
1.6       daniel    166: - Updated code to follow more recent specs, added compatibility flag
1.7       daniel    167: - Better error handling, use a dedicated, overridable error
                    168:   handling function.
                    169: - Support for CDATA.
                    170: - Keep track of line numbers for better error reporting.
                    171: - Support for PI (SAX one).
1.8       daniel    172: - Support for Comments (bad, should be in ASAP, they are parsed
                    173:   but not stored), should be configurable.
                    174: - Improve the support of entities on save (+SAX).
1.2       daniel    175: 

Webmaster