Annotation of XML/TODO, revision 1.44
1.1 daniel 1:
1.16 daniel 2: TODO for the XML parser and stuff:
3: ==================================
4:
1.31 daniel 5:
1.24 daniel 6: TODO:
7: =====
8:
1.39 daniel 9: - If the internal encoding is not UTF8 saving to a given encoding doesn't
1.43 veillard 10: work => fix to force UTF8 encoding ...
1.38 daniel 11: - problem when parsing hrefs with & with the HTML parser (IRC ac)
1.34 daniel 12: - DOM needs
13: xmlAttrPtr xmlNewDocProp(xmlDocPtr doc, const xmlChar *name, const xmlChar *value)
14: int xmlPruneProp(xmlNodePtr node, xmlAtttrPtr attr);
1.39 daniel 15: - General checking of DTD validation in presence of namespaces ... hairy
1.40 daniel 16: mostly done
1.33 daniel 17: - Fix DTD + namespace validity problem
18: "Not valid: root and DtD name do not match 'ROOT' and 'prefix:ROOT'"
1.40 daniel 19: mostly done
1.25 daniel 20: - Correct standalone checking/emitting (hard)
21: 2.9 Standalone Document Declaration
1.27 daniel 22: - Better checking of external parsed entities TAG 1234
23: - Find way of representing PERefs in the Dtd so that %entity; can
24: be saved back.
1.28 daniel 25: - Go through erratas and do the cleanup.
26: http://www.w3.org/XML/xml-19980210-errata ... bummmer
1.31 daniel 27: - Handle undefined namespaces in entity contents better ... at least
28: issue a warning
1.36 daniel 29: - fix --disable-corba configure switch handling, and use XML_WITHOUT_CORBA
30: not WITHOUT_CORBA flag
1.44 ! veillard 31: - Add an ASCII I/O encoder (simple)
1.18 daniel 32:
33: TODO:
34: =====
35:
1.24 daniel 36: - Get OASIS testsuite to a more friendly result, check all the results
1.37 daniel 37: once stable. Current state at:
1.24 daniel 38: http://xmlsoft.org/conf/result.html
39:
1.29 daniel 40: - Optimization of tag strings allocation ?
1.24 daniel 41:
42: - maintain coherency of namespace when doing cut'n paste operations
43: => the functions are coded, but need testing
44:
1.29 daniel 45: - function to rebuild the ID table
46: - functions to rebuild the DTD hash tables (after DTD changes).
1.24 daniel 47:
48:
49: EXTENSIONS:
50: ===========
1.29 daniel 51:
1.21 daniel 52: - Tools to produce man pages from the SGML docs.
1.16 daniel 53: - Finish XPath
1.18 daniel 54: => attributes addressing troubles
1.19 daniel 55: => defaulted attributes handling
56: => namespace axis ?
1.16 daniel 57:
58: - Add Xpointer recognition/API
59:
60: - Add Xlink recognition/API
1.18 daniel 61: => started adding an xlink.[ch] with a unified API for XML and HTML.
1.37 daniel 62: it's crap :-(
1.16 daniel 63:
64: - Implement XSLT
1.19 daniel 65: => seems that someone volunteered ?!?
1.16 daniel 66:
1.18 daniel 67: - Implement XSchemas
1.37 daniel 68: => Really need to be done <grin/>
1.18 daniel 69:
1.16 daniel 70: - O2K parsing;
71: => this is a somewhat ugly mix of HTML and XML, adding a specific
72: routine in the comment parsing code of HTML and plug the XML
73: parsing one in-there should not be too hard. Key point is to get
74: XSL to transform all this to something decent ...
75:
1.18 daniel 76: - extend the shell with:
77: - edit
78: - load/save
79: - mv (yum, yum, but it's harder because directories are ordered in
80: our case, mvup and mvdown would be required)
1.16 daniel 81:
1.20 daniel 82: - Add HTML validation using the XHTML DTD
83: - problem: do we want to keep and maintain the code for handling
84: DTD/System ID cache directly in libxml ?
85:
86: - Add a DTD cache prefilled with xhtml DTDs and entities and a program to
87: manage them -> like the /usr/bin/install-catalog from SGML
88: right place seems $datadir/xmldtds
1.31 daniel 89: Maybe this is better left to user apps
1.16 daniel 90:
1.19 daniel 91: - Add output to XHTML in case of HTML documents.
92:
1.24 daniel 93:
94: Done:
95: =====
96:
1.43 veillard 97: - Issue warning when using non-absolute namespaces URI.
98: - the html parser should add <head> and <body> if they don't exist
99: started, not finished.
100: Done, the automatic closing is added and 3 testcases were inserted
1.42 daniel 101: - Command to force the parser to stop parsing and ignore the rest of the file.
1.43 veillard 102: xmlStopParser() should allow this, mostly untested
1.41 daniel 103: - support for HTML empty attributes like <hr noshade>
1.38 daniel 104: - plugged iconv() in for support of a large set of encodings.
105: - xmlSwitchToEncoding() rewrite done
1.37 daniel 106: - URI checkings (no fragments) rfc2396.txt
1.35 daniel 107: - Added a clean mechanism for overload or added input methods:
108: xmlRegisterInputCallbacks()
1.31 daniel 109: - dynamically adapt the alloc entry point to use g_alloc()/g_free()
110: if the programmer wants it:
111: - use xmlMemSetup() to reset the routines used.
112: - Check attribute normalization especially xmlGetProp()
113: - Validity checking problems for NOTATIONS attributes
114: - Validity checking problems for ENTITY ENTITIES attributes
115: - Parsing of a well balanced chunk xmlParseBalancedChunkMemory()
116: - URI module: validation, base, etc ... see uri.[ch]
117: - turn tester into a generic program xmllint installed with libxml
1.30 daniel 118: - extend validity checks to go through entities content instead of
119: just labelling them PCDATA
1.27 daniel 120: - Save Dtds using the children list instead of dumping the tables,
121: order is preserved as well as comments and PIs
122: - Wrote a notice of changes requires to go from 1.x to 2.x
123: - make sure that all SAX callbacks are disabled if a WF error is detected
124: - checking/handling of newline normalization
125: http://localhost/www.xml.com/axml/target.html#sec-line-ends
1.25 daniel 126: - correct checking of '&' '%' on entities content.
127: - checking of PE/Nesting on entities declaration
128: - checking/handling of xml:space
129: - checking done.
130: - handling done, not well tested
1.24 daniel 131: - Language identification code, productions [33] to [38]
132: => done, the check has been added and report WFness errors
133: - Conditional sections in DTDs [61] to [65]
134: => should this crap be really implemented ???
135: => Yep OASIS testsuite uses them
136: - Allow parsed entities defined in the internal subset to override
137: the ones defined in the external subset (DtD customization).
138: => This mean that the entity content should be computed only at
139: use time, i.e. keep the orig string only at parse time and expand
140: only when referenced from the external subset :-(
141: Needed for complete use of most DTD from Eve Maler
142: - Add regression tests for all WFC errors
143: => did some in test/WFC
144: => added OASIS testsuite routines
145: http://xmlsoft.org/conf/result.html
1.22 daniel 146:
1.23 daniel 147: - I18N: http://wap.trondheim.com/vaer/index.phtml is not XML and accepted
148: by the XML parser, UTF-8 should be checked when there is no "encoding"
149: declared !
1.24 daniel 150: - Support for UTF-8 and UTF-16 encoding
151: => added some convertion routines provided by Martin Durst
152: patched them, got fixes from @@@
153: I plan to keep everything internally as UTF-8 (or ISO-Latin-X)
154: this is slightly more costly but more compact, and recent processors
155: efficiency is cache related. The key for good performances is keeping
156: the data set small, so will I.
157: => the new progressive reading routines call the detection code
158: is enabled, tested the ISO->UTF-8 stuff
1.20 daniel 159: - External entities loading:
160: - allow override by client code
161: - make sure it is alled for all external entities referenced
162: Done, client code should use xmlSetExternalEntityLoader() to set
163: the default loading routine. It will be called each time an external
164: entity entity resolution is triggered.
165: - maintain ID coherency when removing/changing attributes
166: The function used to deallocate attributes now check for it being an
167: ID and removes it from the table.
168: - push mode parsing i.e. non-blocking state based parser
169: done, both for XML and HTML parsers. Use xmlCreatePushParserCtxt()
170: and xmlParseChunk() and html counterparts.
171: The tester program now has a --push option to select that parser
172: front-end. Douplicated tests to use both and check results are similar.
173:
1.18 daniel 174: - Most of XPath, still see some troubles and occasionnal memleaks.
175: - an XML shell, allowing to traverse/manipulate an XML document with
176: a shell like interface, and using XPath for the anming syntax
1.20 daniel 177: - use of readline and history added when available
178: - the shell interface has been cleanly separated and moved to debugXML.c
1.18 daniel 179: - HTML parser, should be fairly stable now
180: - API to search the lang of an attribute
181: - Collect IDs at parsing and maintain a table.
182: PBM: maintain the table coherency
183: PBM: how to detect ID types in absence of DtD !
184: - Use it for XPath ID support
185: - Add validity checking
186: Should be finished now !
1.16 daniel 187: - Add regression tests with entity substitutions
188:
189: - External Parsed entities, either XML or external Subset [78] and [79]
190: parsing the xmllang DtD now works, so it should be sufficient for
191: most cases !
192:
193: - progressive reading. The entity support is a first step toward
1.7 daniel 194: asbtraction of an input stream. A large part of the context is still
195: located on the stack, moving to a state machine and putting everyting
196: in the parsing context should provide an adequate solution.
1.8 daniel 197: => Rather than progressive parsing, give more power to the SAX-like
198: interface. Currently the DOM-like representation is built but
1.18 daniel 199: => it should be possible to define that only as a set of SAX callbacks
200: and remove the tree creation from the parser code.
201: DONE
1.8 daniel 202:
1.1 daniel 203: - DOM support, instead of using a proprietary in memory
204: format for the document representation, the parser should
205: call a DOM API to actually build the resulting document.
206: Then the parser becomes independent of the in-memory
207: representation of the document. Even better using RPC's
208: the parser can actually build the document in another
209: program.
1.8 daniel 210: => Work started, now the internal representation is by default
211: very near a direct DOM implementation. The DOM glue is implemented
1.16 daniel 212: as a separate module. See the GNOME gdome module.
213:
1.2 daniel 214: - C++ support : John Ehresman <jehresma@dsg.harvard.edu>
1.6 daniel 215: - Updated code to follow more recent specs, added compatibility flag
1.7 daniel 216: - Better error handling, use a dedicated, overridable error
217: handling function.
218: - Support for CDATA.
219: - Keep track of line numbers for better error reporting.
220: - Support for PI (SAX one).
1.8 daniel 221: - Support for Comments (bad, should be in ASAP, they are parsed
222: but not stored), should be configurable.
223: - Improve the support of entities on save (+SAX).
1.2 daniel 224:
Webmaster