Annotation of XML/TODO, revision 1.55
1.1 daniel 1:
1.16 daniel 2: TODO for the XML parser and stuff:
3: ==================================
4:
1.31 daniel 5:
1.24 daniel 6: TODO:
7: =====
8:
1.53 veillard 9: - Computation of base when HTTP redirect occurs, might affect HTTP
10: interfaces.
1.49 veillard 11: - performances: there is still improvements needed when parsing Docbook DTD
12: a single function to optimize/avoid.
1.34 daniel 13: - DOM needs
14: int xmlPruneProp(xmlNodePtr node, xmlAtttrPtr attr);
1.48 veillard 15: - listing all attributes in a node.
1.25 daniel 16: - Correct standalone checking/emitting (hard)
17: 2.9 Standalone Document Declaration
1.27 daniel 18: - Better checking of external parsed entities TAG 1234
19: - Find way of representing PERefs in the Dtd so that %entity; can
20: be saved back.
1.28 daniel 21: - Go through erratas and do the cleanup.
1.49 veillard 22: http://www.w3.org/XML/xml-19980210-errata ... started ...
1.31 daniel 23: - Handle undefined namespaces in entity contents better ... at least
24: issue a warning
1.36 daniel 25: - fix --disable-corba configure switch handling, and use XML_WITHOUT_CORBA
26: not WITHOUT_CORBA flag
1.47 veillard 27: - reported by Michael, update of doc node when pasting on a new document
28: There can be far more than simply the doc pointer which refers to
29: the old document, for example namespace declarations or entities
30: references can also be a nasty problem, far more than updating the
31: doc values.
1.50 veillard 32: - jamesh suggestion: SAX like functions to save a document ie. call a
33: function to open a new element with given attributes, write character
34: data, close last element, etc
1.54 veillard 35: - htmlParseDoc has parameter encoding which is not used.
36: Function htmlCreateDocParserCtxt ignore it.
1.55 ! veillard 37: - bug reported by Michael Meallin on validation problems
! 38: - solve the problems related to post-validating of XInclude results.
1.18 daniel 39:
40: TODO:
41: =====
42:
1.24 daniel 43: - Get OASIS testsuite to a more friendly result, check all the results
1.37 daniel 44: once stable. Current state at:
1.24 daniel 45: http://xmlsoft.org/conf/result.html
46:
1.29 daniel 47: - Optimization of tag strings allocation ?
1.24 daniel 48:
49: - maintain coherency of namespace when doing cut'n paste operations
50: => the functions are coded, but need testing
51:
1.29 daniel 52: - function to rebuild the ID table
53: - functions to rebuild the DTD hash tables (after DTD changes).
1.24 daniel 54:
55:
56: EXTENSIONS:
57: ===========
1.29 daniel 58:
1.21 daniel 59: - Tools to produce man pages from the SGML docs.
1.16 daniel 60: - Finish XPath
1.18 daniel 61: => attributes addressing troubles
1.19 daniel 62: => defaulted attributes handling
63: => namespace axis ?
1.16 daniel 64:
65: - Add Xpointer recognition/API
66:
67: - Add Xlink recognition/API
1.18 daniel 68: => started adding an xlink.[ch] with a unified API for XML and HTML.
1.37 daniel 69: it's crap :-(
1.16 daniel 70:
71: - Implement XSLT
1.19 daniel 72: => seems that someone volunteered ?!?
1.16 daniel 73:
1.18 daniel 74: - Implement XSchemas
1.37 daniel 75: => Really need to be done <grin/>
1.18 daniel 76:
1.16 daniel 77: - O2K parsing;
78: => this is a somewhat ugly mix of HTML and XML, adding a specific
79: routine in the comment parsing code of HTML and plug the XML
80: parsing one in-there should not be too hard. Key point is to get
81: XSL to transform all this to something decent ...
82:
1.18 daniel 83: - extend the shell with:
84: - edit
85: - load/save
86: - mv (yum, yum, but it's harder because directories are ordered in
87: our case, mvup and mvdown would be required)
1.16 daniel 88:
1.20 daniel 89: - Add HTML validation using the XHTML DTD
90: - problem: do we want to keep and maintain the code for handling
91: DTD/System ID cache directly in libxml ?
92:
93: - Add a DTD cache prefilled with xhtml DTDs and entities and a program to
94: manage them -> like the /usr/bin/install-catalog from SGML
95: right place seems $datadir/xmldtds
1.31 daniel 96: Maybe this is better left to user apps
1.16 daniel 97:
1.19 daniel 98: - Add output to XHTML in case of HTML documents.
99:
1.24 daniel 100:
101: Done:
102: =====
103:
1.52 veillard 104: - HTML: handling of Script and style data elements, need special code in
105: the parser and saving functions (handling of < > " ' ...):
106: http://www.w3.org/TR/html4/types.html#type-script
107: Attributes are no problems since entities are accepted.
1.48 veillard 108: - DOM needs
109: xmlAttrPtr xmlNewDocProp(xmlDocPtr doc, const xmlChar *name, const xmlChar *value)
1.46 veillard 110: - problem when parsing hrefs with & with the HTML parser (IRC ac)
111: - If the internal encoding is not UTF8 saving to a given encoding doesn't
112: work => fix to force UTF8 encoding ...
113: done, added documentation too
1.45 veillard 114: - Add an ASCII I/O encoder (asciiToUTF8 and UTF8Toascii)
1.43 veillard 115: - Issue warning when using non-absolute namespaces URI.
116: - the html parser should add <head> and <body> if they don't exist
117: started, not finished.
118: Done, the automatic closing is added and 3 testcases were inserted
1.42 daniel 119: - Command to force the parser to stop parsing and ignore the rest of the file.
1.43 veillard 120: xmlStopParser() should allow this, mostly untested
1.41 daniel 121: - support for HTML empty attributes like <hr noshade>
1.38 daniel 122: - plugged iconv() in for support of a large set of encodings.
123: - xmlSwitchToEncoding() rewrite done
1.37 daniel 124: - URI checkings (no fragments) rfc2396.txt
1.35 daniel 125: - Added a clean mechanism for overload or added input methods:
126: xmlRegisterInputCallbacks()
1.31 daniel 127: - dynamically adapt the alloc entry point to use g_alloc()/g_free()
128: if the programmer wants it:
129: - use xmlMemSetup() to reset the routines used.
130: - Check attribute normalization especially xmlGetProp()
131: - Validity checking problems for NOTATIONS attributes
132: - Validity checking problems for ENTITY ENTITIES attributes
133: - Parsing of a well balanced chunk xmlParseBalancedChunkMemory()
134: - URI module: validation, base, etc ... see uri.[ch]
135: - turn tester into a generic program xmllint installed with libxml
1.30 daniel 136: - extend validity checks to go through entities content instead of
137: just labelling them PCDATA
1.27 daniel 138: - Save Dtds using the children list instead of dumping the tables,
139: order is preserved as well as comments and PIs
140: - Wrote a notice of changes requires to go from 1.x to 2.x
141: - make sure that all SAX callbacks are disabled if a WF error is detected
142: - checking/handling of newline normalization
143: http://localhost/www.xml.com/axml/target.html#sec-line-ends
1.25 daniel 144: - correct checking of '&' '%' on entities content.
145: - checking of PE/Nesting on entities declaration
146: - checking/handling of xml:space
147: - checking done.
148: - handling done, not well tested
1.24 daniel 149: - Language identification code, productions [33] to [38]
150: => done, the check has been added and report WFness errors
151: - Conditional sections in DTDs [61] to [65]
152: => should this crap be really implemented ???
153: => Yep OASIS testsuite uses them
154: - Allow parsed entities defined in the internal subset to override
155: the ones defined in the external subset (DtD customization).
156: => This mean that the entity content should be computed only at
157: use time, i.e. keep the orig string only at parse time and expand
158: only when referenced from the external subset :-(
159: Needed for complete use of most DTD from Eve Maler
160: - Add regression tests for all WFC errors
161: => did some in test/WFC
162: => added OASIS testsuite routines
163: http://xmlsoft.org/conf/result.html
1.22 daniel 164:
1.23 daniel 165: - I18N: http://wap.trondheim.com/vaer/index.phtml is not XML and accepted
166: by the XML parser, UTF-8 should be checked when there is no "encoding"
167: declared !
1.24 daniel 168: - Support for UTF-8 and UTF-16 encoding
169: => added some convertion routines provided by Martin Durst
170: patched them, got fixes from @@@
171: I plan to keep everything internally as UTF-8 (or ISO-Latin-X)
172: this is slightly more costly but more compact, and recent processors
173: efficiency is cache related. The key for good performances is keeping
174: the data set small, so will I.
175: => the new progressive reading routines call the detection code
176: is enabled, tested the ISO->UTF-8 stuff
1.20 daniel 177: - External entities loading:
178: - allow override by client code
179: - make sure it is alled for all external entities referenced
180: Done, client code should use xmlSetExternalEntityLoader() to set
181: the default loading routine. It will be called each time an external
182: entity entity resolution is triggered.
183: - maintain ID coherency when removing/changing attributes
184: The function used to deallocate attributes now check for it being an
185: ID and removes it from the table.
186: - push mode parsing i.e. non-blocking state based parser
187: done, both for XML and HTML parsers. Use xmlCreatePushParserCtxt()
188: and xmlParseChunk() and html counterparts.
189: The tester program now has a --push option to select that parser
190: front-end. Douplicated tests to use both and check results are similar.
191:
1.18 daniel 192: - Most of XPath, still see some troubles and occasionnal memleaks.
193: - an XML shell, allowing to traverse/manipulate an XML document with
194: a shell like interface, and using XPath for the anming syntax
1.20 daniel 195: - use of readline and history added when available
196: - the shell interface has been cleanly separated and moved to debugXML.c
1.18 daniel 197: - HTML parser, should be fairly stable now
198: - API to search the lang of an attribute
199: - Collect IDs at parsing and maintain a table.
200: PBM: maintain the table coherency
201: PBM: how to detect ID types in absence of DtD !
202: - Use it for XPath ID support
203: - Add validity checking
204: Should be finished now !
1.16 daniel 205: - Add regression tests with entity substitutions
206:
207: - External Parsed entities, either XML or external Subset [78] and [79]
208: parsing the xmllang DtD now works, so it should be sufficient for
209: most cases !
210:
211: - progressive reading. The entity support is a first step toward
1.7 daniel 212: asbtraction of an input stream. A large part of the context is still
213: located on the stack, moving to a state machine and putting everyting
214: in the parsing context should provide an adequate solution.
1.8 daniel 215: => Rather than progressive parsing, give more power to the SAX-like
216: interface. Currently the DOM-like representation is built but
1.18 daniel 217: => it should be possible to define that only as a set of SAX callbacks
218: and remove the tree creation from the parser code.
219: DONE
1.8 daniel 220:
1.1 daniel 221: - DOM support, instead of using a proprietary in memory
222: format for the document representation, the parser should
223: call a DOM API to actually build the resulting document.
224: Then the parser becomes independent of the in-memory
225: representation of the document. Even better using RPC's
226: the parser can actually build the document in another
227: program.
1.8 daniel 228: => Work started, now the internal representation is by default
229: very near a direct DOM implementation. The DOM glue is implemented
1.16 daniel 230: as a separate module. See the GNOME gdome module.
231:
1.2 daniel 232: - C++ support : John Ehresman <jehresma@dsg.harvard.edu>
1.6 daniel 233: - Updated code to follow more recent specs, added compatibility flag
1.7 daniel 234: - Better error handling, use a dedicated, overridable error
235: handling function.
236: - Support for CDATA.
237: - Keep track of line numbers for better error reporting.
238: - Support for PI (SAX one).
1.8 daniel 239: - Support for Comments (bad, should be in ASAP, they are parsed
240: but not stored), should be configurable.
241: - Improve the support of entities on save (+SAX).
1.2 daniel 242:
Webmaster
![[BACK]](/cvsweb/icons/back.gif){kind=icon}
Return to TODO CVS log ![[TXT]](/cvsweb/icons/text.gif){kind=icon}
![[DIR]](/cvsweb/icons/dir.gif){kind=icon}
Up to [Public] / XML