Annotation of XML/TODO, revision 1.54
1.1 daniel 1:
1.16 daniel 2: TODO for the XML parser and stuff:
3: ==================================
4:
1.31 daniel 5:
1.24 daniel 6: TODO:
7: =====
8:
1.53 veillard 9: - Computation of base when HTTP redirect occurs, might affect HTTP
10: interfaces.
1.49 veillard 11: - performances: there is still improvements needed when parsing Docbook DTD
12: a single function to optimize/avoid.
1.34 daniel 13: - DOM needs
14: int xmlPruneProp(xmlNodePtr node, xmlAtttrPtr attr);
1.48 veillard 15: - listing all attributes in a node.
1.25 daniel 16: - Correct standalone checking/emitting (hard)
17: 2.9 Standalone Document Declaration
1.27 daniel 18: - Better checking of external parsed entities TAG 1234
19: - Find way of representing PERefs in the Dtd so that %entity; can
20: be saved back.
1.28 daniel 21: - Go through erratas and do the cleanup.
1.49 veillard 22: http://www.w3.org/XML/xml-19980210-errata ... started ...
1.31 daniel 23: - Handle undefined namespaces in entity contents better ... at least
24: issue a warning
1.36 daniel 25: - fix --disable-corba configure switch handling, and use XML_WITHOUT_CORBA
26: not WITHOUT_CORBA flag
1.47 veillard 27: - reported by Michael, update of doc node when pasting on a new document
28: There can be far more than simply the doc pointer which refers to
29: the old document, for example namespace declarations or entities
30: references can also be a nasty problem, far more than updating the
31: doc values.
1.50 veillard 32: - jamesh suggestion: SAX like functions to save a document ie. call a
33: function to open a new element with given attributes, write character
34: data, close last element, etc
1.54 ! veillard 35: - htmlParseDoc has parameter encoding which is not used.
! 36: Function htmlCreateDocParserCtxt ignore it.
! 37:
1.18 daniel 38:
39: TODO:
40: =====
41:
1.24 daniel 42: - Get OASIS testsuite to a more friendly result, check all the results
1.37 daniel 43: once stable. Current state at:
1.24 daniel 44: http://xmlsoft.org/conf/result.html
45:
1.29 daniel 46: - Optimization of tag strings allocation ?
1.24 daniel 47:
48: - maintain coherency of namespace when doing cut'n paste operations
49: => the functions are coded, but need testing
50:
1.29 daniel 51: - function to rebuild the ID table
52: - functions to rebuild the DTD hash tables (after DTD changes).
1.24 daniel 53:
54:
55: EXTENSIONS:
56: ===========
1.29 daniel 57:
1.21 daniel 58: - Tools to produce man pages from the SGML docs.
1.16 daniel 59: - Finish XPath
1.18 daniel 60: => attributes addressing troubles
1.19 daniel 61: => defaulted attributes handling
62: => namespace axis ?
1.16 daniel 63:
64: - Add Xpointer recognition/API
65:
66: - Add Xlink recognition/API
1.18 daniel 67: => started adding an xlink.[ch] with a unified API for XML and HTML.
1.37 daniel 68: it's crap :-(
1.16 daniel 69:
70: - Implement XSLT
1.19 daniel 71: => seems that someone volunteered ?!?
1.16 daniel 72:
1.18 daniel 73: - Implement XSchemas
1.37 daniel 74: => Really need to be done <grin/>
1.18 daniel 75:
1.16 daniel 76: - O2K parsing;
77: => this is a somewhat ugly mix of HTML and XML, adding a specific
78: routine in the comment parsing code of HTML and plug the XML
79: parsing one in-there should not be too hard. Key point is to get
80: XSL to transform all this to something decent ...
81:
1.18 daniel 82: - extend the shell with:
83: - edit
84: - load/save
85: - mv (yum, yum, but it's harder because directories are ordered in
86: our case, mvup and mvdown would be required)
1.16 daniel 87:
1.20 daniel 88: - Add HTML validation using the XHTML DTD
89: - problem: do we want to keep and maintain the code for handling
90: DTD/System ID cache directly in libxml ?
91:
92: - Add a DTD cache prefilled with xhtml DTDs and entities and a program to
93: manage them -> like the /usr/bin/install-catalog from SGML
94: right place seems $datadir/xmldtds
1.31 daniel 95: Maybe this is better left to user apps
1.16 daniel 96:
1.19 daniel 97: - Add output to XHTML in case of HTML documents.
98:
1.24 daniel 99:
100: Done:
101: =====
102:
1.52 veillard 103: - HTML: handling of Script and style data elements, need special code in
104: the parser and saving functions (handling of < > " ' ...):
105: http://www.w3.org/TR/html4/types.html#type-script
106: Attributes are no problems since entities are accepted.
1.48 veillard 107: - DOM needs
108: xmlAttrPtr xmlNewDocProp(xmlDocPtr doc, const xmlChar *name, const xmlChar *value)
1.46 veillard 109: - problem when parsing hrefs with & with the HTML parser (IRC ac)
110: - If the internal encoding is not UTF8 saving to a given encoding doesn't
111: work => fix to force UTF8 encoding ...
112: done, added documentation too
1.45 veillard 113: - Add an ASCII I/O encoder (asciiToUTF8 and UTF8Toascii)
1.43 veillard 114: - Issue warning when using non-absolute namespaces URI.
115: - the html parser should add <head> and <body> if they don't exist
116: started, not finished.
117: Done, the automatic closing is added and 3 testcases were inserted
1.42 daniel 118: - Command to force the parser to stop parsing and ignore the rest of the file.
1.43 veillard 119: xmlStopParser() should allow this, mostly untested
1.41 daniel 120: - support for HTML empty attributes like <hr noshade>
1.38 daniel 121: - plugged iconv() in for support of a large set of encodings.
122: - xmlSwitchToEncoding() rewrite done
1.37 daniel 123: - URI checkings (no fragments) rfc2396.txt
1.35 daniel 124: - Added a clean mechanism for overload or added input methods:
125: xmlRegisterInputCallbacks()
1.31 daniel 126: - dynamically adapt the alloc entry point to use g_alloc()/g_free()
127: if the programmer wants it:
128: - use xmlMemSetup() to reset the routines used.
129: - Check attribute normalization especially xmlGetProp()
130: - Validity checking problems for NOTATIONS attributes
131: - Validity checking problems for ENTITY ENTITIES attributes
132: - Parsing of a well balanced chunk xmlParseBalancedChunkMemory()
133: - URI module: validation, base, etc ... see uri.[ch]
134: - turn tester into a generic program xmllint installed with libxml
1.30 daniel 135: - extend validity checks to go through entities content instead of
136: just labelling them PCDATA
1.27 daniel 137: - Save Dtds using the children list instead of dumping the tables,
138: order is preserved as well as comments and PIs
139: - Wrote a notice of changes requires to go from 1.x to 2.x
140: - make sure that all SAX callbacks are disabled if a WF error is detected
141: - checking/handling of newline normalization
142: http://localhost/www.xml.com/axml/target.html#sec-line-ends
1.25 daniel 143: - correct checking of '&' '%' on entities content.
144: - checking of PE/Nesting on entities declaration
145: - checking/handling of xml:space
146: - checking done.
147: - handling done, not well tested
1.24 daniel 148: - Language identification code, productions [33] to [38]
149: => done, the check has been added and report WFness errors
150: - Conditional sections in DTDs [61] to [65]
151: => should this crap be really implemented ???
152: => Yep OASIS testsuite uses them
153: - Allow parsed entities defined in the internal subset to override
154: the ones defined in the external subset (DtD customization).
155: => This mean that the entity content should be computed only at
156: use time, i.e. keep the orig string only at parse time and expand
157: only when referenced from the external subset :-(
158: Needed for complete use of most DTD from Eve Maler
159: - Add regression tests for all WFC errors
160: => did some in test/WFC
161: => added OASIS testsuite routines
162: http://xmlsoft.org/conf/result.html
1.22 daniel 163:
1.23 daniel 164: - I18N: http://wap.trondheim.com/vaer/index.phtml is not XML and accepted
165: by the XML parser, UTF-8 should be checked when there is no "encoding"
166: declared !
1.24 daniel 167: - Support for UTF-8 and UTF-16 encoding
168: => added some convertion routines provided by Martin Durst
169: patched them, got fixes from @@@
170: I plan to keep everything internally as UTF-8 (or ISO-Latin-X)
171: this is slightly more costly but more compact, and recent processors
172: efficiency is cache related. The key for good performances is keeping
173: the data set small, so will I.
174: => the new progressive reading routines call the detection code
175: is enabled, tested the ISO->UTF-8 stuff
1.20 daniel 176: - External entities loading:
177: - allow override by client code
178: - make sure it is alled for all external entities referenced
179: Done, client code should use xmlSetExternalEntityLoader() to set
180: the default loading routine. It will be called each time an external
181: entity entity resolution is triggered.
182: - maintain ID coherency when removing/changing attributes
183: The function used to deallocate attributes now check for it being an
184: ID and removes it from the table.
185: - push mode parsing i.e. non-blocking state based parser
186: done, both for XML and HTML parsers. Use xmlCreatePushParserCtxt()
187: and xmlParseChunk() and html counterparts.
188: The tester program now has a --push option to select that parser
189: front-end. Douplicated tests to use both and check results are similar.
190:
1.18 daniel 191: - Most of XPath, still see some troubles and occasionnal memleaks.
192: - an XML shell, allowing to traverse/manipulate an XML document with
193: a shell like interface, and using XPath for the anming syntax
1.20 daniel 194: - use of readline and history added when available
195: - the shell interface has been cleanly separated and moved to debugXML.c
1.18 daniel 196: - HTML parser, should be fairly stable now
197: - API to search the lang of an attribute
198: - Collect IDs at parsing and maintain a table.
199: PBM: maintain the table coherency
200: PBM: how to detect ID types in absence of DtD !
201: - Use it for XPath ID support
202: - Add validity checking
203: Should be finished now !
1.16 daniel 204: - Add regression tests with entity substitutions
205:
206: - External Parsed entities, either XML or external Subset [78] and [79]
207: parsing the xmllang DtD now works, so it should be sufficient for
208: most cases !
209:
210: - progressive reading. The entity support is a first step toward
1.7 daniel 211: asbtraction of an input stream. A large part of the context is still
212: located on the stack, moving to a state machine and putting everyting
213: in the parsing context should provide an adequate solution.
1.8 daniel 214: => Rather than progressive parsing, give more power to the SAX-like
215: interface. Currently the DOM-like representation is built but
1.18 daniel 216: => it should be possible to define that only as a set of SAX callbacks
217: and remove the tree creation from the parser code.
218: DONE
1.8 daniel 219:
1.1 daniel 220: - DOM support, instead of using a proprietary in memory
221: format for the document representation, the parser should
222: call a DOM API to actually build the resulting document.
223: Then the parser becomes independent of the in-memory
224: representation of the document. Even better using RPC's
225: the parser can actually build the document in another
226: program.
1.8 daniel 227: => Work started, now the internal representation is by default
228: very near a direct DOM implementation. The DOM glue is implemented
1.16 daniel 229: as a separate module. See the GNOME gdome module.
230:
1.2 daniel 231: - C++ support : John Ehresman <jehresma@dsg.harvard.edu>
1.6 daniel 232: - Updated code to follow more recent specs, added compatibility flag
1.7 daniel 233: - Better error handling, use a dedicated, overridable error
234: handling function.
235: - Support for CDATA.
236: - Keep track of line numbers for better error reporting.
237: - Support for PI (SAX one).
1.8 daniel 238: - Support for Comments (bad, should be in ASAP, they are parsed
239: but not stored), should be configurable.
240: - Improve the support of entities on save (+SAX).
1.2 daniel 241:
Webmaster