The XQuery and XPath Full Text 1.0 Test Suite (XQFTTS) was designed to test whether the W3C XQuery and XPath Full Text 1.0 specifcation can be implemented interoperably as published. If you have implemented XQuery and XPath Full Text 1.0, using this test suite facility is a good way to ensure that your implementation follows the specification, and to identify aspects of the specification that should be changed if there are implementability issues. Sending us your test suite results helps the XML Query and XSL Working Groups to satisfy the requirements to progress toward W3C Recommendation status.
Use CVS to get the test suite:
$ export CVSROOT=":pserver:anonymous@dev.w3.org:/sources/public" $ cvs login (Logging in to anonymous@dev.w3.org) CVS password: anonymous $ cvs get 2007/xpath-full-text-10-test-suite/
You can also browse the testsuite using CVSWeb at http://dev.w3.org/cvsweb/2007/xpath-full-text-10-test-suite/.
The XQuery and XPath Full Text 1.0 Test Suite version 1.0.4 contains over 650 test cases. It contains a catalog that contains general information on the test suite as well as test descriptions for each of the test cases included in this release. Test queries and expected results are contained in individual files. All interpretations of this Recommendation are subject to confirmation by the XML Query and XSL Working Groups.
Implementors are encouraged 1) to write a harness for this test suite and to test their implementations and 2) to report their results to the XML Query and XSL Working Groups. All of these areas are discussed in greater detail below.
This is version 1.0.4 of this test suite. The W3C XML Query WG and the W3C XSL WG believe that this is the final version of the test suite that will be published before transition is requested to Proposed Recommendation.
| Version | Date |
| XQuery and XPath Full Text 1.0 Test Suite 1_0_0 | 9 July 2009 |
| XQuery and XPath Full Text 1.0 Test Suite 1_0_1 | 25 January 2010 |
| XQuery and XPath Full Text 1.0 Test Suite 1_0_2 | 9 April 2010 |
| XQuery and XPath Full Text 1.0 Test Suite 1_0_3 | 15 October 2010 |
| XQuery and XPath Full Text 1.0 Test Suite 1_0_4 | 2 December 2010 |
We encourage you, the implementors of XQuery and XPath Full Text 1.0, to run these tests and send us your results. These results will help us exit the Candidate Recommendation stage (described in the W3C Process Document).
As there is no de jure or de facto API for implementations of XQuery, we are not able to provide a test harness to execute these tests. You will have to provide your own test harnesses.
We have provided Guidelines for Running the XQuery and XPath Full Text 1.0 Test Suite to assist you in running these tests. These guidelines will tell you how the queries may be modified before they are executed and how to compare your actual results with the expected results that we have provided.
If you believe that some of the queries or their expected results are incorrect, then we encourage you to enter bug reports in the public instance of Bugzilla at W3C, http://www.w3.org/Bugs/Public/. Please include the query and test results you believe are correct as attachments to the bug report.
To enter a bug report you will need a Bugzilla signon (email address and password). You can create this signon by following the Open a new Bugzilla account link on the Bugzilla Main Page. General information on Bugzilla, an open-source bug tracking system, is available at http://www.bugzilla.org/. The standard documentation for the version currently being run on the W3C server is available at http://www.bugzilla.org/docs/2.20/html/.
To enter a bug report in Bugzilla you will need to log in, choose the action "New", and then choose the "XPath / XQuery / XSLT" Product and the "Full Text 1.0" Component. Enter a short description of the problem in the Summary field; it would be very helpful if every Summary started with the string "[XQFTTS]". Detailed information should be entered in the Description field. Please be specific about the problem that you are reporting. Clearly identify the test case or test cases that are problematic. If you believe that the expected result is wrong, then tell us what result you believe is correct. If you believe that another result for a test case is justified, then please tell us what it is. In both cases, please cite portions of one or more of the XPath, XQuery, and Full Text specifications that support your position.
When you are ready to submit your results to us, we ask that you follow the guidelines provided in the Guidelines for Submitting XQuery and XPath Full Text 1.0 Test Suite Results. These guidelines will tell you how to generate an XML result document that we can use to generate our reports. They will also tell you how to generate your own report from the XML result file.
If you have indicated that you wish your results to be displayed as “Anonymous”, then please send them to the XML Query WG Team Contact, Liam Quin. Otherwise, please send them to Jim Melton, cc'ing www-archive@w3.org.
We encourage you to send us results early, and then to send us updates as the XPath and XQuery Full Text 1.0 Test Suite progresses and as your implementation progresses.
Distributed under both the W3C Test Suite License and the W3C 3-clause BSD License. To contribute to a W3C Test Suite, see the policies and contribution forms.
We have received test results from several implementations of XPath and XQuery Full Text 1.0.
A summary of test results can be found here.
Detailed test results can be found here.
Questions about the XPath and XQuery Full Text 1.0 Test Suite can be sent to the XQTS public mailing list. Messages sent to this list can be seen in public-xqts-comments@w3.org Mail Archives.
The following members of the XML Query Working Group and XSL Working Group participated in the development of this test suite:
Thomas Baby (Oracle), Pat Case (Library of Congress), Michael Dyck (Invited expert), Christian Grün (Universitaet Konstanz), Mary Holstege (Marklogic), Zhen Hua Liu (Oracle), Jim Melton (Oracle)