CVS log for 2000/10/swap/cwm.py

Request diff between arbitrary revisions

remove failing test (not ideal) and add a documentation line

fix output bug

now ready to run sparql tests --- still need good debugging output

A month of changes

fix tabs

for timbl, slightly better support for xml literals

fix SPARQL BOUND

proof that release process still works

fix c14n and filter bug

slight changes

dont always canonicalize --- a hack

we seem to have (mostly) stabilized

fix owl:sameAs

renamed --pythink to --rete

boolean literals, and fixes for --why

small edit to to correct how pycwmko is invoked

retest regression.n3 reason/detailed.tests, pfproxy.py works and checks

grouping of statements by reason; Various bugs out, duplicate checking always in runLaborious. Passed regression.n3 and reason/details.tests

Add --chatty=6 progress about where cwm is on the command line

--n3=B flag introduced. --why improved but not perfect.

better pycwmko?

first attempt in a while at tarball

tests for sparql

more normal log:notIncludes

strange looping bug remains

a working server

my first SPARQL query

fix a spelling error in the name of loadFormulaWithSubs[t]itution

pycwmko lives! (barely)

remove support for {$,$}, fix trivial --why

merge in the performance branch. From here on out, cwm uses sets.

preformance --- change variables to sets

list ops

I\'m ready to announce the n3 tests

Fix bugs in cwm --patch
diff.py now can generate weak deltas when necessary, when the graphs are not solid.
Offline working hack in webaccess.py
Fixed bug in lllyn.py with interning of datatyped literals giving diff objects for same type  sometimes.

Added --solve option
Made it so the default is not to escape unicode characters in literals in n3 files

Yosi

undo what I did last thing Friday. Those changes are nowhere near ready for the trunk

so I have stuff to work on at home

make sure make dist_tarball does not leave around a swap/swap directory to confuse things

rdflib tests in the default test suite

see if we can get referer tags

An attempt to get setup.py working
Those changes get very annoying and kludgy
Also, string:search is implemented (not tested yet)

Yosi

fixed test system and release system

First implementation of and test for N3QL implementation in cwm.
Not widely tested.

Reification continues

Reify, and dereify. Dereify still has problems

Yosi

Added files forgotten  on previous commit

Yosi

Added working rdflib support, and a number of minor bugs fixed

Yosi

An attempt to have Cwm keep track of the files used in the regression tests
for you. It is not particularly beautiful

Yosi

see doc/changes.html and log of previous commits

--patch uses delta namespace
-- removed i18n tests
-- numerics canonicalized
see doc/changes.html

(See doc/changes.html)
on xml output, nodeID was incorrectly spelled.
update.py provides cwm's --patch option.
diff.py as independent progrem generates patch files for cwm --patch

replace registered-trademark character to avoid...

sys:1: DeprecationWarning: Non-ASCII character '\xc2' in file ../cwm.py on line 22, but no encoding declared; see http://www.python.org/peps/pep-0263.html for details

See http://www.w3.org/2000/10/swap/doc/changes.html for details
- Regresssion test incorporates the RDF Core Positive Parser Tests except XMLLiteral & reification
- xml:base support was added in the parser.
- Use the --rdf=R flag to allow RDF to be parsed even when there is no enveloping <rdf:RDF> tag
- nodeid generated on RDF output
- Automatically generated terms with no URIs sort after anything which has a URI.
- Namespace prefix smarts on output - default ns used for that most frequently used.
- suppresses namespace prefix declarations which are not actually needed in the output.
- Cwm will also make up prefixes when it needs them for a namespace, and none of the input data uses one.-
- Will not use namespace names for URIs which do not have a "#". Including a "/" in the flags overrides.

Introduced webAccess.py with  urlopenForRDF which (for now) adds an accept header ofr application/rdf+xml.
This allows cwm to get RDF versions of the W3C web site mail archive search outputs.

Merged runSmart branh, which now passes tests.
The main change is that query.n3 mapps the rules before executing them,
and then exeutes them in an order which takes account of the
interdependencies between rules.  Cyclic subsystems of rules are
isoplated, and then the rules and those subsystems formed into a DAG
and executed in a topological ordering.  This is not a full rete
system yet.
The regression test file infor and program retest.py have changed
a little, working toward resuse of tests between applications.

Checking in for safety, list/append.n3 still loops, don't use for real work

Passes regression test. (make release)

Passes regression test. (make release)

Passes regression test. (make release)

Passes regression test. (make release)

Bug fixes (using --think=; adding new data to kb after --think, etc) . passes regression tests.

List processing improves - see doc/changes.html

Passes regression test. (make release)

--dereify implemented (linear time algorithm)

Re-engineered in places - See doc changes.html

Fix --ugly to just dump data but  do dump the forSomes

Changed llyn mostly, so that the forAll and forSome pseudo-statements
are no longer stored in the formulae. Instead, each formula has a simple
list of universal vars and a list of existentials.
This means that the query engin can no longer query for forAll x. Thisis no great loss.
Also, started separating the inference engine from the store, making it
use the stores (or arther Formul's in mostcases) API instead of knowledge of internals.
Not finished, but an improvement.
Aiming to separate the pretty printer too soon.

Added caommand line flaf --closure=flags  to make a run crawl the web for more
info as it finds references to new documents.
s p o flags allow it to crawl by looking up URIs in those positions.
i should do imports and r rules but testing is minimal.
test case is test/ferrell/myDingo.n3
enjoy

Added but not completely tests --closure

added need() call, which is needed when using an LX parser after a llyn parser

Minor fixes. log:forSome and log;forAll no longer generated in xml rdf o/p

Numeric typres returned by math builtins. See http://www.w3.org/2003/04/08-cwm.html

Datatypes now used in math and time - see maths and times for old functionality - ordering changed on ntriples output - unicode test now works - some work on unicode in various places - see i18n/hiragana.n3

Datatypes added. N3 has special syntax for int and double, suppressed with --n3=n . RDF/XML input and N3 in and out done, but NOT XML output.

fixed bug in --languageOptions

Switched to import-as-needed for LX languages and engines

reflect change in LX module naming; add lbase support

CWM_RDF_PARSER environment variable can now be set to rdflib2rdf

Passes regression test

Improved documentation for Formula in llyn.py

Passes 64 retests with -n -c

Added --language=trace so I could see how an RDFSink is really called
in various situations (eg --pipe, --bySubject, ...).    This is
important for adding new languages.

Moved otter language support back from engine/otter to language/otter
Changed cwm.py to use this, and [ --engine=otter --think ] instead of
--check.

Added scaffolding for --language=htables (etc) to route through lxkb

Major shift in style of LX towards using expr.py.  Added some access
to otter, via --check.  Works as described in
http://lists.w3.org/Archives/Public/www-archive/2003Jan/0024
I don't like this UI; I imagine something more like --engine=otter
--think, and --language=otter (instead of --otterDump).
No tests for any of this.

Works without proof stuff, working on proof stuff....

--why works up to reason/t5. GK and SBP's list bugs fixed.

cleanup only

some --flatten tests fail. --why fails. Formulae must be closed to be referenced in a add()

retest ok, --why seems too work on simple cases

--why does NOT work

minor api changes probably

some minor changes to LX-formula stuff, but it's still broken in ways
that don't show up on the regression test.

mostly: moved llyn-LX conversion stuff out of llyn.py, into
LX.engine.llynInterface.py

Switched cwm main-loop to keeping state in llyn AND/OR an LX.formula,
as needed by each command-line option.  Also factored out common
language code in main loop, so cwm can handle more than just "rdf" and
"n3".  New functionality is not thoroughly tested, but old functionality
is and should be fine.  Also did a few changes to LX variable
handling.

Add rdf=T to assume RDF embedded in foreign XML to be asserted

properly indented comments, according to
http://lists.w3.org/Archives/Team/sw-team/2002Aug/0060.html
which quotes
http://www.python.org/peps/pep-0008.html

added --flatten and related development options

RemoteQuery hooks ready in llyn.py. tests 100%

uripath changes. passes 51 general tests and 25 loopback tests

cleanup: diagnostic interface, relative/absolute uri handling

minor

some changes to RDFSink mainly, a few bugs out

add new* to RDFSink.py - changing parser-store interface

Fixed (I hope) slowdown in parsing, also slight module shuffle

Add to help: --crypto for crypto processing

Require --crypto for crypto processing

Bug prevented --pipe mode from working

Probably the last commit from Crest machine. Add n3String.

minor changes. Added string:containsIgnoringCase

Passed test/retest.sh

ooops

Fixed CRs in files, added -revision to cwm

remove use of slow MoveContext  and improve cannonicalization of output

Add test/norm/fix.rdf tests for namespaces on attributes

Merged lisfix branch with main - passed retest.sh

listfix branch merged I hope

works, no crs

still not working

fixed some bugs introduced by proper unicode string handling

Add os:argv to get command line params to RDF processing

--string added, list output bugs fixed, quotation choices changed on output, log:includes hudes handles quantified variables better

alreadyDictionary introduced to check for previous bindings already found

Split store (llyn) from programs (cwm and converter-cgi)

oops! put new URISyntax error class in the wrong place!

added a bit of URI syntax checking

bugfix -- n3 output of file with statments with () as subject gave error -- partial fix

Name change resolvesTo to semantics, hasContent to content. Some schema cleanup to validate under check.n3

Error handling now notes URI of inaccessible document

factored RDFSink.py out of notation3.py

introduced SYMBOL to replace notation3.RESOURCE
introduced forSomeSym, forAllSym to replace N3_forSome_URI, N3_forAll_URI

log:uri didn't work when the literal came
from RDF/xml cuz its type was type(u"")
rather than type("")
@@I owe a test case.

Bug fixes

Split up cwm.py python modules

Fix notIncludes bug

weird

Functions of lists now work, specifically string.concatenation.

bug fix

- log:resolvesTo can parse RDF/xml as well as RDF/n3,
	and it can survive 404 errors, syntax errors

- sax2rdf follows #_formula kludge better

- ?foo parsing: varPrefix reference eliminated
  (not really sure what this code does, though)

got rid of engine global; fixed bug mid:3B8E8357.AC64D2A4@w3.org http://lists.w3.org/Archives/Public/www-archive/2001Aug/0044.html

fixed newslines. AGAIN!

First version with concat builtin taking a list

Runs most of retest, not all builtins. List handling started but not tested.

BEWARE - not very tested, 5 failures in retest. New compact internal repn of lists.

REDO: tweaked log:uri . added Literal.uriref() (currently using md5: rather than data: @@)

along with log:resolvesTo, added log:hasContent and log:n3ExprFor. TODO: prepend stuff, e.g. namespace bindings, in n3ExprFor. Think more about base URIs

changed CRLFs to LFs. again!!!

Fix crash in test/includes/uri-startswith.n3

Bug fix test/includes/uri-startswith2.n3

fixed typo in BI_uri evaluateSubject

Fixed bug in log:includes that bindings were not taken into target of includes

in order to deal with french labels in the RDF schema for RDF schema, cut over to sax-based RDF parser; groks entities now, as well as full unicode; seems to pass retest.sh, modulo prefix ordering and file:/ junk

fix --triples bug - bySubject now sorts URIs too not anons (?)

fix documentation

Now has undocumented s,p,a,r,t flags on n3 output

mmm

passes retest

Bultins added - see test/include. Passes test/retest.sh

Fix RDF bug test/jos/ziv-query.n3, order xml namespace decls. passes retest.sh

sorted @prefix directives by prefix on output

passes test/retest.sh

various improvements, -flat and -reify fixed, ...