CVS log for 2004/semwalker/robot_excl.pl

Keyword substitution: kv
Default branch: MAIN

Revision 1.9: download - view: text, markup, annotated - select for diffs
Wed May 26 21:14:22 2004 UTC (20 years ago) by sandro
Branches: MAIN
CVS tags: before_oct_2006_restructuring, SEMWALKER_0_8_0_RELEASE, SEMWALKER_0_8_0_B2, SEMWALKER_0_8_0_B1, HEAD
Diff to: previous 1.8: preferred, colored
Changes since revision 1.8: +5 -5 lines

in progress -- redoing retrieval to use rdf_db

Revision 1.8: download - view: text, markup, annotated - select for diffs
Thu Apr 29 20:37:06 2004 UTC (20 years, 1 month ago) by sandro
Branches: MAIN
Diff to: previous 1.7: preferred, colored
Changes since revision 1.7: +2 -2 lines

interpretive rx, general harvester stuff, load/save hack for rx

Revision 1.7: download - view: text, markup, annotated - select for diffs
Tue Apr 27 20:41:22 2004 UTC (20 years, 1 month ago) by sandro
Branches: MAIN
Diff to: previous 1.6: preferred, colored
Changes since revision 1.6: +5 -3 lines

working on harvest....

Revision 1.6: download - view: text, markup, annotated - select for diffs
Tue Apr 27 17:00:15 2004 UTC (20 years, 1 month ago) by sandro
Branches: MAIN
Diff to: previous 1.5: preferred, colored
Changes since revision 1.5: +2 -2 lines

added cache reloading (and storing more cache metadata on disk)

Revision 1.5: download - view: text, markup, annotated - select for diffs
Thu Apr 22 17:51:14 2004 UTC (20 years, 1 month ago) by sandro
Branches: MAIN
Diff to: previous 1.4: preferred, colored
Changes since revision 1.4: +2 -2 lines

change path/2 to uri_path/2

Revision 1.4: download - view: text, markup, annotated - select for diffs
Thu Apr 8 15:39:17 2004 UTC (20 years, 2 months ago) by sandro
Branches: MAIN
Diff to: previous 1.3: preferred, colored
Changes since revision 1.3: +35 -8 lines

robot exclusion seems to work

Revision 1.3: download - view: text, markup, annotated - select for diffs
Wed Apr 7 16:10:31 2004 UTC (20 years, 2 months ago) by sandro
Branches: MAIN
Diff to: previous 1.2: preferred, colored
Changes since revision 1.2: +8 -7 lines

better comments

Revision 1.2: download - view: text, markup, annotated - select for diffs
Thu Mar 18 07:07:26 2004 UTC (20 years, 2 months ago) by sandro
Branches: MAIN
Diff to: previous 1.1: preferred, colored
Changes since revision 1.1: +2 -46 lines

robot-exclusion improvements; parsing->clauses looks good

Revision 1.1: download - view: text, markup, annotated - select for diffs
Thu Mar 18 06:34:19 2004 UTC (20 years, 2 months ago) by sandro
Branches: MAIN

adding robot-exclusion support; not quite ready

Diffs between
and