Annotation of charlint/Overview.html, revision 1.18
1.1 duerst 1: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"
2: "http://www.w3.org/TR/REC-html40/loose.dtd">
3: <HTML>
4: <HEAD>
5: <META http-equiv="Content-Type" content="text/html; charset=ISO-8859-1">
6: <META http-equiv="Content-Style-Type" content="text/css">
7: <!--BASE href="http://www.w3.org/Consortium/Translation/"-->
8: <!--LINK rel="stylesheet" href="../i18n.css"-->
9: <STYLE type="text/css">
10: <!--
11: H1.title {text-align: center }
12: P.toolbar { text-align: center }
13: DIV.deliverable { margin-left: 2em;
14: margin-right: 2em }
15: P.note { margin-left: 10%;
16: margin-right: 10%;
17: color: green }
18: TH { text-align: left }
19: TH, TD { padding: 2px }
20: .external { font-style: italic }
21: -->
22: </STYLE>
1.17 duerst 23: <TITLE>Charlint - A Character Normalization Tool</TITLE>
1.1 duerst 24: <LINK rel="stylesheet" type="text/css" href="../../StyleSheets/base.css">
25: </HEAD>
26: <BODY bgcolor="#FFFFFF" text="#000000">
27: <P>
28: <A HREF="/"><IMG BORDER="0" ALT="W3C" WIDTH="72" HEIGHT="48" SRC="w3c_home"></A>
29: <H1>
1.3 duerst 30: Charlint - A Character Normalization Tool
1.1 duerst 31: </H1>
1.3 duerst 32: <P>
1.7 duerst 33: <A href="#Perl">Perl source</A> | <A HREF="#Recommended">Recommended Character
1.15 duerst 34: Data File</A> | <A HREF="#How">How to use</A> | <A HREF="#Future">Future
35: Plans</A> | Background | Version History
1.4 duerst 36: <H3>
1.12 duerst 37: <A NAME="Perl">Perl Source</A> and Installation
1.4 duerst 38: </H3>
1.3 duerst 39: <P>
1.4 duerst 40: Charlint is writen in Perl 5. You can get the source from
41: <A HREF="http://www.w3.org/International/charlint/charlint.pl">http://www.w3.org/International/charlint/charlint.pl</A>.
1.5 duerst 42: Charlint is covered by the
43: <A HREF="http://www.w3.org/Consortium/Legal/copyright-software.html">W3C
1.12 duerst 44: software licence</A>. To install charlint, please make sure you have installed
45: Perl 5, you have downloaded an appropriate character data file, and you have
1.13 duerst 46: downloaded the Perl source.
1.6 duerst 47: <H3>
1.7 duerst 48: <A NAME="Recommended">Recommended Character Data File</A>
1.6 duerst 49: </H3>
1.1 duerst 50: <P>
1.7 duerst 51: Charlint needs information on characters in order to work correctly. To indicate
52: the file you want to use, please use the -f option. The currently recommended
1.8 duerst 53: character data file is available from
54: <A HREF="ftp://ftp.unicode.org/Public/3.0-Update/UnicodeData-3.0.0.beta.txt">ftp://ftp.unicode.org/Public/3.0-Update/UnicodeData-3.0.0.beta.txt</A>.
1.16 duerst 55: Composition exclusions are currently hard-coded and are based on
56: <A HREF="ftp://ftp.unicode.org/Public/3.0-Update/CompositionExclusions-1.beta.txt">ftp://ftp.unicode.org/Public/3.0-Update/CompositionExclusions-1.beta.txt</A>.
1.18 ! duerst 57: Additional information on these and other files can be found at
1.9 duerst 58: <A HREF="http://www.unicode.org/unicode/standard/versions/Unicode3.0-beta.html">http://www.unicode.org/unicode/standard/versions/Unicode3.0-beta.html</A>.
1.10 duerst 59: Please note that this data file is a beta version; the beta test will last
60: up to 15 August 1999. Using charlint is one way to test this data file. Please
61: send any comments on <EM>the data file</EM> to
62: <A HREF="mailto:errata@unicode.org">errata@unicode.org</A>.
1.1 duerst 63: <H3>
1.12 duerst 64: <A NAME="How">How to use charlint</A>
1.11 duerst 65: </H3>
66: <P>
1.15 duerst 67: Charlint is a perl script that works as a simple filter. It uses UTF-8 both
68: for input and for output. Behaviour can be fine-tuned with various options.
69: A list of options as the one below can be optained by using <KBD>charlint
70: -h</KBD>.
71: <PRE>(options prefixed by # are currently not available)
1.14 duerst 72: -b: Remove initial 'Byte Order Mark'
73: -B: Supress warning about initial 'Byte Order Mark'
74: -d: Debug: Thoroughly check character data table input
75: -D: Leave after reading in character data
76: -e: # remove undefined codepoints
77: -E: Do not warn about undefined codepoints
78: -f file: Read data from file
79: (please use newest V3.0 beta datafiles)
80: -C: # Do not normalize
81: -h: Prints out this short description
82: -n: Accept &#ddddd; and &#xhhhh; on input
83: (beware of <![CDATA[, <SCRIPT>, <STYLE>)
84: -N: Produce &#xhh; on output
85: -o: Print out 'unprintable' bytes as octal
86: -p: # Remove stuff in private zone
87: -P: Supress checking private zone
88: -u: # Fix UTF-8 (convert or remove)
89: -U: Supress checking correctness of UTF-8
90: -v: Print version
91: </PRE>
1.11 duerst 92: <H3>
1.15 duerst 93: <A NAME="Future">Future Plans</A>
1.1 duerst 94: </H3>
1.15 duerst 95: <P>
96: We have just released the first version of charlint. There are many things
97: we plan to add in the future:
98: <UL>
99: <LI>
100: Hangul syllable normalization
101: <LI>
102: Removal of undefined codepoints and codepoints in the private zone
103: <LI>
104: Removal/fix of incorrect UTF-8
105: </UL>
1.1 duerst 106: <P>
107: <HR>
108: <ADDRESS>
109: <A HREF="mailto:duerst@w3.org">Martin Dürst</A> <BR>
110: <A HREF="../Help/Webmaster.html">Webmaster</A> <BR>
111: last revised $Date: 1999/06/23 12:51:49 $ by $Author: connolly $
112: </ADDRESS>
113: <P class=policyfooter>
114: <SMALL><A href="/Consortium/Legal/ipr-notice.html#Copyright">Copyright</A>
115: © 1997 <A href="http://www.w3.org">W3C</A>
116: (<A href="http://www.lcs.mit.edu">MIT</A>,
117: <A href="http://www.inria.fr/">INRIA</A>,
118: <A href="http://www.keio.ac.jp/">Keio</A> ), All Rights Reserved. W3C
119: <A href="/Consortium/Legal/ipr-notice.html#Legal Disclaimer">liability,</A>
120: <A href="/Consortium/Legal/ipr-notice.html#W3C Trademarks">trademark</A>,
121: <A href="/Consortium/Legal/copyright-documents.html">document use </A>and
122: <A href="/Consortium/Legal/copyright-software.html">software licensing
123: </A>rules apply. Your interactions with this site are in accordance with
124: our <A href="/Consortium/Legal/privacy-statement.html#Public">public</A>
125: and <A href="/Consortium/Legal/privacy-statement.html#Members">Member</A>
126: privacy statements.</SMALL>
127: </BODY></HTML>
Webmaster
![[BACK]](/cvsweb/icons/back.gif){kind=icon}
Return to Overview.html CVS log ![[TXT]](/cvsweb/icons/text.gif){kind=icon}
![[DIR]](/cvsweb/icons/dir.gif){kind=icon}
Up to [Public] / charlint