Convert plain text file to html.
This describes version 2.51 of HTML::TextToHTML.
From the command line:
txt2html I<arguments>
From Scripts:
use HTML::TextToHTML;
# create a new object my $conv = new HTML::TextToHTML();
# convert a file $conv->txt2html(infile=>[$text_file], outfile=>$html_file, title=>"Wonderful Things", mail=>1, ]);
# reset arguments $conv->args(infile=>[], mail=>0);
# convert a string $newstring = $conv->process_chunk($mystring)
HTML::TextToHTML converts plain text files to \s-1HTML\s0. The txt2html script uses this module to do the same from the command-line.
It supports headings, tables, lists, simple character markup, and hyperlinking, and is highly customizable. It recognizes some of the apparent structure of the source document (mostly whitespace and typographic layout), and attempts to mark that structure explicitly using \s-1HTML\s0. The purpose for this tool is to provide an easier way of converting existing text documents to \s-1HTML\s0 format, giving something nicer than just whapping the text into a big \s-1PRE\s0 block.
\$1
The original txt2html script was written by Seth Golub (see http://www.aigeek.com/txt2html/), and converted to a perl module by Kathryn Andersen (see http://www.katspace.com/tools/text_to_html/) and made into a sourceforge project by Sun Tong (see http://sourceforge.net/projects/txt2html/). Earlier versions of the HTML::TextToHTML module called the included script texthyper so as not to clash with the original txt2html script, but now the projects have all been merged.
All arguments can be set when the object is created, and further options can be set when calling the actual txt2html method. Arguments to methods can take a hash of arguments.
Note that all option-names must match exactly \*(-- no abbreviations are allowed. The argument-keys are expected to have values matching those required for that argument \*(-- whether that be a boolean, a string, a reference to an array or a reference to a hash. These will replace any value for that argument that might have been there before.
append_file=>I<filename> If you want something appended by default, put the filename here. The appended text will not be processed at all, so make sure it's plain text or correct \s-1HTML\s0. i.e. do not have things like:
Mary Andersen <[email protected]>
but instead, have:
Mary Andersen <[email protected]>
(default: nothing)
append_head=>I<filename> If you want something appended to the head by default, put the filename here. The appended text will not be processed at all, so make sure it's plain text or correct \s-1HTML\s0. i.e. do not have things like:
Mary Andersen <[email protected]>
but instead, have:
Mary Andersen <[email protected]>
(default: nothing)
body_deco=>I<string> Body decoration string: a string to be added to the \s-1BODY\s0 tag so that one can set attributes to the \s-1BODY\s0 (such as class, style, bgcolor etc) For example, \*(L"class='withimage'\*(R".
bold_delimiter=>I<string> This defines what character (or string) is taken to be the delimiter of text which is to be interpreted as bold (that is, to be given a \s-1STRONG\s0 tag). If this is empty, then no bolding of text will be done. (default: #)
bullets=>I<string> This defines what single characters are taken to be \*(L"bullet\*(R" characters for unordered lists. Note that because this is used as a character class, if you use '-' it must come first. (default:-=o*\267)
bullets_ordered=>I<string> This defines what single characters are taken to be \*(L"bullet\*(R" placeholder characters for ordered lists. Ordered lists are normally marked by a number or letter followed by '.' or ')' or ']' or ':'. If an ordered bullet is used, then it simply indicates that this is an ordered list, without giving explicit numbers. Note that because this is used as a character class, if you use '-' it must come first. (default:nothing)
caps_tag=>I<tag> Tag to put around all-caps lines (default: \s-1STRONG\s0) If an empty tag is given, then no tag will be put around all-caps lines.
custom_heading_regexp=>\@custom_headings Add patterns for headings. Header levels are assigned by regexp in the order seen in the input text. When a line matches a custom header regexp, it is tagged as a header. If it's the first time that particular regexp has matched, the next available header level is associated with it and applied to the line. Any later matches of that regexp will use the same header level. Therefore, if you want to match numbered header lines, you could use something like this: my @custom_headings = ('^ *\d+\. \w+', '^ *\d+\.\d+\. \w+', '^ *\d+\.\d+\.\d+\. \w+'); ... custom_heading_regexp=>\@custom_headings, ... Then lines like " 1. Examples " " 1.1. Things" and " 4.2.5. Cold Fusion" Would be marked as H1, H2, and H3 (assuming they were found in that order, and that no other header styles were encountered). If you prefer that the first one specified always be H1, the second always be H2, the third H3, etc, then use the \*(L"explicit_headings\*(R" option. This expects a reference to an array of strings. (default: none)
default_link_dict=>I<filename> The name of the default \*(L"user\*(R" link dictionary. (default: \*(L"$ENV{'\s-1HOME\s0'}/.txt2html.dict\*(R" \*(-- this is the same as for the txt2html script. If there is no $ENV{\s-1HOME\s0} then it is just '.txt2html.dict')
demoronize=>1 Convert Microsoft-generated character codes that are non-ISO codes into something more reasonable. (default:true)
doctype=>I<doctype> This gets put in the \s-1DOCTYPE\s0 field at the top of the document, unless it's empty. Default : '-//W3C//DTD \s-1HTML\s0 4.01//EN\*(L" \*(R"http://www.w3.org/TR/html4/strict.dtd' If xhtml is true, the contents of this is ignored, unless it's empty, in which case no \s-1DOCTYPE\s0 declaration is output.
eight_bit_clean=>1 If false, convert Latin-1 characters to \s-1HTML\s0 entities. If true, this conversion is disabled; also \*(L"demoronize\*(R" is set to false, since this also changes 8-bit characters. (default: false)
escape_HTML_chars=>1 turn & < > into & > < (default: true)
explicit_headings=>1 Don't try to find any headings except the ones specified in the --custom_heading_regexp option. Also, the custom headings will not be assigned levels in the order they are encountered in the document, but in the order they are specified on the custom_heading_regexp option. (default: false)
extract=>1 Extract Mode; don't put \s-1HTML\s0 headers or footers on the result, just the plain \s-1HTML\s0 (thus making the result suitable for inserting into another document (or as part of the output of a \s-1CGI\s0 script). (default: false)
hrule_min=>I<n> Min number of ---s for an HRule. (default: 4)
indent_width=>I<n> Indents this many spaces for each level of a list. (default: 2)
indent_par_break=>1 Treat paragraphs marked solely by indents as breaks with indents. That is, instead of taking a three-space indent as a new paragraph, put in a <\s-1BR\s0> and three non-breaking spaces instead. (see also --preserve_indent) (default: false)
infile=>\@my_files infile=>['chapter1.txt', 'chapter2.txt'] The name of the input file(s). This expects a reference to an array of filenames. The special filename '-' designates \s-1STDIN\s0. See also \*(L"inhandle\*(R" and \*(L"instring\*(R". (default:-)
inhandle=>\@my_handles inhandle=>[\*MYINHANDLE, \*STDIN] An array of input filehandles; use this instead of \*(L"infile\*(R" or \*(L"instring\*(R" to use a filehandle or filehandles as input.
instring=>\@my_strings instring=>[$string1, $string2] An array of input strings; use this instead of \*(L"infile\*(R" or \*(L"inhandle\*(R" to use a string or strings as input.
italic_delimiter=>I<string> This defines what character (or string) is taken to be the delimiter of text which is to be interpreted as italic (that is, to be given a \s-1EM\s0 tag). If this is empty, no italicising of text will be done. (default: *)
underline_delimiter=>I<string> This defines what character (or string) is taken to be the delimiter of text which is to be interpreted as underlined (that is, to be given a U tag). If this is empty, no underlining of text will be done. (default: _)
links_dictionaries=>\@my_link_dicts links_dictionaries=>['url_links.dict', 'format_links.dict'] File(s) to use as a link-dictionary. There can be more than one of these. These are in addition to the Global Link Dictionary and the User Link Dictionary. This expects a reference to an array of filenames.
link_only=>1 Do no escaping or marking up at all, except for processing the links dictionary file and applying it. This is useful if you want to use the linking feature on an \s-1HTML\s0 document. If the \s-1HTML\s0 is a complete document (includes \s-1HTML\s0,HEAD,BODY tags, etc) then you'll probably want to use the --extract option also. (default: false)
lower_case_tags=>1 Force all tags to be in lower-case.
mailmode=>1 Deal with mail headers & quoted text. The mail header paragraph is given the class 'mail_header', and mail-quoted text is given the class 'quote_mail'. (default: false)
make_anchors=>0 Should we try to make anchors in headings? (default: true)
make_links=>0 Should we try to build links? If this is false, then the links dictionaries are not consulted and only structural text-to-HTML conversion is done. (default: true)
make_tables=>1 Should we try to build tables? If true, spots tables and marks them up appropriately. See \*(L"Input File Format\*(R" for information on how tables should be formatted. This overrides the detection of lists; if something looks like a table, it is taken as a table, and list-checking is not done for that paragraph. (default: false)
min_caps_length=>I<n> min sequential \s-1CAPS\s0 for an all-caps line (default: 3)
outfile=>I<filename> The name of the output file. If it is \*(L"-\*(R" then the output goes to Standard Output. (default: - )
The output filehandle; if this is given then the output goes to this filehandle instead of to the file given in \*(L"outfile\*(R".
par_indent=>I<n> Minumum number of spaces indented in first lines of paragraphs.
Only used when there's no blank line
preceding the new paragraph. (default: 2)
preformat_trigger_lines=>I<n> How many lines of preformatted-looking text are needed to switch to <\s-1PRE\s0>
<= 0 : Preformat entire document
1 : one line triggers
>= 2 : two lines trigger
(default: 2)
endpreformat_trigger_lines=>I<n> How many lines of unpreformatted-looking text are needed to switch from <\s-1PRE\s0>
<= 0 : Never preformat within document
1 : one line triggers
>= 2 : two lines trigger
(default: 2) \s-1NOTE\s0 for preformat_trigger_lines and endpreformat_trigger_lines: A zero takes precedence. If one is zero, the other is ignored. If both are zero, entire document is preformatted.
preformat_start_marker=>I<regexp> What flags the start of a preformatted section if --use_preformat_marker is true. (default: \*(L"^(:?(:?<)|<)PRE(:?(:?>)|>)\$\*(R")
preformat_end_marker=>I<regexp> What flags the end of a preformatted section if --use_preformat_marker is true. (default: \*(L"^(:?(:?<)|<)/PRE(:?(:?>)|>)\$\*(R")
preformat_whitespace_min=>I<n> Minimum number of consecutive whitespace characters to trigger normal preformatting. \s-1NOTE:\s0 Tabs are expanded to spaces before this check is made. That means if tab_width is 8 and this is 5, then one tab may be expanded to 8 spaces, which is enough to trigger preformatting. (default: 5)
prepend_file=>I<filename> If you want something prepended to the processed body text, put the filename here. The prepended text will not be processed at all, so make sure it's plain text or correct \s-1HTML\s0. (default: nothing)
preserve_indent=>1 Preserve the first-line indentation of paragraphs marked with indents by replacing the spaces of the first line with non-breaking spaces. (default: false)
short_line_length=>I<n> Lines this short (or shorter) must be intentionally broken and are kept that short. (default: 40)
style_url=>I<url> This gives the \s-1URL\s0 of a stylesheet; a \s-1LINK\s0 tag will be added to the output.
tab_width=>I<n> How many spaces equal a tab? (default: 8)
table_type=>{ ALIGN=>0, PGSQL=>0, BORDER=>1, DELIM=>0 } This determines which types of tables will be recognised when \*(L"make_tables\*(R" is true. The possible types are \s-1ALIGN\s0, \s-1PGSQL\s0, \s-1BORDER\s0 and \s-1DELIM\s0. (default: all types are true)
title=>I<title> You can specify a title. Otherwise it will use a blank one. (default: nothing)
titlefirst=>1 Use the first non-blank line as the title. (See also \*(L"title\*(R")
underline_length_tolerance=>I<n> How much longer or shorter can underlines be and still be underlines? (default: 1)
underline_offset_tolerance=>I<n> How far offset can underlines be and still be underlines? (default: 1)
unhyphenation=>0 Enables unhyphenation of text. (default: true)
use_mosaic_header=>1 Use this option if you want to force the heading styles to match what Mosaic outputs. (Underlined with \*(L"***\*(R"s is H1, with \*(L"===\*(R"s is H2, with \*(L"+++\*(R" is H3, with \*(L"---\*(R" is H4, with \*(L"~~~\*(R" is H5 and with \*(L"...\*(R" is H6) This was the behavior of txt2html up to version 1.10. (default: false)
use_preformat_marker=>1 Turn on preformatting when encountering \*(L"<\s-1PRE\s0>\*(R" on a line by itself, and turn it off when there's a line containing only \*(L"</PRE>\*(R". When such preformatted text is detected, the \s-1PRE\s0 tag will be given the class 'quote_explicit'. (default: off)
xhtml=>1 Try to make the output conform to the \s-1XHTML\s0 standard, including closing all open tags and marking empty tags correctly. This turns on --lower_case_tags and overrides the --doctype option. Note that if you add a header or a footer file, it is up to you to make it conform; the header/footer isn't touched by this. Likewise, if you make link-dictionary entries that break \s-1XHTML\s0, then this won't fix them, except to the degree of putting all tags into lower-case. (default: true)
There are global variables for setting types and levels of debugging. These should only be used by developers.
$HTML::TextToHTML::Debug = 1; Enable copious debugging output. (default: false)
$HTML::TextToHTML::DictDebug = I<n>; Debug mode for link dictionaries. Bitwise-Or what you want to see: 1: The parsing of the dictionary 2: The code that will make the links 4: When each rule matches something 8: When each tag is created (default: 0)
$conv = new HTML::TextToHTML()
$conv = new HTML::TextToHTML(titlefirst=>1, ... );
Create a new object with new. If arguments are given, these arguments will be used in invocations of other methods.
See \*(L"\s-1OPTIONS\s0\*(R" for the possible values of the arguments. $conv->args(short_line_length=>60, titlefirst=>1, .... );
Updates the current arguments/options of the HTML::TextToHTML object. Takes hash of arguments, which will be used in invocations of other methods. See \*(L"\s-1OPTIONS\s0\*(R" for the possible values of the arguments. $newstring = $conv->process_chunk($mystring);
Convert a string to a \s-1HTML\s0 fragment. This assumes that this string is at the least, a single paragraph, but it can contain more than that. This returns the processed string. If you want to pass arguments to alter the behaviour of this conversion, you need to do that earlier, either when you create the object, or with the \*(L"args\*(R" method.
$newstring = $conv->process_chunk($mystring, close_tags=>0);
If there are open tags (such as lists) in the input string, process_chunk will automatically close them, unless you specify not to, with the close_tags option.
$newstring = $conv->process_chunk($mystring, is_fragment=>1);
If you want this string to be treated as a fragment, and not assumed to be a paragraph, set is_fragment to true. If there is more than one paragraph in the string (ie it contains blank lines) then this option will be ignored. $newstring = $conv->process_para($mystring);
Convert a string to a \s-1HTML\s0 fragment. This assumes that this string is at the most a single paragraph, with no blank lines in it. If you don't know whether your string will contain blank lines or not, use the \*(L"process_chunk\*(R" method instead.
This returns the processed string. If you want to pass arguments to alter the behaviour of this conversion, you need to do that earlier, either when you create the object, or with the \*(L"args\*(R" method.
$newstring = $conv->process_para($mystring, close_tags=>0);
If there are open tags (such as lists) in the input string, process_para will automatically close them, unless you specify not to, with the close_tags option.
$newstring = $conv->process_para($mystring, is_fragment=>1);
If you want this string to be treated as a fragment, and not assumed to be a paragraph, set is_fragment to true. $conv->txt2html(%args);
Convert a text file to \s-1HTML\s0. Takes a hash of arguments. See \*(L"\s-1OPTIONS\s0\*(R" for the possible values of the arguments. Arguments which have already been set with new or args will remain as they are, unless they are overridden.
These are methods used internally, only of interest to developers. $self->init_our_data();
Initializes the internal object data. $self->deal_with_options();
do extra processing related to particular options $newtext = escape($text);
Escape & < and > $newtext = demoronize_char($text);
Convert Microsoft character entities into characters.
Added by Alan Jackson, alan at ajackson dot org, and based on the demoronize script by John Walker, http://www.fourmilab.ch/ $newtext = demoronize_code($text);
convert Microsoft character entities into \s-1HTML\s0 code $tag = $self->get_tag($in_tag);
$tag = $self->get_tag($in_tag, tag_type=>\s-1TAG_START\s0, inside_tag=>'');
output the tag wanted (add the <> and the / if necessary) - output in lower or upper case - do tag-related processing options:
tag_type=>\s-1TAG_START\s0 | tag_type=>\s-1TAG_END\s0 | tag_type=>\s-1TAG_EMPTY\s0 (default start) inside_tag=>string (default empty)
$tag = $self->close_tag($in_tag);
close the open tag $self->hrule(para_lines_ref=>$para_lines, para_action_ref=>$para_action, ind=>0);
Deal with horizontal rules. $self->shortline(line_ref=>$line_ref, line_action_ref=>$line_action_ref, prev_ref=>$prev_ref, prev_action_ref=>$prev_action_ref, prev_line_len=>$prev_line_len);
Deal with short lines. if ($self->is_mailheader(rows_ref=>$rows_ref)) { ... }
Is this a mailheader line? $self->mailheader(rows_ref=>$rows_ref);
Deal with a mailheader. $self->mailquote(line_ref=>$line_ref, line_action_ref=>$line_action_ref, prev_ref=>$prev_ref, prev_action_ref=>$prev_action_ref, next_ref=>$next_ref);
Deal with quoted mail. $newvector = subtract_modes($vector, $mask);
Subtracts modes listed in $mask from $vector. $self->paragraph(line_ref=>$line_ref, line_action_ref=>$line_action_ref, prev_ref=>$prev_ref, prev_action_ref=>$prev_action_ref, line_indent=>$line_indent, prev_indent=>$prev_indent, is_fragment=>$is_fragment, ind=>$ind);
Detect paragraph indentation. ($prefix, $number, $rawprefix, $term) = $self->listprefix($line);
Detect and parse a list item. $self->startlist(prefix=>$prefix, number=>0, rawprefix=>$rawprefix, term=>$term, para_lines_ref=>$para_lines_ref, para_action_ref=>$para_action_ref, ind=>0, prev_ref=>$prev_ref, total_prefix=>$total_prefix);
Start a list. $self->endlist(num_lists=>0, prev_ref=>$prev_ref, line_action_ref=>$line_action_ref);
End N lists $self->continuelist(para_lines_ref=>$para_lines_ref, para_action_ref=>$para_action_ref, ind=>0, term=>$term);
Continue a list. $self->liststuff(para_lines_ref=>$para_lines_ref, para_action_ref=>$para_action_ref, para_line_indent_ref=>$para_line_indent_ref, ind=>0, prev_ref=>$prev_ref);
Process a list (higher-level method). $table_type = $self->get_table_type(rows_ref=>$rows_ref, para_len=>0);
Figure out the table type of this table, if any if ($self->is_aligned_table(rows_ref=>$rows_ref, para_len=>0)) { ... }
Check if the given paragraph-array is an aligned table if ($self->is_pgsql_table(rows_ref=>$rows_ref, para_len=>0)) { ... }
Check if the given paragraph-array is a Postgresql table (the ascii format produced by Postgresql)
A \s-1PGSQL\s0 table can start with an optional table-caption,
then it has a row of column headings separated by | then it has a row of ------+----- then it has one or more rows of column values separated by | then it has a row-count (N rows) if ($self->is_border_table(rows_ref=>$rows_ref, para_len=>0)) { ... }
Check if the given paragraph-array is a Border table.
A \s-1BORDER\s0 table can start with an optional table-caption,
then it has a row of +------+-----+ then it has a row of column headings separated by | then it has a row of +------+-----+ then it has one or more rows of column values separated by | then it has a row of +------+-----+ if ($self->is_delim_table(rows_ref=>$rows_ref, para_len=>0)) { ... }
Check if the given paragraph-array is a Delimited table.
A \s-1DELIM\s0 table can start with an optional table-caption, then it has at least two rows which start and end and are punctuated by a non-alphanumeric delimiter.
| val1 | val2 | | val3 | val4 | $self->tablestuff(table_type=>0, rows_ref=>$rows_ref, para_len=>0);
Process a table. $self->make_aligned_table(rows_ref=>$rows_ref, para_len=>0);
Make an Aligned table. $self->make_pgsql_table(rows_ref=>$rows_ref, para_len=>0);
Make a \s-1PGSQL\s0 table. $self->make_border_table(rows_ref=>$rows_ref, para_len=>0);
Make a \s-1BORDER\s0 table. $self->make_delim_table(rows_ref=>$rows_ref, para_len=>0);
Make a Delimited table. if ($self->is_preformatted($line)) { ... }
Returns true if the passed string is considered to be preformatted. $front = $self->split_end_explicit_preformat(para_ref=>$para_ref);
Modifies the given string, and returns the front preformatted part. $self->endpreformat(para_lines_ref=>$para_lines_ref, para_action_ref=>$para_action_ref, ind=>0, prev_ref=>$prev_ref);
End a preformatted section. $self->preformat(mode_ref=>$mode_ref, line_ref=>$line_ref, line_action_ref=>$line_action_ref, prev_ref=>$prev_ref, next_ref=>$next_ref, prev_action_ref);
Detect and process a preformatted section. $anchor = $self->make_new_anchor($heading_level);
Make a new anchor. $self->anchor_mail($line_ref);
Make an anchor for a mail section. $self->anchor_heading($heading_level, $line_ref);
Make an anchor for a heading. $self->heading_level($style);
Add a new heading style if this is a new heading style. if ($self->is_ul_list_line($line)) { ... }
Tests if this line starts a \s-1UL\s0 list item. if ($self->is_heading(line_ref=>$line_ref, next_ref=>$next_ref)) { ... }
Tests if this line is a heading. Needs to take account of the next line, because a standard heading is defined by \*(L"underlining\*(R" the text of the heading. $self->heading(line_ref=>$line_ref, next_ref=>$next_ref);
Make a heading. Assumes is_heading is true. if ($self->is_custom_heading($line)) { ... }
Check if the given line matches a custom heading. $self->custom_heading(line_ref=>$line_ref);
Make a custom heading. Assumes is_custom_heading is true. $self->unhyphenate_para($para_ref);
Join up hyphenated words that are split across lines. $self->tagline($tag, $line_ref);
Put the given tag around the given line. if ($self->iscaps($line)) { ... }
Check if a line is all capitals. $self->caps(line_ref=>$line_ref, line_action_ref=>$line_action_ref);
Detect and deal with an all-caps line. $self->do_delim(line_ref=>$line_ref, line_action_ref=>$line_action_ref, delim=>'*', tag=>'STRONG');
Deal with a line which has words delimited by the given delimiter; this is used to deal with italics, bold and underline formatting. $regexp = glob2regexp($glob);
Convert very simple globs to regexps $self->add_regexp_to_links_table(label=>$label, pattern=>$pattern, url=>$url, switches=>$switches);
Add the given regexp \*(L"link definition\*(R" to the links table. $self->add_literal_to_links_table(label=>$label, pattern=>$pattern, url=>$url, switches=>$switches);
Add the given literal \*(L"link definition\*(R" to the links table. $self->add_glob_to_links_table(label=>$label, pattern=>$pattern, url=>$url, switches=>$switches);
Add the given glob \*(L"link definition\*(R" to the links table. $self->parse_dict($dictfile, $dict);
Parse the dictionary file. (see also load_dictionary_links, for things that were stripped) $self->setup_dict_checking();
Set up the dictionary checking. if ($self->in_link_context($match, $before)) { ... }
Check if we are inside a link (<a ...>); certain kinds of substitution are not allowed here. $self->apply_links(para_ref=>$para_ref, para_action_ref=>$para_action_ref);
Apply links and formatting to this paragraph. $self->check_dictionary_links(line_ref=>$line_ref, line_action_ref=>$line_action_ref);
Check (and alter if need be) the bits in this line matching the patterns in the link dictionary. $self->load_dictionary_links();
Load the dictionary links. $self->do_file_start($outhandle, $para);
Extra stuff needed for the beginning: \s-1HTML\s0 headers, and prepending a file if desired. $self->do_init_call();
Certain things, like reading link dictionaries, need to be done only once.
There are two files which are used which can affect the outcome of the conversion. One is the link dictionary, which contains patterns (of how to recognise http links and other things) and how to convert them. The other is, naturally, the format of the input file itself. A link dictionary file contains patterns to match, and what to convert them to. It is called a \*(L"link\*(R" dictionary because it was intended to be something which defined what a href link was, but it can be used for more than that. However, if you wish to define your own links, it is strongly advised to read up on regular expressions (regexes) because this relies heavily on them.
The file consists of comments (which are lines starting with #) and blank lines, and link entries. Each entry consists of a regular expression, a -> separator (with optional flags), and a link \*(L"result\*(R".
In the simplest case, with no flags, the regular expression defines the pattern to look for, and the result says what part of the regular expression is the actual link, and the link which is generated has the href as the link, and the whole matched pattern as the visible part of the link. The first character of the regular expression is taken to be the separator for the regex, so one could either use the traditional / separator, or something else such as | (which can be helpful with URLs which are full of / characters).
So, for example, an ftp \s-1URL\s0 might be defined as:
|ftp:[\w/\.:+\-]+| -> $&
This takes the whole pattern as the href, and the resultant link has the same thing in the href as in the contents of the anchor.
But sometimes the href isn't the whole pattern.
/<URL:\s*(\S+?)\s*>/ --> $1
With the above regex, a () grouping marks the first subexpression, which is represented as $1 (rather than $& the whole expression). This entry matches a \s-1URL\s0 which was marked explicity as a \s-1URL\s0 with the pattern <URL:foo> (note the < is shown as the entity, not the actual character. This is because by the time the links dictionary is checked, all such things have already been converted to their \s-1HTML\s0 entity forms, unless, of course, the escape_HTML_chars option was turned off) This would give us a link in the form <A HREF=\*(L"foo\*(R"><URL:foo></A>
The h flag
However, if we want more control over the way the link is constructed, we can construct it ourself. If one gives the h flag, then the \*(L"result\*(R" part of the entry is taken not to contain the href part of the link, but the whole link.
For example, the entry:
/<URL:\s*(\S+?)\s*>/ -h-> <A HREF="$1">$1</A>
will take <URL:foo> and give us <A HREF=\*(L"foo\*(R">foo</A>
However, this is a very powerful mechanism, because it can be used to construct custom tags which aren't links at all. For example, to flag *italicised words* the following entry will surround the words with \s-1EM\s0 tags.
/\B\*([a-z][a-z -]*[a-z])\*\B/ -hi-> <EM>$1</EM>
The i flag
This turns on ignore case in the pattern matching.
The e flag
This turns on execute in the pattern substitution. This really only makes sense if h is turned on too. In that case, the \*(L"result\*(R" part of the entry is taken as perl code to be executed, and the result of that code is what replaces the pattern.
The o flag
This marks the entry as a once-only link. This will convert the first instance of a matching pattern, and ignore any others further on.
For example, the following pattern will take the first mention of HTML::TextToHTML and convert it to a link to the module's home page.
"HTML::TextToHTML" -io-> http://www.katspace.com/tools/text_to_html/ For the most part, this module tries to use intuitive conventions for determining the structure of the text input. Unordered lists are marked by bullets; ordered lists are marked by numbers or letters; in either case, an increase in indentation marks a sub-list contained in the outer list.
Headers (apart from custom headers) are distinguished by \*(L"underlines\*(R" underneath them; headers in all-capitals are distinguished from those in mixed case. All headers, both normal and custom headers, are expected to start at the first line in a \*(L"paragraph\*(R".
In other words, the following is a header:
I am Head Man -------------
But the following does not have a header:
I am not a head Man, man I am Head Man -------------
Tables require a more rigid convention. A table must be marked as a separate paragraph, that is, it must be surrounded by blank lines. Tables come in different types. For a table to be parsed, its --table_type option must be on, and the --make_tables option must be true.
\s-1ALIGN\s0 Table Type
Columns must be separated by two or more spaces (this prevents accidental incorrect recognition of a paragraph where interword spaces happen to line up). If there are two or more rows in a paragraph and all rows share the same set of (two or more) columns, the paragraph is assumed to be a table. For example
-e File exists. -z File has zero size. -s File has nonzero size (returns size).
becomes
<table> <tr><td>-e</td><td>File exists.</td></tr> <tr><td>-z</td><td>File has zero size.</td></tr> <tr><td>-s</td><td>File has nonzero size (returns size).</td></tr> </table>
This guesses for each column whether it is intended to be left, centre or right aligned.
\s-1BORDER\s0 Table Type
This table type has nice borders around it, and will be rendered with a border, like so:
+---------+---------+ | Column1 | Column2 | +---------+---------+ | val1 | val2 | | val3 | val3 | +---------+---------+
The above becomes
<table border="1"> <thead><tr><th>Column1</th><th>Column2</th></tr></thead> <tbody> <tr><td>val1</td><td>val2</td></tr> <tr><td>val3</td><td>val3</td></tr> </tbody> </table>
It can also have an optional caption at the start.
My Caption +---------+---------+ | Column1 | Column2 | +---------+---------+ | val1 | val2 | | val3 | val3 | +---------+---------+
\s-1PGSQL\s0 Table Type
This format of table is what one gets from the output of a Postgresql query.
Column1 | Column2 ---------+--------- val1 | val2 val3 | val3 (2 rows)
This can also have an optional caption at the start. This table is also rendered with a border and table-headers like the \s-1BORDER\s0 type.
\s-1DELIM\s0 Table Type
This table type is delimited by non-alphanumeric characters, and has to have at least two rows and two columns before it's recognised as a table.
This one is delimited by the '| character:
| val1 | val2 | | val3 | val3 |
But one can use almost any suitable character such as : # $ % + and so on. This is clever enough to figure out what you are using as the delimiter if you have your data set up like a table. Note that the line has to both begin and end with the delimiter, as well as using it to separate values.
This can also have an optional caption at the start.
use HTML::TextToHTML; my $conv = new HTML::TextToHTML();
my $conv = new HTML::TextToHTML(title=>"Wonderful Things", default_link_dict=>$my_link_file, ); $conv->args(short_line_length=>60, preformat_trigger_lines=>4, caps_tag=>"strong", ); $conv->txt2html(infile=>[$text_file], outfile=>$html_file, title=>"Wonderful Things", mail=>1 ); open(IN, "ls |") or die "could not open!"; $conv->txt2html(inhandle=>[\*IN], outfile=>'-', );
If the underline used to mark a header is off by more than 1, then that part of the text will not be picked up as a header unless you change the value of --underline_length_tolerance and/or --underline_offset_tolerance. People tend to forget this.
HTML::TextToHTML requires Perl 5.8.1 or later.
For installation, it needs:
Module::Build
The txt2html script needs:
Getopt::Long Getopt::ArgvFile Pod::Usage File::Basename
For testing, it also needs:
Test::More
For debugging, it also needs:
YAML::Syck
Make sure you have the dependencies installed first! (see \s-1REQUIRES\s0 above)
Some of those modules come standard with more recent versions of perl, but I thought I'd mention them anyway, just in case you may not have them.
If you don't know how to install these, try using the \s-1CPAN\s0 module, an easy way of auto-installing modules from the Comprehensive Perl Archive Network, where the above modules reside. Do \*(L"perldoc perlmodinstall\*(R" or \*(L"perldoc \s-1CPAN\s0\*(R" for more information.
To install this module type the following:
perl Build.PL ./Build ./Build test ./Build install
Or, if you're on a platform (like \s-1DOS\s0 or Windows) that doesn't like the \*(L"./\*(R" notation, you can do this:
perl Build.PL perl Build perl Build test perl Build install
In order to install somewhere other than the default, such as in a directory under your home directory, like \*(L"/home/fred/perl\*(R" go
perl Build.PL --install_base /home/fred/perl
as the first step instead.
This will install the files underneath /home/fred/perl.
You will then need to make sure that you alter the \s-1PERL5LIB\s0 variable to find the modules, and the \s-1PATH\s0 variable to find the script.
Therefore you will need to change: your path, to include /home/fred/perl/script (where the script will be)
PATH=/home/fred/perl/script:${PATH}
the \s-1PERL5LIB\s0 variable to add /home/fred/perl/lib
PERL5LIB=/home/fred/perl/lib:${PERL5LIB}
Note that the system links dictionary will be installed as \*(L"/home/fred/perl/share/txt2html/txt2html.dict\*(R"
If you want to install in a temporary install directory (such as if you are building a package) then instead of going
perl Build install
go
perl Build install destdir=/my/temp/dir
and it will be installed there, with a directory structure under /my/temp/dir the same as it would be if it were installed plain. Note that this is \s-1NOT\s0 the same as setting --install_base, because certain things are done at build-time which use the install_base info.
See \*(L"perldoc perlrun\*(R" for more information on \s-1PERL5LIB\s0, and see \*(L"perldoc Module::Build\*(R" for more information on installation options.
Tell me about them.
perl txt2html.
Kathryn Andersen (RUBYKAT) perlkat AT katspace dot com http//www.katspace.com/
based on txt2html by Seth Golub
Original txt2html script copyright (c) 1994-2000 Seth Golub <seth \s-1AT\s0 aigeek.com>
Copyright (c) 2002-2005 by Kathryn Andersen
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.