Fast link checker and website maintenance tool
linklint [-cache directory] [-case] [-checksum] [-concise_url] [-db1..9] [-delay d] [-doc] [-docbase base] [-dont_output xxxx] [-error] [-flush] [-forward] [-help] [-help_all] [-host hostname:port] [-host hostname] [-htmlonly] [-http] [-http_header name:value] [-ignore ignoreset] [-index file] [-language zz] [-limit n] [-list] [-local linkset] [-map /a=[/b]] [-net] [-netmod] [-netset] [-no_anchors] [-no_query_string] [-no_warn_index] [-orphan] [-out file] [-output_frames] [-output_index filename] [-password realm user:password] [-proxy hostname[:port]] [-quiet] [-redirect] [-retry] [-silent] [-skip skipset] [-textonly] [-timeout t] [-url_doc_prefix url/] [-version] [-warn] [-xref] linkset
2.3.5 August 13, 2001
This manual page documents briefly the Linklint program, which is an Open Source Perl program that checks local and remote \s-1HTML\s0 links.
This manual page was written for the Debian distribution because the original program does not have a manual page. Instead, it has documentation in the \s-1HTML\s0 format; see below.
\$1
Whether you are doing a local site check or an \s-1HTTP\s0 site check, you specify which directories (presumably containing \s-1HTML\s0 files) to check with one or more linksets. A linkset uses two wildcard characters @ and #. Each linkset specifies one or more directories much like the standard * and ? wildcard characters are used to specify the characters in the * names of files in one directory.
The @ character matches any string of characters (this kind of acts like \*(L"*\*(R"), and the # character (which is kind of like \*(L"?\*(R") matches any string of characters except \*(L"/\*(R" . The best way to understand how @ and # work is to look at a few examples:
the entire site /@
the homepage only (default) /
files in the root directory only /#
. . . and one directory down /#/#
files in the sub directory only /sub/#
files in the sub directory and below /sub/@
specific files /file1 /file2 ...
specific subdirectories /sub1/@ /sub2/@ ...
If you specify more than one linkset, files matching any of the linksets will be checked. \s-1HTML\s0 files that don't match any of the linksets will be skipped. Linklint will see if they exist but won't check any of their links.
Skips \s-1HTML\s0 files that match skipset. \*(C`Linklint\*(C' will make sure these files exist but won't add any of their links to the list of files to check. Multiple skipsets are allowed, but each must be preceded with -skip on the command line. Skipsets use the same wildcard characters as linksets.
Ignores files matching ignoreset. \*(C`Linklint\*(C' doesn't even check to see if these files exist. Multiple ignoresets are allowed, but each must be preceded with -ignore on the command line. Ignoresets use the same wildcard characters as linksets.
Limits checking to n \s-1HTML\s0 files (default 500). All \s-1HTML\s0 files after the first n are skipped. If you are developing \s-1HTML\s0 pages on a computer that does not have an http server, or if you are developing a simple site that does not use Server Redirection or extensive \s-1CGI\s0, you should use local site checking.
linklint /@
Checks all \s-1HTML\s0 files in the current directory and below. Assumes that the current directory is the server root directory so links starting with \*(L"/\*(R" default to this directory. You must specify /@ to check the entire site. See Which Files to Check for details.
linklint -root dir /@
Checks all \s-1HTML\s0 files in dir and below. This is useful if you want to check several sites on the same machine or if you don't want to run Linklint in your public \s-1HTML\s0 directory.
By default \*(C`Linklint\*(C' assumes all links on your site that start with \*(C`http://\*(C' are remote links to other sites. If you have absolute links to your own site, give \*(C`Linklint\*(C' your hostname and links starting with \*(C`http://hostname\*(C' will be treated as local files. If you specify -host hostname:port, only http links to this hostname and port will be treated as local files.
Makes sure that the filename (upper/lower) case used links inside of html tags matches the case used by the file system. This is for Windows only and is very handy if you are porting a site to a Unix host.
Checks all directories that contain files used on the site for unused (orphan) files.
Uses file as the default index file instead of the default list used by \*(C`Linklint\*(C'. You can specify more than one file but each one must be preceded by -index on the command line. If a default index file is not found, \*(C`Linklint\*(C' uses a listing of the entire directory. See the Default File section for details.
Substitutes leading /a with /b. For server-side image maps or to simulate Server Redirection.
Turns of the \*(L"index file not found\*(R" warning. Applies to local site checking only.
Tells \*(C`Linklint\*(C' to ignore named anchors. This could ease memory problems for people with large sites who are primarily interested in missing pages and not missing named anchors. This option works for both \s-1HTTP\s0 and local site checks. If you have a complicated site that uses lots of \s-1CGI\s0 or Server Redirection, you should use \s-1HTTP\s0 site checking. Even though an \s-1HTTP\s0 site check reads pages via your \s-1HTTP\s0 server, you will get the best performance if you do your checking on a machine that has a high speed connection to your server.
linklint -http -host www.site.com /@
The -http flag tells \*(C`Linklint\*(C' to check \s-1HTML\s0 files on the site www.site.com via a remote http connection. You must specify a -host whenever you do an \s-1HTTP\s0 site check (otherwise Linklint won't where to get your pages). You can specify /@ to check the entire site. See Which Files to Check for details.
This flag tells Linklint to perform an \s-1HTTP\s0 site check instead of a local site check. All files (except server side image maps) will be read via the \s-1HTTP\s0 protocol from your web server.
If you include :port at the end of your hostname, Linklint uses this port for the \s-1HTTP\s0 site check.
Uses user and password as authorization to enter password protected realm. Realms are named areas of a site that share a common set of usernames and passwords. If passwords are needed to check your site, Linklint will tell you which realms need passwords in warning messages. Enclose the realm in double quotes if it contains spaces. If no password is given for a specific realm, Linklint will try using the password for the "\*(C`DEFAULT\*(C'" realm if it was provided.
Times out after t seconds (default 15) when getting files via http. Once data is received, an additional t seconds is allowed. The timeout is disabled on Windows machines since the Windows port of Perl does not support the \*(C`alarm()\*(C' function.
Delays d seconds between requests to the same host (default 0). This is a friendly thing to do especially if you are checking many links on the same host.
Gets files that match linkset locally. The default -local linkset is @.map (which matches any link ending in .map). This allows Linklint to follow links through server-side image maps. The default is ignored if you specify your own -local expressions. You need to specify the -root directory for this option to work propery.
Substitutes leading /a with /b. For server-side image maps or to simulate Server Redirection.
Tells \*(C`Linklint\*(C' to ignore named anchors.
Up until version 2.3.4, Linklint did not use query strings while doing \s-1HTTP\s0 site checks. Query strings were removed before making \s-1HTTP\s0 requests. As of 2.3.4 query strings in links are used in the requests. Use the -no_query_string flag to get back the \*(L"old\*(R" behavior.
Adds the \s-1HTTP\s0 header Name: value to all \s-1HTTP\s0 requests generated by Linklint. You will need to use quotation marks to hide spaces in the header line from the command line interpreter. Linklint will automatically add a space after the first colon if there is not one there already. Multiple (unique) header lines are allowed.
This option is only useful if you are checking a site that uses content negotiation to present the same \s-1URL\s0 in different languages. Creates an \s-1HTTP\s0 Request header of the form Accept-Language: zz that is included as part of all \s-1HTTP\s0 requests generated by Linklint. Multiple -language specifications are allowed. This will result in a single Accept-Language: header that lists all of the languages you have specified in alphabetical order. Some web sites can use this information to return pages to you in a specific language. If you need to get more complicated than this, use the more general purpose -http_header to create your own header. There is a partial list of language abbreviations (taken from Debian) included as part of the Linklint documentation. A remote \s-1URL\s0 check is used to see if a remote \s-1URL\s0 exists (or has been recently modified). Links in the remote pages are not checked nor does Linklint look for named anchors in remote URLs.
Remote \s-1URL\s0 checking can be used to check all of the \*(L"remote\*(R" links on your site (those that link to pages on other sites) or it can check a list of URLs. There are several ways to specify which remote URLs to check:
linklint http://somehost/file.html
Checks to see if /file.html exists on somehost. Multiple URLs can be entered on the command line, in an @commandfile, or in an @@httpfile. Every \s-1URL\s0 to be checked must begin with \*(C`http://\*(C'. This will disable site checking.
linklint @@httpfile
Checks all the remote http URLs found in httpfile. Anything in the file starting with \*(C`http://\*(C' is considered to be a \s-1URL\s0. If the file looks like a remoteX.txt file generated by Linklint then all failed URLs will be cross referenced.
linklint @@ -doc linkdoc
Assuming you have already done a site check and used -doc linkdoc to put all of your output files in the linkdoc directory, Linklint will check all the remote links that were found on your site and cross reference all failed URLs without doing a site check. You can use the -netmod or -netset flags to enable the status-cache.
linklint -net [site check options]
The -net flag tells Linklint to check all remote links after doing either a local or \s-1HTTP\s0 site check site. If you are having memory problems, don't use the -net option, instead use one of the @@ options above.
Times out after t seconds (default 15) when getting files via http. Once data is received, an additional t seconds is allowed. The timeout is disabled on Windows machines since the Windows port of Perl does not support the \*(C`alarm()\*(C' function.
Delays d seconds between requests to the same host (default 0). This is a friendly thing to do especially if you are checking many links on the same host.
Checks for <meta> redirects in the headers of remote URLs that are html files. If a redirect is found it is followed. This feature is disabled if the status cache is used.
Sends all remote \s-1HTTP\s0 requests through the proxy server hostname and the optional port. This allows you to check remote URLs or (new with version 2.3.1) your entire site from within a firewall that has an http proxy server. Some error messages (relating to host errors) may not be available through a proxy server.
Turns off printing successful URLs to \s-1STDOUT\s0 during remote link checking. The Status Cache is a very powerful feature. It allows you to keep track of recent changes in all of the remote (off-site) pages you link to. You can then use the Linklint output files to quickly check changed pages to see if they still meet your needs.
The flags below make use of the status cache file linklint.url (kept in your \s-1HOME\s0 or \s-1LINKLINT\s0 directory). This file keeps track of the modification dates of all the remote URLs that you check.
Operates just like -net but makes use of the status cache. Newly checked URLs will be entered in the cache. Linklint will tell you which (previously cached) URLs have been modified since the last -netset.
Like -netmod but also resets the last modified status in the cache for all URLs that checked ok. If you always use -netset, modified URLs will be reported just once.
Only checks URLs that have a host fail status in the cache. Sometimes a \s-1URL\s0 fails because its host is temporarily down. This flag enables you to recheck just those links. An easy way to recheck all the cached URLs with host failures is \*(C`linklint @@ -retry\*(C'. Use \*(C`linklint @@linkdoc/remoteX.txt -retry\*(C' if you want failed URLs to be cross referenced.
Removes all URLs from the cache that are not currently being checked. The -retry flag has no effect on which URLs are flushed.
Ensures that every \s-1URL\s0 that has been modified is reported as such. This flag can make the remote checking take longer. Many of the pages that require a checksum are dynamically generated and will always be reported as modified.
Reads and writes the linklint.url cache file in this directory. The default directory is set by your \s-1LINKLINT\s0 or \s-1HOME\s0 environment variables. No output files are generated by default, only progress and a brief summary of the results are printed to the screen. You can produce complete documentation (split up into separate files) in a -doc directory or put selected output in a single -out file or by redirecting the standard output to a file. See the Output File Specification section for a detailed description of all output files.
Sends all output to the linkdoc directory. The output is divided into separate .txt and .html files. Complete documentation is always produced regardless of the single file flags. The file index.txt contains an index to all the other files; index.html is an \s-1HTML\s0 version of the index. The index files for remote \s-1URL\s0 checking are ur_lindex.txt and url_index.html.
Prevents any \s-1HTML\s0 files from being created in the -doc directory.
Erases redundant text files in the -doc directory after they have been used to create the \s-1HTML\s0 output files. The files remote.txt and remoteX.txt are not erased since they can be used by Linklint to recheck remote URLs.
Overrides the default base expression used for directing a browser to the resources listed in the output \s-1HTML\s0 files. The base is prepended to local links in the output \s-1HTML\s0 files. This only affects the links in \s-1HTML\s0 output files, it has no effect on what is displayed in these files. Ordinarily this flag would only be used during a local site check to set the base to \*(C`http://host\*(C'.
All \s-1HTML\s0 output data files are linked to from index.html. If you use this flag then the the data files will be opened up in a new frame (window) which can be handy in some cases since it always leaves the index.html file open in its own window.
The output index files were previously named linklint.txt and linklint.html. These have now been changed to index.txt and index.html. You can use the -output_index option to change this name back to \*(C`linklint\*(C' or to something else.
By default, the output files associate with remote \s-1URL\s0 checking all start with \*(L"url\*(R". You can change this with the -url_doc_prefix option. If the url_doc_prefix contains a \*(L"/\*(R" character then the appropriate directory will be created (as a subdirectory of the -doc directory).
Don't create output files that contain \*(L"xxxx\*(R". Can be repeated. Example: -dont_output "X$" will supress the output of all cross reference files.
Lists missing files and other errors.
Sends list output and summary information to file.
Lists all found files, links, directories etc.
Lists all warnings.
Adds cross references to the lists.
Sorts lists by referring file.
Debugs command line input and linkset expressions.
Prints the name of every file that gets checked (not just \s-1HTML\s0 files).
Debugs \s-1HTML\s0 parser, prints out tags and resulting links.
Debugs socket connection (kind of).
Not used.
Details last-modified status for remote URLs (requires -netset or -netmod).
Prints brief debug information while checking remote URLs.
Prints all http headers while checking remote URLs.
Generates random http errors.
Gives version information.
Lists a few simple examples of how to use Linklint.
Lists all help (contained in program) including every input option.
Disables printing progress to the screen.
Disables printing summarys to the screen.
Linklint is written by James B. Bowlin <[email protected]>. This manual page was written by Denis Barbier <[email protected]> for the Debian system (but may be used by others) by cut'n'paste from original documentation written in \s-1HTML\s0.