cewl(1)

cewl1

Custom word list generator

Usage

cewl [OPTION] ... URL

Overview

CeWL (Custom Word List generator) is a ruby app which spiders a given URL, up to a specified depth, and returns a list of words which can then be used for password crackers such as John the Ripper. Optionally, CeWL can follow external links.

CeWL can also create a list of email addresses found in mailto links. These email addresses can be used as usernames in brute force actions.

CeWL is pronounced "cool".

Options

General options

-h, --help

Show help.

-k, --keep

Keep the downloaded file.

-d <x>, --depth <x>

Depth to spider to, default 2.

-m, --min_word_length

Minimum word length, default 3.

-o, --offsite

Let the spider visit other sites.

--exclude

A file containing a list of paths to exclude.

--allowed

A regex pattern that path must match to be followed.

-w, --write

Write the output to the file.

-u, --ua <agent>

User agent to send.

-n, --no-words

Don't output the wordlist.

-g <x>, --groups <x>

Return groups of words as well.

--lowercase

Lowercase all parsed words.

--with-numbers

Accept words with numbers in as well as just letters.

--convert-umlauts

Convert common ISO-8859-1 (Latin-1) umlauts (ä-ae, ö-oe, ü-ue, ß-ss).

-a, --meta

Include meta data.

--meta_file file

Output file for meta data.

-e, --email

Include email addresses.

--email_file <file>

Output file for email addresses.

--meta-temp-dir <dir>

The temporary directory used by exiftool when parsing files, default /tmp.

-c, --count

Show the count for each word found.

-v, --verbose

Verbose.

--debug

Extra debug information.

Authentication

--auth_type

Digest or basic.

--auth_user

Authentication username.

--auth_pass

Authentication password.

Proxy Support

--proxy_host

Proxy host.

--proxy_port

Proxy port, default 8080.

--proxy_username

Username for proxy, if required.

--proxy_password

Password for proxy, if required.

Headers

--header, -H

In format name:value - can pass multiple.

<url>

The site to spider.

Tip

Sometimes, CeWL will return nothing. Use -v option to see the issue causing no output. E.g.: if '$ cewl http://example.org' is redirected to https://example.org, cewl will keep a silent.

Releases

5 releases since Debian 9 (Stretch); the text changed 3 times.

  1. 9
  2. 10–11
  3. 12
  4. 13

--allowed since Debian 12 (Bookworm); --convert-umlauts since Debian 12 (Bookworm); --debug since Debian 10 (Buster); --exclude since Debian 12 (Bookworm); --groups since Debian 12 (Bookworm); --header since Debian 10 (Buster); --lowercase since Debian 12 (Bookworm); --meta-temp-dir since Debian 12 (Bookworm); --min_word_length since Debian 12 (Bookworm); --with-numbers since Debian 10 (Buster); -H since Debian 10 (Buster); -g since Debian 12 (Bookworm); -m since Debian 12 (Bookworm).

Bugs

Someone has reported that the spider misses some pages which are have querystrings on them. This issue isn't confirmed.

Author

The CeWL was written by Robin Wood <[email protected]>.

This manual page was written by Joao Eriberto Mota Filho <[email protected]> for the Debian project (but may be used by others).

From cewl 6.2.1-1 in Debian 13 (Trixie). Parsed by carta from the page's man source.