libwget-robots(3) on Linux
The text fab32c8d9472, as Debian 13 (Trixie) shipped it. The page shows this text now.
Robots Exclusion file parser
The text fab32c8d9472, as Debian 13 (Trixie) shipped it. The page shows this text now.
Robots Exclusion file parser