carta

libwget-robots(3) on Linux

The text cd09316bd19b, as Debian 12 (Bookworm), Debian 11 (Bullseye) shipped it.

Robots Exclusion file parser

libwget-robots(3) on Linux now