WWW::RobotRules::DB_File3pm

Usage

    require WWW::RobotRules::DB_File;
    require LWP::RobotUA;
    #Create a robot useragent that uses a disk caching RobotRules
    $ua = WWW::RobotUA->new( 'my-robot/1.0', '[email protected]' ,
          WWW::RobotRules::DB_File->new( 'my-robot/1.0', '/path/cachefile' ));
    #The just use $ua as usual
    $res=$ua->request($req);

Overview

This is a subclass of WWW::RobotRules that uses the DB_File package to implement disk caching of robots.txt.

Methods

This is a subclass of WWW::RobotRules, so it implements the same methods

$rules = WWW::RobotRules::DB_File->new('my-robot/1.0', /path/cachefile)

This is the constructor. The only difference from the original constructor from WWW::RobotRules is that you here has to specify a cache file as well.