scrapy-ws(1)

scrapy-ws1

Python scrapy web service control script

Usage

scrapy-ws [{-P | -H}] action ...

Overview

Example script to control and monitor Scrapy using its web service. It only provides a reduced functionality as its main purpose is to illustrate how to write a web service client. Feel free to improve or write you own.

Options

-H

Scrapy host to connect to. (default: localhost)

-P

Scrapy port to connect to. (default: 6080)

help

List of available commands

run <spider_name>

Schedule spider for running

stop <spider>

Stop a running spider

list-running

List running spiders

list-available

List name of available spiders

list-resources

List available web service resources

list-extensions

List enabled extensions

get-spider-stats <spider>

Get stats of a running spider

get-global-stats

Get global stats

Releases

Unchanged in 2 releases since Debian 7 (Wheezy).

  1. 7–8

Author

Scrapy-ws was written by the Scrapy Developers <[email protected]>.

This manual page was written by Ignace Mouzannar <[email protected]>, for the Debian project (but may be used by others).

From python-scrapy 0.24.2-1 in Debian 8 (Jessie). Parsed by carta from the page's man source.