scrapydweb 0.9.1

Full-featured web UI for monitoring and controlling your Scrapyd servers

ScrapydWeb: Full-featured web UI for monitoring and controlling Scrapyd servers

Feature Support

• Multinode Scrapyd Servers

  • Group, filter and select any numbers of nodes
  • Execute command on multinodes with one click

• Scrapy Log Analysis

  • Collect statistics
  • Show crawling progress with chart
  • Extract key logs

• All Scrapyd API supported

  • Deploy project, Run Spider, Stop job
  • List projects/versions/spiders/running_jobs
  • Delete version/project

Maintainer

• my8100
• simplety(frontend)

Installation

To install ScrapydWeb, simply use pip:

$ pip install scrapydweb

Start Up

Run "scrapydweb -h" to get help, and a config file named "scrapydweb_settings.py" would be copied to the working directory, then you can custom config with it

$ scrapydweb

Visit http://127.0.0.1:5000

Screenshot

• Overview
• Dashboard
• Manage Projects
• Run Spider