civic-scraper 0.1.0

Command-line tool and library for scraping government agendas, minutes and other public records.

civic-scraper

civic-scraper helps download agendas, minutes and other documents produced by government. It includes a command-line tool and reusable Python code to scrape a growing number of public agency websites.

• Docs: http://civic-scraper.readthedocs.io/en/latest/

• GitHub: https://github.com/biglocalnews/civic-scraper

• PyPI: https://pypi.python.org/pypi/civic-scraper

• Free and open source software: Apache license

Basic install and usage

Install civic-scraper:

pip install civic-scraper

…and start scraping from the command line:

# Scrape today's agendas and minutes from a CivicPlus site
civic-scraper scrape --download --url http://nc-nashcounty.civicplus.com/AgendaCenter

Or in a script:

# Scrape today's agendas and minutes from a CivicPlus site
from civic_scraper.platforms import CivicPlusSite
url = "http://nc-nashcounty.civicplus.com/AgendaCenter"
site = CivicPlusSite(url)
site.scrape(download=True)

See the official docs for more details on usage.