webarchiver 0.12.0

Python tool that allows you to take multiple full page screenshots of web pages without ads.

Webarchiver

Version: 0.12.0

Python tool that allows you to take full page screenshots of pages without ads

Supports batching by adding multiple links in a text file, or my adding links to command line separated by commas.

Requirements:

One of the following browsers:

• Chrome/Chromium browser
• Firefox
• Selenoid Server

Usage:

Short Flag	Long Flag	Description
-h	--help	See Usage
-b	--browser	Specify browser: Chrome / Firefox / Selenoid
-c	--clean	Convert mobile sites to regular site
-d	--directory	Location where the images will be saved
	--dpi	DPI for the image
-e	--executor	Execution environmment: Local / Selenoid Host|Selenoid URL
-f	--file	Text file to read the URLs from
-l	--links	Comma separated URLs (No spaces)
-i	--image-type	Save images as PNG or JPEG
-p	--processes	Number of processes to run concurrently
-u	--url-filter	Filter URLs that contain this string
-z	--zoom	The zoom to use on the browser

Example:

webarchiver -c -f <links_file.txt> -l "<URL1,URL2,URL3>" -i 'jpeg' -d "~/Downloads" -z 100 --dpi 1 --browser "Firefox"

webarchiver -c -f <links_file.txt> -l "<URL1,URL2,URL3>" -i 'png' -d "~/Downloads" -z 100 --dpi 1 --executor "selenoid|http://selenoid.com/wd/hub" --browser "Chrome"

Install Instructions

Install Python Package

python -m pip install webarchiver

Build Instructions

Build Python Package

sudo chmod +x ./*.py
pip install .
python setup.py bdist_wheel --universal
# Test Pypi
twine upload --repository-url https://test.pypi.org/legacy/ dist/* --verbose -u "Username" -p "Password"
# Prod Pypi
twine upload dist/* --verbose -u "Username" -p "Password"