Skip to main content

Clark University, Package for YouTube crawler and cleaning data

Project description

clarku-youtube-crawler

Version 0.0.1->0.0.3

This is beta without testing since python packaging is a pain. Please don't install these versions.

Version 0.0.5

Finally figured out testing. It works okay. More documentation to come. To install:

pip install clarku-youtube-crawler

Example usage

import clarku_youtube_crawler.RawCrawler as cr

After running import, go to config.ini to configure file paths. Make sure DEVELOPER_KEY.txt (or if the filename differs, configure also in config.ini) is in the same folder. Then run:

test = cr.RawCrawler()
test.__build__()
test.crawl("asmr",start_date=1, start_month=1, start_year=2020, day_count=1)
test.crawl_videos_in_list(comment_page_count=1)
test.merge_all()

If missing requirements (I already include all dependencies so it shouldn't happen), download requirements.txt here on this repo and run

$ pip install -r requirements.txt

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

clarku_youtube_crawler-0.0.5.tar.gz (6.6 kB view hashes)

Uploaded Source

Built Distribution

clarku_youtube_crawler-0.0.5-py3-none-any.whl (13.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page