Skip to main content

Python package to handle download of multiple types of files.

Project description

Travis CI build SonarCloud Quality SonarCloud Maintainability Maintainability Pypi project Pypi total project downloads

Python package to handle the download of multiple types of files.

How do I install this package?

As usual, just download it using pip:

pip install downloaders

Usage examples

from downloaders import BaseDownloader

downloader = BaseDownloader()
urls = [...]
downloader.download(urls)

Tests Coverage

Since some software handling coverages sometimes get slightly different results, here’s three of them:

Coveralls Coverage SonarCloud Coverage Code Climate Coverage

Troubleshooting

MacOS multiprocessing nightmare fuel

Cupertino has a gift for us: somehow multiprocessing on MacOS in some specific astral configurations that I have yet to fully understand, it will crash with the following error:

The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.

Apparently, this can be easily fixed by changing the way multiprocessing spawns processes, that is:

import platform, multiprocessing

if platform.system() == "Darwin":
    multiprocessing.set_start_method('spawn')

The aforementioned solution was proposed on this StackOverflow question.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

downloaders-1.0.6.tar.gz (9.9 kB view details)

Uploaded Source

File details

Details for the file downloaders-1.0.6.tar.gz.

File metadata

  • Download URL: downloaders-1.0.6.tar.gz
  • Upload date:
  • Size: 9.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/45.2.0.post20200210 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.7.6

File hashes

Hashes for downloaders-1.0.6.tar.gz
Algorithm Hash digest
SHA256 f2095624fef1d49fef1ebd97501b4981d2aa0e13d918d3566ba0bc2ed1922068
MD5 b81201aafb48312e3978ae9b78fc486c
BLAKE2b-256 3050f3afa0397441d8c13274fc9ecc45a0acab933b9804b2374a8555064c995e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page