Skip to main content

A package to download several URL as one, as well as supporting multi-part URLs

Project description

multiurl

A package to download several URL as one, as well as supporting multi-part URLs

Simple example

from multiurl import download

download(url="http://example.com/test.data",
         target="data.file")

Download from two URLs into one file

from multiurl import download

download(url=["http://example.com/test1.data",
              "http://example.com/test2.data"],
         target="data.file")

URLs types can be mixed:

from multiurl import download

download(url=["http://example.com/test1.data",
              "ftp://example.com/test2.data"],
         target="data.file")

Download parts of URLs

Provide parts of URLs as a list of (offset, length) tuples, expressed in bytes.

from multiurl import download

download(url="http://example.com/test.data",
         parts = [(0, 10), (40, 10), (60, 10)],
         target="data.file")

Download parts of URLs form several URLs

from multiurl import download

download(url=[("http://example.com/test1.data", [(0, 10), (40, 10), (60, 10)]),
              ("http://example.com/test2.data", [(0, 10), (40, 10), (60, 10)])],
         target="data.file")

License

Apache License 2.0 In applying this licence, ECMWF does not waive the privileges and immunities granted to it by virtue of its status as an intergovernmental organisation nor does it submit to any jurisdiction.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

multiurl-0.0.11.tar.gz (15.9 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page