Workflow manager for Zyte ScrapyCloud tasks.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for kalessin from gravatar.com kalessin

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: BSD License (BSD)
  • Maintainer: Scrapinghub
Classifiers
Report project as malware

Project description

A set of tools for controlling processing workflow with spiders and script running in scrapinghub ScrapyCloud.

Installation

pip install shub-workflow

If you want to support s3 tools:

pip install shub-workflow[with-s3-tools]

For google cloud storage tools support:

pip install shub-workflow[with-gcs-tools]

Usage

Check Project Wiki for documentation. You can also see code tests for lots of examples of usage.

Note

The requirements for this library are defined in setup.py as usual. The Pipfile files in the repository don't define dependencies. It is only used for setting up a development environment for shub-workflow library development and testing.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for kalessin from gravatar.com kalessin

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: BSD License (BSD)
  • Maintainer: Scrapinghub
Classifiers

Release history Release notifications | RSS feed

1.14.31.1

1.14.31

1.14.30.3

1.14.30.2

1.14.30.1

1.14.30

1.14.29

1.14.28.2

1.14.28.1

1.14.27.3

1.14.27.2

1.14.27.1

1.14.27

1.14.26.15

1.14.26.14

1.14.26.13

1.14.26.12

1.14.26.11

1.14.26.10

1.14.26.9

1.14.26.8

1.14.26.7

1.14.26.6

1.14.26.5

1.14.26.4

1.14.26.3

1.14.26

1.14.25.1

1.14.25

1.14.24

1.14.23

1.14.22

1.14.21.17

1.14.21.16

1.14.21.15

1.14.21.14

1.14.21.13

1.14.21.12

1.14.21.11

1.14.21.10

1.14.21.9

1.14.21.8

1.14.21.7

1.14.21.6

1.14.21.5

1.14.21.4

1.14.21.3

1.14.21.2

1.14.21.1

1.14.21

1.14.20.16

1.14.20.15

1.14.20.14

1.14.20.13

1.14.20.12

1.14.20.11

1.14.20.10

1.14.20.9

1.14.20.8

1.14.20.7

1.14.20.6

1.14.20.5

1.14.20.4

1.14.20.3

1.14.20.2

1.14.20.1

1.14.20

1.14.19.2

1.14.19.1

1.14.19

1.14.18

1.14.17.1

1.14.17

1.14.16.4

1.14.16.3

1.14.16.2

1.14.16.1

1.14.16

1.14.15.3

1.14.15.2

1.14.15.1

1.14.15

1.14.14

1.14.13.4

1.14.13.3

1.14.13.2

1.14.13.1

1.14.13

1.14.12

1.14.11

1.14.10.4

1.14.10.3

1.14.10.2

1.14.10.1

1.14.10

1.14.9.1

1.14.9

1.14.8.1

1.14.8

1.14.7.1

1.14.7

1.14.6

1.14.5.2

1.14.5.1

1.14.5

1.14.4.1

1.14.4

1.14.3.2

1.14.3.1

1.14.2.8

1.14.2.7

1.14.2.6

1.14.2.5

1.14.2.4

1.14.2.3

1.14.2.2

1.14.2.1

1.14.2

1.14.1.2

1.14.1.1

1.14.0.3

1.14.0.2

1.13.8.4

1.13.8.3

1.13.8.2

1.13.8.1

1.13.8

1.13.7.2

1.13.7.1

1.13.7

1.13.6

1.13.5

1.13.4.1

1.13.3

1.13.2.3

1.13.2.2

1.13.2.1

1.13.2

1.13.1.4

1.13.1.3

1.13.1.2

This version

1.13.1.1

1.13.1

1.13.0.2

1.13.0.1

1.13

1.12.4.1

1.12.4

1.12.3.8

1.12.3.7

1.12.3.6

1.12.3.5

1.12.3.4

1.12.3.3

1.12.3.2

1.12.3.1

1.12.3

1.12.2.2

1.12.2.1

1.12.2

1.12.1.5

1.12.1.4

1.12.1.3

1.12.1.2

1.11.9.1

1.11.9

1.11.8

1.11.7.8

1.11.7.7

1.11.7.6

1.11.7.5

1.11.7.4

1.11.7.3

1.11.7.2

1.11.7.1

1.11.7

1.11.5.1

1.11.4.2

1.11.4.1

1.11.4

1.11.3

1.11.2

1.11.1

1.11

1.10.23.1

1.10.23

1.10.22

1.10.21

1.10.20

1.10.19

1.10.18

1.10.17

1.10.16

1.10.15.1

1.10.15

1.10.14

1.10.13.9

1.10.13.8

1.10.13.7

1.10.13.6

1.10.13.5

1.10.13.4

1.10.13.2

1.10.13.1

1.10.13

1.10.12

1.10.11.1

1.10.11

1.10.10

1.10.9

1.10.8.3

1.10.8.2

1.10.8.1

1.10.8

1.10.7.3

1.10.7.2

1.10.7.1

1.10.7

1.10.6.1

1.10.6

1.10.5.2

1.10.5.1

1.10.5

1.10.4

1.10.3.2

1.10.3.1

1.10.3

1.10.2.2

1.10.2.1

1.10.2

1.10.1.4

1.10.1.3

1.10.1.2

1.10.1.1

1.10.1

1.10

1.9.7.4

1.9.7.3

1.9.7.2

1.9.7.1

1.9.7

1.9.6.8

1.9.6.7

1.9.6.6

1.9.4.2

1.9.3

1.9.2.9

1.9.2.8

1.9.2.7

1.9.2.6

1.9.2.5

1.9.2.2

1.9.2.1

1.9.2

1.9.1.7

1.9.1.6

1.9.1.5

1.9

1.8.7.3

1.8.7.1

1.8.7

1.8.6.6

1.8.6.5

1.8.6.3

1.8.5.3

1.8.5.2

1.8.5.1

1.8.5

1.8.4.3

1.8.4.2

1.8.4.1

1.8.4

1.8.3

1.8.2.1

1.8.2

1.8.1.4

1.8.1.3

1.8.1.2

1.8.1.1

1.8.1

1.8

1.7.12

1.7.11.2

1.7.11.1

1.7.11

1.7.10

1.7.9.2

1.7.9

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.1

1.7.0.2

1.6.7.1

1.6.6

1.6.5

1.6.4.2

1.6.4.1

1.6.4

1.6.3.3

1.6.3.2

1.6.1

1.6

1.5.5.3

1.5.5

1.5.4.3

1.5.3

1.5.2

1.5.1

1.4.2

1.2.2

1.2.1

1.1.3

1.1.2

1.1.1

1.1

1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

shub-workflow-1.13.1.1.tar.gz (46.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

shub_workflow-1.13.1.1-py3-none-any.whl (53.4 kB view details)

Uploaded Python 3

File details

Details for the file shub-workflow-1.13.1.1.tar.gz.

File metadata

  • Download URL: shub-workflow-1.13.1.1.tar.gz
  • Upload date:
  • Size: 46.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.12

File hashes

Hashes for shub-workflow-1.13.1.1.tar.gz
Algorithm Hash digest
SHA256 f64ad152d3ee8c76e2d19f8dd49fbe1b6c8262c04b2b0b10b9a68d52f8d26123
MD5 3041167a3fba12a106c5eb0f6566837c
BLAKE2b-256 192391ddfafce7192462e34cdccb54ae388c75723bd94a3d9642589515c6dcbc

See more details on using hashes here.

File details

Details for the file shub_workflow-1.13.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for shub_workflow-1.13.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 ccbba5e757ce2b556203dfdf279fb00bccfb2fa42af4cea80bda9a8d54520705
MD5 134bb29b65e31af978470eb04250e2b4
BLAKE2b-256 e2f619e62e3edc425cefdd9cdcbc7a6110aaaf956c474e0bbe11d007ccfab96a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page