Skip to main content

Provider package apache-airflow-providers-apache-spark for Apache Airflow

Project description

Package apache-airflow-providers-apache-spark

Release: 4.7.1.rc1

Apache Spark

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

The package supports the following python versions: 3.8,3.9,3.10,3.11

Requirements

PIP package

Version required

apache-airflow

>=2.6.0

pyspark

grpcio-status

>=1.59.0

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-apache-spark[cncf.kubernetes]

Dependent package

Extra

apache-airflow-providers-cncf-kubernetes

cncf.kubernetes

The changelog for the provider package can be found in the changelog.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file apache_airflow_providers_apache_spark-4.7.1rc1.tar.gz.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-4.7.1rc1.tar.gz
Algorithm Hash digest
SHA256 0a9782701d89ea29b6c5e6bf5c3a5d2f1bcb6d6a69c39c890fd891c6cc7687b7
MD5 cd08ea831860b84385c9f4e04fe3306e
BLAKE2b-256 e2bbc275286fce28a240bc954fc8a18d9f81f2841460e5b1cfcacf675baaeffe

See more details on using hashes here.

File details

Details for the file apache_airflow_providers_apache_spark-4.7.1rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_apache_spark-4.7.1rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 087faa1e3ab6e83dd4235531627a3425bac1b6bad3aae0785c05d01084575c1e
MD5 8391b6aa8a724f35458373adefae2736
BLAKE2b-256 d9fcb14311c2fac2e698c8da193f2cde4776291af9c7bfbcbc6559931e740d02

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page