Skip to main content

Python API for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads.

Project description

SparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark performance metrics. The bulk of sparkMeasure is written in Scala. This package contains the Python API for sparkMeasure. Use it from Python programs, PySpark, Jupyter notebooks, or in general as a tool to instrument and collect runtime metrics for your Spark jobs.

Key Features:

  • Interactive troubleshooting for Spark workloads.
  • Batch job analysis with Flight Recorder mode.
  • Monitoring with external systems (InfluxDB, Kafka, Prometheus).
  • Language support for Scala, Java, and Python.
  • Educational tool demonstrating Spark Listener interface.

For more information, see the sparkMeasure GitHub page and documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sparkmeasure-0.27.0.tar.gz (6.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sparkmeasure-0.27.0-py2.py3-none-any.whl (8.5 kB view details)

Uploaded Python 2Python 3

File details

Details for the file sparkmeasure-0.27.0.tar.gz.

File metadata

  • Download URL: sparkmeasure-0.27.0.tar.gz
  • Upload date:
  • Size: 6.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.11

File hashes

Hashes for sparkmeasure-0.27.0.tar.gz
Algorithm Hash digest
SHA256 785ed898724ae8db9e5af2a2af4ed1d16c78b00e3cdc75c96e8b29f323e7572c
MD5 34796b6fa5729efca5c9ebee00e2a2bd
BLAKE2b-256 2978fdbdf25a859067a829ea26711dff3c80ed8cb72a36f474dca8b38fb94d1d

See more details on using hashes here.

File details

Details for the file sparkmeasure-0.27.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for sparkmeasure-0.27.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8c519f39f902d818fe131cbe2d164093785a5174700d47af53fd9658b09287b8
MD5 b3c7fb5a30f0f9e95f4197503d02e89a
BLAKE2b-256 f910392fca96f15f41e8d4bb25c1f627cec1ba13c7ca84fe1721695932360eeb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page