Python API for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads.
Project description
SparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark performance metrics. The bulk of sparkMeasure is written in Scala. This package contains the Python API for sparkMeasure. Use it from Python programs, PySpark, Jupyter notebooks, or in general as a tool to instrument and collect runtime metrics for your Spark jobs.
Key Features:
- Interactive troubleshooting for Spark workloads.
- Batch job analysis with Flight Recorder mode.
- Monitoring with external systems (InfluxDB, Kafka, Prometheus).
- Language support for Scala, Java, and Python.
- Educational tool demonstrating Spark Listener interface.
For more information, see the sparkMeasure GitHub page and documentation.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sparkmeasure-0.27.0.tar.gz.
File metadata
- Download URL: sparkmeasure-0.27.0.tar.gz
- Upload date:
- Size: 6.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
785ed898724ae8db9e5af2a2af4ed1d16c78b00e3cdc75c96e8b29f323e7572c
|
|
| MD5 |
34796b6fa5729efca5c9ebee00e2a2bd
|
|
| BLAKE2b-256 |
2978fdbdf25a859067a829ea26711dff3c80ed8cb72a36f474dca8b38fb94d1d
|
File details
Details for the file sparkmeasure-0.27.0-py2.py3-none-any.whl.
File metadata
- Download URL: sparkmeasure-0.27.0-py2.py3-none-any.whl
- Upload date:
- Size: 8.5 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8c519f39f902d818fe131cbe2d164093785a5174700d47af53fd9658b09287b8
|
|
| MD5 |
b3c7fb5a30f0f9e95f4197503d02e89a
|
|
| BLAKE2b-256 |
f910392fca96f15f41e8d4bb25c1f627cec1ba13c7ca84fe1721695932360eeb
|