New
sparkMeasure v0.25
Release 0.25, highlights
π Improvements
- Improved Documentation: Clearer setup and usage instructions.
- Memory Report Enhanced: More robust error handling in StageMetrics.
- Updated Flight Recorder Mode: Simplified configuration and examples.
- Wider Compatibility: Supports Java 11 & 17, Scala 2.12 & 2.13, Spark 3.x & 4.x, Python 3.9 to 3.12.
π Bug Fixes
- Fixed Kafka Sink Errors.
- Corrected Memory Reporting in StageMetrics.
- Improved JSON Print for Flight Recorder.
- Enhanced Python API Error Handling.
π₯ Installation
-
Scala:
spark-shell --packages ch.cern.sparkmeasure:spark-measure_2.12:0.25 -
Python:
pip install sparkmeasure pyspark --packages ch.cern.sparkmeasure:spark-measure_2.12:0.25