1.1.0 (Spark 3.2)
What's Changed
- Default master value to first check the system variables. by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/127
- More documentation by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/128, https://github.com/Kotlin/kotlin-spark-api/pull/130
- Rdd related helpers by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/132
- 3.2 Encoders, supporting scala case classes by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/134, https://github.com/Kotlin/kotlin-spark-api/pull/147
- Reorganizing API and adding conversions by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/136
- Sorting functions for key/value Datasets by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/138
- Tuple first by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/144
- Streaming support by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/133, https://github.com/Kotlin/kotlin-spark-api/pull/157
- Kotlin Jupyter notebook support by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/137, https://github.com/Kotlin/kotlin-spark-api/pull/155, https://github.com/Kotlin/kotlin-spark-api/pull/158
- Created and updated wiki
Full Changelog: https://github.com/Kotlin/kotlin-spark-api/compare/kotlin-spark-3.2-1.0.3...3.2-1.1.0
Get it
Maven Central: https://search.maven.org/artifact/org.jetbrains.kotlinx.spark/kotlin-spark-api-3.2/1.1.0/jar
Read more
Blog post: https://blog.jetbrains.com/big-data-tools/2022/05/26/kotlin-api-for-apache-spark-streaming-jupyter-and-more/