What's Changed

• Reorganized project: Gradle by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/168.

• Reorganized project: Now supporting builds for each patch-version of Spark from 3.0.0 to 3.3.0 and Scala 2.12 / 2.13 by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/168. NOTE: The new naming scheme.

• Added: UDT Support for MLlib etc. by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/162. Example.

• Added: Better UD(A)F support by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/152. Example

• Added: seqOf() function by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/172.

• Added: dfOf() function by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/162.

• Added: JavaRDD extension functions by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/174. Example / Use case.

• Added: Spark properties now in use-magic in Jupyter in https://github.com/Kotlin/kotlin-spark-api/issues/176.

• Fixed: Reading files from Datalore by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/165.

• Fixed: Encoding "isSomething" names in data classes by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/171.

• Fixed: Conversion methods for Scala 2.12 / 2.13 by @Jolanrensen in https://github.com/Kotlin/kotlin-spark-api/pull/175.

• Updated wiki.

Full Changelog: https://github.com/Kotlin/kotlin-spark-api/milestone/10?closed=1.

Get it

Maven Central: https://search.maven.org/artifact/org.jetbrains.kotlinx.spark/kotlin-spark-api_3.3.0_2.13/1.2.1/jar.

For other Spark- and Scala versions, follow the naming scheme.

Read more

Blog post: Coming soon!