New
v2.19.0
The release introduces several changes to viaParquet:
- ability to define a default partition value so that you can partition your data even when the partition column is nullable
- introduced a custom builder for viaParquet in Akka / Pekko so that you can stream any document format (supported by https://github.com/apache/parquet-java, e.g. Avro) and partition it.
Moreover, to keep compatibility with Apache Spark, from now on, Parquet4s url-encodes partition values during writing and url-decodes during reading.
Notable dependency changes:
- Parquet (Java) upgraded to 1.14.1
- Pekko upgraded to 1.0.3
- Slf4j upgraded to 2.0.16
- Protobuf compiler upgraded to 0.11.17