New
v2.21.0
This release introduces several substantial changes:
- Decimal Formats and Scaling Enhancements:
Users of Parquet4s can now choose from multiple formats for decimal values. In addition to the default binary format, you can use
intandlongcolumns. Furthermore, you can customize the scale and precision of decimals. When reading decimals, you have the option to rescale the original source format or retain it as stored in the Parquet file. Please refer to the documentation for further details. - Simplified Filtering Type Classes:
The filtering type classes have undergone significant simplification. The
FilterDecoderand, consequently, theFilterCodecare no longer required to define custom filters. From now on, only theFilterEncoderis needed. Over the course of Parquet4s's evolution, the UDP class remained the last feature requiring filter decoding. To simplify the filtering mechanism and eliminate this last dependency, UDP must now rely on Java column types instead of Scala ones. This is a breaking change, but it is a necessary tradeoff to enhance the overall simplicity of the library. Please refer to the documentation for more details.