New
v0.15.0
Scio 0.15 adds support for Iceberg, beam's managed transforms, and Avro 1.11's java-class annotations.
๐ Enhancements
- Magnolify API by @kellen in https://github.com/spotify/scio/pull/5286
- (fix #5067) Drop Java 8 Targeting by @clairemcginty in https://github.com/spotify/scio/pull/5203
- Managed + Iceberg IO by @kellen in https://github.com/spotify/scio/pull/5494
- Support writing extra metadata in scio-parquet by @clairemcginty in https://github.com/spotify/scio/pull/5411
- Update IcebergIO read/write parameters by @kellen in https://github.com/spotify/scio/pull/5823
- Add integration test for Magnolify TableRowType compatibility by @clairemcginty in https://github.com/spotify/scio/pull/5818
- Support Avro 1.11 java-class annotations in scio-parquet by @clairemcginty in https://github.com/spotify/scio/pull/5821
- Add ParquetMetadataDoFn by @kellen in https://github.com/spotify/scio/pull/5820
- v0.15.0 by @kellen in https://github.com/spotify/scio/pull/5609
- Remove stale comments, make some previously-deprecated methods private by @kellen in https://github.com/spotify/scio/pull/5584
๐๏ธ Build Improvements
- Vendor Socco by @kellen in https://github.com/spotify/scio/pull/5811
- Exclude dependabot from updating ci.yml by @kellen in https://github.com/spotify/scio/pull/5813
- Move CI env definition by @kellen in https://github.com/spotify/scio/pull/5826
- Remove developers list by @kellen in https://github.com/spotify/scio/pull/5548
- Fix BT integration tests by @kellen in https://github.com/spotify/scio/pull/5606
- Fix BT integration tests mark ii by @kellen in https://github.com/spotify/scio/pull/5608
- Add headers, remove unused by @kellen in https://github.com/spotify/scio/pull/5619
๐ Bug Fixes
- Fix Iceberg integration test, defaults by @kellen in https://github.com/spotify/scio/pull/5825
- Fix seed setting in samplers by @kellen in https://github.com/spotify/scio/pull/5816
- Add check for java 17 SCollectionMatcher (fix #5483) by @kellen in https://github.com/spotify/scio/pull/5605
๐ฑ Dependency Updates
- Upgrade to Avro 1.11.5 by @clairemcginty in https://github.com/spotify/scio/pull/5799
- Update sbt to 1.11.7, sbt-mdoc to 2.8.0, sbt-java-formatter to 0.10.0โฆ by @kellen in https://github.com/spotify/scio/pull/5815
- Bump to magnolify 0.9.2 by @kellen in https://github.com/spotify/scio/pull/5824
- Update scala-compiler, scala-library, ... to 2.13.17 by @clairemcginty in https://github.com/spotify/scio/pull/5786
- Bump coursier/cache-action from 6 to 7 by @dependabot[bot] in https://github.com/spotify/scio/pull/5797
- Update sbt-typelevel to 0.8.2 by @clairemcginty in https://github.com/spotify/scio/pull/5808
- Update sbt-jmh to 0.4.8 by @clairemcginty in https://github.com/spotify/scio/pull/5809
- Update mysql-connector-j to 9.5.0 by @clairemcginty in https://github.com/spotify/scio/pull/5804
- Update cloud-sql-connector-jdbc-sqlserver, ... to 1.27.0 by @clairemcginty in https://github.com/spotify/scio/pull/5802
- Update jedis to 7.0.0 by @clairemcginty in https://github.com/spotify/scio/pull/5810
- Update sbt-scoverage to 2.4.1 by @clairemcginty in https://github.com/spotify/scio/pull/5807
- Update sbt-bom to 1.0.30 by @clairemcginty in https://github.com/spotify/scio/pull/5803
- Update testcontainers-scala-elasticsearch, ... to 0.43.6 by @clairemcginty in https://github.com/spotify/scio/pull/5801
- Update elasticsearch-java to 8.19.7 by @clairemcginty in https://github.com/spotify/scio/pull/5800
- Update magnolify to 0.8.0, tensorflow to 1.0.0, caffeine to 3.2.0 by @kellen in https://github.com/spotify/scio/pull/5604
- magnolify 0.9 by @kellen in https://github.com/spotify/scio/pull/5812
Full Changelog: https://github.com/spotify/scio/compare/v0.14.20...v0.15.0