New
0.13.0
DataFusion Comet 0.13.0 Changelog
This release consists of 169 commits from 15 contributors. See credits at the end of this changelog for more information.
Fixed bugs:
Unclaimed project
Are you a maintainer of datafusion-comet? Claim this project to take control of your public changelog and roadmap.
Changelog
Apache DataFusion Comet Spark Accelerator
Last updated about 8 hours ago
This release consists of 169 commits from 15 contributors. See credits at the end of this changelog for more information.
Fixed bugs:
Performance related:
process_sorted_row_partition #3059 (andygrove)Implemented enhancements:
explode and explode_outer for array inputs #2836 (andygrove)native_datafusion scan #2879 (andygrove)from_json #2934 (andygrove)murmur3 hash support to complex types #3077 (andygrove)unix_timestamp function #2936 (andygrove)Documentation updates:
Other:
if, case_when and coalesce) #2807 (rluvaton)Iceberg install docs #2824 (comphead)CometExecRule #2840 (andygrove)CometExecRule to reduce duplicate code #2844 (andygrove)CometExecRule to CometShuffleExchangeExec serde implementation #2853 (andygrove)CometExecRule handling of BroadcastHashJoin and fix fallback reporting #2856 (andygrove)CometExecRule to remove confusing code and fix more fallback reporting #2860 (andygrove)CometExecRule #2863 (andygrove)CometScanRule #2867 (andygrove)CometSparkSessionExtensions to CometScanRule and CometExecRule #2873 (andygrove)native_datafusion scans #2877 (andygrove)ScanExec::new no longer fetches data #2881 (andygrove)row_step from process_sorted_row_partition #2920 (andygrove)ScanExec #2939 (andygrove)main #2962 (andygrove)CometScanRule to improve scan selection and fallback logic #2978 (andygrove)SpillSorter to top level class and add tests #3081 (andygrove)native_comet #3236 (andygrove)install instead of compile in TPC CI jobs #3263 (andygrove)Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
91 Andy Grove
23 dependabot[bot]
18 Matt Butrovich
9 B Vadlamani
7 Oleks V
5 Kazantsev Maksim
5 Manu Zhang
3 Shekhar Prasad Rajak
2 hsiang-c
1 Bjørn Jørgensen
1 Emily Matheys
1 Parth Chandra
1 Raz Luvaton
1 Wonseok Yang
1 Zhen Wang
Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.
♞ lichess.org: the forever free, adless and open source chess server ♞
💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB) [deprecated]
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.