New
v0.26.1
Added
pw.Table.forgetto remove old (in terms of event time) entries from the pipeline.pw.Table.buffer, a stateful buffering operator that delays entries untiltime_column <= max(time_column) - thresholdcondition is met.pw.Table.ignore_lateto filter out old (in terms of event time) entries.- Rows batching for async UDFs. It can be enabled with
max_batch_sizeparameter.
Changed
pw.io.subscribeandpw.io.python.writenow work with async callbacks.- The
diffcolumn in tables automatically created bypw.io.postgres.writeandpw.io.postgres.write_snapshotinreplaceandcreate_if_not_existsinitialization modes now uses thesmallinttype. optimize_transaction_logoption has been removed frompw.io.deltalake.TableOptimizer.
Fixed
pw.io.postgres.writeandpw.io.postgres.write_snapshotnow respect the type optionality defined in the Pathway table schema when creating a new PostgreSQL table. This applies to thereplaceandcreate_if_not_existsinitialization modes.