Unclaimed project
Are you a maintainer of pathway? Claim this project to take control of your public changelog and roadmap.
Changelog
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Last updated 1 day ago
None serializes differently (no value in Kafka, "None" string in NATS)pw.io.kafka.read now exposes message headers in metadata as base64-encoded pairs in `heade...pw.io.kafka.read and pw.io.redpanda.read now allow each schema field to be specified as coming from either the message key or the message value.pw.Table.filter_out_results_of_forgetting method, allowing to revert the effects of forgetting at a later stage.tool method now allows to pass an optional description, default value being kept as the handler's docstring.pw.io.kafka.read and pw.io.redpanda.read now create a key column storing the contents...Table.add_update_timestamp_utc function for tracking update time of rows in the tablecatalog parameter is now required in both pw.io.iceberg.read an...pw.io.mysql.write method for writing to MySQL. It supports two output table types: stream of changes and a realtime-updated data snapshot.pw.io.deltalake.read now accepts the start_from_timestamp_ms parameter for non-append-only tables. In this case, the connector will replay the history of chang...pathway.xpacks.llm.parsers.PaddleOCRParser supporting parsing of PDF, PPTX and images.pw.io.gdrive.read now supports the "only_metadata" format. When this format is used, the table will contain only metadata updates for the tracked directory, without reading object contents.PATHWAY_DETAILED_METRICS_DIR or via pw.set_monitoring_config().pw.io.kinesis.read...pw.Table.forget to remove old (in terms of event time) entries from the pipeline.pw.Table.buffer, a stateful buffering operator that delays entries until time_column <= max(time_column) - threshold condition is met.pw.Table.ignore_late to filter out old (in terms of event time) entries.max_batch_size parameter....path_filter parameter in pw.io.s3.read and pw.io.minio.read functions. It enables post-filtering of object paths using a wildcard pattern (*, ?), allowing exclusion of paths that pass the main path filter but do not match path_filter.max_backlog_size, allowing to limit the number of read events in processing per...pw.xpacks.llm.mcp_server.PathwayMcp that allows serving pw.xpacks.llm.document_store.DocumentStore and pw.xpacks.llm.question_answering endpoints as MCP (Model Context Protocol) tools.pw.io.dynamodb.write method for writing to Dynamo DB.AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
Stable Diffusion web UI
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.