Airflow 3.1.0

We are thrilled to announce the release of Apache Airflow 3.1.0, an update that puts humans at the center of data workflows.

Read more about what 3.1.0 brings in https://airflow.apache.org/blog/airflow-3.1.0/

📦 PyPI: https://pypi.org/project/apache-airflow/3.1.0/
📚 Core Airflow Docs: https://airflow.apache.org/docs/apache-airflow/3.1.0/
📚 Task SDK Docs: https://airflow.apache.org/docs/task-sdk/1.1.0/
🛠️ Release Notes: https://airflow.apache.org/docs/apache-airflow/3.1.0/release_notes.html
🚏 Constraints: https://github.com/apache/airflow/tree/constraints-3.1.0

Apache Airflow 3.1.0 represents an extraordinary community effort, showcasing the vibrant ecosystem that drives this project forward with 163 contributors making this release possible across 1,400+ commits.

Screenshots

i18n-demo snake calendar favorite gantt hitl

New Features

Add Calendar and Gantt chart views to modern React UI with enhanced filtering (#54252, #51667)
Add Python 3.13 support for Airflow runtime and dependencies (#46891)
Add SQLAlchemy 2.0 support with various compatibility fixes for Python 3.13 (#52233, #52518, #54940)
Add support for the psycopg3 postgres driver (#52976)
Add ability to track & display user who triggers DAG runs (#51738, #53510, #54164, #55112)
Add toggle for log grouping in task log viewer for better organization (#51146)
Add tag filtering improvements with Any/All selection options (#51162)
Add comprehensive filtering for DAG runs, task instances, and audit logs (#53652, #54210, #55082)
Add XCom browsing with filtering and improved navigation (#54049)
Add bulk task instance actions and deletion endpoints (#50443, #50165, #50235)
Add DAG run deletion functionality through UI (#50368)
Add test connection button for connection validation (#51055)
Add hyperlink support for URLs in XCom values (#54288)
Add pool column to task instances list and improve pool integration (#51185, #51031)
Add drag-and-drop log grouping and improved log visualization (#51146)
Add color support for XCom JSON display (#51323)
Add configuration column to DAG runs page (#51270)
Add enhanced note visibility and management in task headers (#51764, #54163)
Introduce React plugin system (AIP-68) for modern UI extensions (#52255)
Add support for external view plugins via iframe integration (#51003, #51889)
Add dashboard integration capabilities for custom React apps (#54131, #54144)
Add comprehensive plugin development tools and documentation (#53643)
Implement complete HITL operator suite (HITLOperator, ApprovalOperator, HITLEntryOperator) for human decision workflows (#52868)
Add HITL UI integration with role-based access and form handling (#53035)
Add HITL API endpoints with filtering and query support (#53376, #53923)
Add HITL utility functions for generating URLs to required actions page (#54827)
Improve HITL user experience with bug fixes, UI enhancements, and data model consistency (#55463, #55539, #55575, #55546, #55543, #55536, #55535)
Add ordering and filtering support for HITL details endpoints (#55217)
Add "No Response Received" required action state (#55149)
Add operator filter for HITL task instances (#54773)
Implement deadline alert system for proactive DAG monitoring (AIP-86) (#53951, #53903, #53201, #55086)

Bug Fixes

Fix DAG list filtering to include QUEUED runs with null start_date (#52668)
Fix XCom deletion failure for mapped task instances through bulk deletion API (#51850)
Fix XCom deletion failure for mapped task instances (#54954)
Fix task timeout handling within task SDK (#54089)
Fix task instance tries API duplicate entries (#50597)
Fix connection validation and type checking during construction (#54759)
Fix mapped task instance index display in Task Instances tab (#55363)
Fix Gantt chart state mismatch with Grid view (#55300)
Fix Gantt chart status color display issues (#55296)
Fix XCom mapping for dynamically-mapped task groups (#51556)
Fix missing ti_successes and related metrics in Airflow 3.0 Task SDK (#55322)
Fix bulk operation permissions for connection, pool and variable (#55278)
Fix clearTaskInstances API: Restore include_past/future support on UI (#54416)
Fix migration when XCom has NaN values (#53812)
Fix HITL related UI schema generated by prek hooks (#55204)
Fix consistent no-log handling for tasks with try_number=0 in API and UI (#55035)
Fix timezone conversion in datetime trigger parameters (#54593)
Fix audit log payload for DAG pause/unpause actions (#55091)
Fix pushing None as an XCom value (#55080)
Fix scheduler processing of cleared running tasks stuck in RESTARTING state (#55084)
Fix XCom deletion failure for mapped task instances (#54954)
Fix outgoing graph edges should exit opposite of incoming edges (#54789)
Fix external links in Navigation buttons (#52220)
Fix Error when viewing DAG details of a no longer configured bundle (#52086)
Fix compatibility with new numpy and pandas versions (#52071)
Fix connection recovery from URI when host has protocol (#51953)
Fix last DAG run not showing on DAG listing (#51115)
Fix task instance tries API returning duplicate entries (#50597)
Fix Graph view vanishing and loading issues (#53886, #54756)
Fix rendered template display formatting for better readability (#53657)
Fix Grid view expand/collapse button functionality (#54257)
Fix tooltip visibility and positioning issues (#53913)
Fix grid keyboard navigation focus management (#54271)
Fix plugin registration for invalid objects and middleware registration (#55264, #55399)
Fix external links for plugins with undefined URL routes (#55221)

Miscellaneous

Move secrets masker to shared distribution for better modularity (#54449)
Move email notifications from scheduler to DAG processor for better architecture (#55238)
Add graph UI load optimization with latest run info endpoint (#53429)
Optimize UI bundle size by moving translations to dynamic loading (#51735)
Relocate Task SDK components for improved separation (#55174, #54795)
Refactor trigger rule utilities and weight rule consolidation (#54797, #53393)
Remove deprecated Airflow 2.x modules and legacy imports (#50482)
Clean up unused code and improve module organization (#52176, #52173, #53031)
Add SQLAlchemy 2.0 CI support for future compatibility (#52233)
Improve test fixtures and SDK communication testing (#54795, #50603)
Add translation completeness linting and validation tools (#51166)
Upgrade to latest versions of important dependencies (#55350)
Move webserver configuration options to API section (#50693, #50656)
Improve DAG bundle handling and versioning support (#47592)
Add database management CLI tools for external database operations (#50657)
Add comprehensive HITL operator documentation and examples (#54618)
Add guards for registering middlewares from plugins (#55399)
Optimize Gantt group expansion with de-bouncing and deferred rendering (#55334)
Differentiate between triggers and watchers currently running for better visibility (#55376)
Removed unused config: dag_stale_not_seen_duration (#55601, #55684)
Update UI's query client strategy for improved performance (#55528)
Unify datetime format across the UI for consistency (#55572)
Mark React Apps as Experimental for Airflow 3.1 release (#55478)
Improve OOM error messaging for clearer task failure diagnosis (#55602)
Display responder username for better audit trail in HITL workflows (#55509)
The constraint file do not contain developer dependencies anymore (#53631)
Add hyperlinks to dag_id column in DAG Runs and Task Instances pages for better navigation (#55648)
Add responsive web design (RWD) support to Grid view (#55745)

Doc Only Changes

Add comprehensive Human-in-the-Loop operator tutorial and examples (#54618)
Add deadline alerts configuration and usage documentation (#53727)
Make term Dag consistent in docs task-sdk (#55100)
Add migration guide for upgrading from legacy SLA functionality to deadline alerts (#55743)
Add DAG bundles triggerer limitation documentation (#55232)
Add deadline alerts usage guides and best practices (#53727)
Remove --preview flag from ruff check instructions for Airflow 3 upgrade path (#55516)
Add documentation for context parameter (#55377)

New Features

Add Calendar and Gantt chart views to modern React UI with enhanced filtering (#54252, #51667)

Add Python 3.13 support for Airflow runtime and dependencies (#46891)

Add SQLAlchemy 2.0 support with various compatibility fixes for Python 3.13 (#52233, #52518, #54940)

Add support for the psycopg3 postgres driver (#52976)

Add ability to track & display user who triggers DAG runs (#51738, #53510, #54164, #55112)

Add toggle for log grouping in task log viewer for better organization (#51146)

Add tag filtering improvements with Any/All selection options (#51162)

Add comprehensive filtering for DAG runs, task instances, and audit logs (#53652, #54210, #55082)

Add XCom browsing with filtering and improved navigation (#54049)

Add bulk task instance actions and deletion endpoints (#50443, #50165, #50235)

Add DAG run deletion functionality through UI (#50368)

Add test connection button for connection validation (#51055)

Add hyperlink support for URLs in XCom values (#54288)

Add pool column to task instances list and improve pool integration (#51185, #51031)

Add drag-and-drop log grouping and improved log visualization (#51146)

Add color support for XCom JSON display (#51323)

Add configuration column to DAG runs page (#51270)

Add enhanced note visibility and management in task headers (#51764, #54163)

Introduce React plugin system (AIP-68) for modern UI extensions (#52255)

Add support for external view plugins via iframe integration (#51003, #51889)

Add dashboard integration capabilities for custom React apps (#54131, #54144)

Add comprehensive plugin development tools and documentation (#53643)

Implement complete HITL operator suite (HITLOperator, ApprovalOperator, HITLEntryOperator) for human decision workflows (#52868)

Add HITL UI integration with role-based access and form handling (#53035)

Add HITL API endpoints with filtering and query support (#53376, #53923)

Add HITL utility functions for generating URLs to required actions page (#54827)

Improve HITL user experience with bug fixes, UI enhancements, and data model consistency (#55463, #55539, #55575, #55546, #55543, #55536, #55535)

Add ordering and filtering support for HITL details endpoints (#55217)

Add "No Response Received" required action state (#55149)

Add operator filter for HITL task instances (#54773)

Implement deadline alert system for proactive DAG monitoring (AIP-86) (#53951, #53903, #53201, #55086)

Bug Fixes

Fix DAG list filtering to include QUEUED runs with null start_date (#52668)

Fix XCom deletion failure for mapped task instances through bulk deletion API (#51850)

Fix XCom deletion failure for mapped task instances (#54954)

Fix task timeout handling within task SDK (#54089)

Fix task instance tries API duplicate entries (#50597)

Fix connection validation and type checking during construction (#54759)

Fix mapped task instance index display in Task Instances tab (#55363)

Fix Gantt chart state mismatch with Grid view (#55300)

Fix Gantt chart status color display issues (#55296)

Fix XCom mapping for dynamically-mapped task groups (#51556)

Fix missing ti_successes and related metrics in Airflow 3.0 Task SDK (#55322)

Fix bulk operation permissions for connection, pool and variable (#55278)

Fix clearTaskInstances API: Restore include_past/future support on UI (#54416)

Fix migration when XCom has NaN values (#53812)

Fix HITL related UI schema generated by prek hooks (#55204)

Fix consistent no-log handling for tasks with try_number=0 in API and UI (#55035)

Fix timezone conversion in datetime trigger parameters (#54593)

Fix audit log payload for DAG pause/unpause actions (#55091)

Fix pushing None as an XCom value (#55080)

Fix scheduler processing of cleared running tasks stuck in RESTARTING state (#55084)

Fix XCom deletion failure for mapped task instances (#54954)

Fix outgoing graph edges should exit opposite of incoming edges (#54789)

Fix external links in Navigation buttons (#52220)

Fix Error when viewing DAG details of a no longer configured bundle (#52086)

Fix compatibility with new numpy and pandas versions (#52071)

Fix connection recovery from URI when host has protocol (#51953)

Fix last DAG run not showing on DAG listing (#51115)

Fix task instance tries API returning duplicate entries (#50597)

Fix Graph view vanishing and loading issues (#53886, #54756)

Fix rendered template display formatting for better readability (#53657)

Fix Grid view expand/collapse button functionality (#54257)

Fix tooltip visibility and positioning issues (#53913)

Fix grid keyboard navigation focus management (#54271)

Fix plugin registration for invalid objects and middleware registration (#55264, #55399)

Fix external links for plugins with undefined URL routes (#55221)

Miscellaneous

Move secrets masker to shared distribution for better modularity (#54449)

Move email notifications from scheduler to DAG processor for better architecture (#55238)

Add graph UI load optimization with latest run info endpoint (#53429)

Optimize UI bundle size by moving translations to dynamic loading (#51735)

Relocate Task SDK components for improved separation (#55174, #54795)

Refactor trigger rule utilities and weight rule consolidation (#54797, #53393)

Remove deprecated Airflow 2.x modules and legacy imports (#50482)

Clean up unused code and improve module organization (#52176, #52173, #53031)

Add SQLAlchemy 2.0 CI support for future compatibility (#52233)

Improve test fixtures and SDK communication testing (#54795, #50603)

Add translation completeness linting and validation tools (#51166)

Upgrade to latest versions of important dependencies (#55350)

Move webserver configuration options to API section (#50693, #50656)

Improve DAG bundle handling and versioning support (#47592)

Add database management CLI tools for external database operations (#50657)

Add comprehensive HITL operator documentation and examples (#54618)

Add guards for registering middlewares from plugins (#55399)

Optimize Gantt group expansion with de-bouncing and deferred rendering (#55334)

Differentiate between triggers and watchers currently running for better visibility (#55376)

Removed unused config: dag_stale_not_seen_duration (#55601, #55684)

Update UI's query client strategy for improved performance (#55528)

Unify datetime format across the UI for consistency (#55572)

Mark React Apps as Experimental for Airflow 3.1 release (#55478)

Improve OOM error messaging for clearer task failure diagnosis (#55602)

Display responder username for better audit trail in HITL workflows (#55509)

The constraint file do not contain developer dependencies anymore (#53631)

Add hyperlinks to dag_id column in DAG Runs and Task Instances pages for better navigation (#55648)

Add responsive web design (RWD) support to Grid view (#55745)

Doc Only Changes

Add comprehensive Human-in-the-Loop operator tutorial and examples (#54618)

Add deadline alerts configuration and usage documentation (#53727)

Make term Dag consistent in docs task-sdk (#55100)

Add migration guide for upgrading from legacy SLA functionality to deadline alerts (#55743)

Add DAG bundles triggerer limitation documentation (#55232)

Add deadline alerts usage guides and best practices (#53727)

Remove --preview flag from ruff check instructions for Airflow 3 upgrade path (#55516)

Add documentation for context parameter (#55377)

airflow

Screenshots

New Features

Bug Fixes

Miscellaneous

Doc Only Changes

More Python Projects

AutoGPT

yt-dlp

markitdown

Airflow 3.1.0

Screenshots

New Features

Bug Fixes

Miscellaneous

Doc Only Changes

More Python Projects

AutoGPT

yt-dlp

markitdown

HelloGitHub