v0.11.1

Highlights

This release includes 1456 commits from 449 contributors (184 new contributors)!

Key changes include:

PyTorch 2.9.0 + CUDA 12.9.1: Updated the default CUDA build to torch==2.9.0+cu129, enabling Inductor partitioning and landing multiple fixes in graph-partition rules and compile-cache integration.
Batch-invariant torch.compile: Generalized batch-invariant support across attention and MoE backends, with explicit support for DeepGEMM and FlashInfer on Hopper and Blackwell GPUs.
Robust async scheduling: Fixed several correctness and stability issues in async scheduling, especially when combined with chunked prefill, structured outputs, priority scheduling, MTP, and DeepEP / DCP. We expect --async-scheduling to be enabled by default in the next release.
Stronger scheduler + KV ecosystem: Improved test coverage in CI and made scheduler behavior more robust with KV connectors, prefix caching, and multi-node deployments.
Anthropic API Support: Added support for the /v1/messages endpoint, allowing users to interact with vllm serve using Anthropic-compatible clients.

Detailed release notes will be updated in the next few days.

What's Changed

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (@frankwang28 #25355)
[Docs] Add Toronto Meetup (@mgoin #25773)
[CI] Add E2E Blackwell Quantized MoE Test (@mgoin #25723)
[V1] address post issues related to #20059 (part 1); cascade attention reenable by default (@fhl2000 #23046)
[CI] Fix FlashInfer AOT in release docker image (@mgoin #25730)
[spec decode] Consolidate speculative decode method name for MTP (@zixi-qi #25232)
Reduce the Cuda Graph memory footprint when running with DBO (@SageMoore #25779)
Kernel-override Determinism [1/n] (@bwasti #25603)
[Bugfix] Optimize CpuGpuBuffer initialization (@namanlalitnyu #25447)
[Spec decode] automatically disable mm for text-only draft models (@jmkuebler #25667)
[Core] Don't count preempted tokens in prefix cache hit rate (@zhuohan123 #25787)
Add option to restrict media domains (@russellb #25783)
Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (@mgoin #25782)
[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (@david6666666 #22872)
[Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (@yewentao256 #25788)
[CI/Build] Consolidate model loader tests and requirements (@DarkLight1337 #25765)
[CI/Build] Add timing to Model Executor Test (@22quinn #25799)
[CI/Build] Reorganize root-level V1 tests (@DarkLight1337 #25767)
[Misc] Fix codeowners override for v1 sample and attention (@22quinn #25037)
[Misc] Update openai client example file for multimodal (@ywang96 #25795)
[Bugfix] Add missing image_size for phi4_multimodal (@Renovamen #25796)
[Bugfix] Merge MM embeddings by index instead of token IDs (@DarkLight1337 #16229)
Validate API tokens in constant time (@russellb #25781)
Add filtering for chat template kwargs (@russellb #25794)
Fix GPTQ model loading in Transformers backend (@hmellor #25770)
[Bugfix] Fix triton import precommit failure (@tlrmchlsmth #25803)
[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (@tlrmchlsmth #24982)
[docs] Resolve transcriptions API TODO (@yyzxw #25446)
[env] default nixl side port conflicts with kv-event zmq port (@panpan0000 #25056)
[Core] Refactor self.model() to call a helper for subclassing. (@patrick-toulme #25084)
[torch.compile]: Add VLLM_DEBUG_DUMP_PATH environment variable (@ZJY0516 #25651)
[Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (@smarterclayton #25766)
[Core] GC Debug callback (@Jialin #24829)

New Contributors

@bwasti first commit is #25603
@Renovamen first commit is #25796
@patrick-toulme first commit is #25084
@kingsmad first commit is #25825
@yingjun-mou first commit is #25827
@zhoukezi first commit is #25854
@leejnau first commit is #25706
@adabeyta first commit is #25513
@acisseJZhong first commit is #25912
@a120092009 first commit is #25942
@Anionex first commit is #25354
@DrStone1971 first commit is #25843
@certainly-param first commit is #25935
@natoscott first commit is #26007
@kmaehashi first commit is #26005
@leo-pony first commit is #25470
@huijjj first commit is #24947
@levunet first commit is #24768
@Egor-Krivov first commit is #25668
@sixiang-google first commit is #25992
@astralord first commit is #26027
@jasl first commit is #26098
@nrghosh first commit is #26148
@southfreebird first commit is #25974
@soldni first commit is #26054
@yuafng first commit is #26219
@ILikeIneine first commit is #25823
@jasonlizhengjian first commit is #25998
@elieserr first commit is #26177
@orangeng first commit is #26266
@ymoslem first commit is #26258
@abhisheksheth28 first commit is #25521
@seven-mile first commit is #26231
@cfRod first commit is #26289
@atalhens first commit is #26265
@gholmes829 first commit is #25164
@dcampora first commit is #25945
@antrec first commit is #26340
@plliao first commit is #26325
@morrison-turnansky first commit is #26113
@isharif168 first commit is #26347
@Barry-Delaney first commit is #25931
@utkarshsharma1 first commit is #26279
@Aydin-ab first commit is #25283
@therealnaveenkamal first commit is #25103
@QierLi first commit is #24926
@zhiyuan1i first commit is #24486
@iwzbi first commit is #16601
@roikoren755 first commit is #25947
@luis5tb first commit is #25593
@wangxiongts first commit is #25550
@sangho-vision first commit is #26563
@muzian666 first commit is #26562
@HsChen-sys first commit is #22100
@FENP first commit is #26574
@gjgjos first commit is #26339

Full Changelog: https://github.com/vllm-project/vllm/compare/v0.11.0...v0.11.1

Highlights

This release includes 1456 commits from 449 contributors (184 new contributors)!

Key changes include:

PyTorch 2.9.0 + CUDA 12.9.1: Updated the default CUDA build to torch==2.9.0+cu129, enabling Inductor partitioning and landing multiple fixes in graph-partition rules and compile-cache integration.

Batch-invariant torch.compile: Generalized batch-invariant support across attention and MoE backends, with explicit support for DeepGEMM and FlashInfer on Hopper and Blackwell GPUs.

Robust async scheduling: Fixed several correctness and stability issues in async scheduling, especially when combined with chunked prefill, structured outputs, priority scheduling, MTP, and DeepEP / DCP. We expect --async-scheduling to be enabled by default in the next release.

Stronger scheduler + KV ecosystem: Improved test coverage in CI and made scheduler behavior more robust with KV connectors, prefix caching, and multi-node deployments.

Anthropic API Support: Added support for the /v1/messages endpoint, allowing users to interact with vllm serve using Anthropic-compatible clients.

Detailed release notes will be updated in the next few days.

What's Changed

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (@frankwang28 #25355)

[Docs] Add Toronto Meetup (@mgoin #25773)

[CI] Add E2E Blackwell Quantized MoE Test (@mgoin #25723)

[V1] address post issues related to #20059 (part 1); cascade attention reenable by default (@fhl2000 #23046)

[CI] Fix FlashInfer AOT in release docker image (@mgoin #25730)

[spec decode] Consolidate speculative decode method name for MTP (@zixi-qi #25232)

Reduce the Cuda Graph memory footprint when running with DBO (@SageMoore #25779)

Kernel-override Determinism [1/n] (@bwasti #25603)

[Bugfix] Optimize CpuGpuBuffer initialization (@namanlalitnyu #25447)

[Spec decode] automatically disable mm for text-only draft models (@jmkuebler #25667)

[Core] Don't count preempted tokens in prefix cache hit rate (@zhuohan123 #25787)

Add option to restrict media domains (@russellb #25783)

Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (@mgoin #25782)

[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (@david6666666 #22872)

[Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (@yewentao256 #25788)

[CI/Build] Consolidate model loader tests and requirements (@DarkLight1337 #25765)

[CI/Build] Add timing to Model Executor Test (@22quinn #25799)

[CI/Build] Reorganize root-level V1 tests (@DarkLight1337 #25767)

[Misc] Fix codeowners override for v1 sample and attention (@22quinn #25037)

[Misc] Update openai client example file for multimodal (@ywang96 #25795)

[Bugfix] Add missing image_size for phi4_multimodal (@Renovamen #25796)

[Bugfix] Merge MM embeddings by index instead of token IDs (@DarkLight1337 #16229)

Validate API tokens in constant time (@russellb #25781)

Add filtering for chat template kwargs (@russellb #25794)

Fix GPTQ model loading in Transformers backend (@hmellor #25770)

[Bugfix] Fix triton import precommit failure (@tlrmchlsmth #25803)

[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (@tlrmchlsmth #24982)

[docs] Resolve transcriptions API TODO (@yyzxw #25446)

[env] default nixl side port conflicts with kv-event zmq port (@panpan0000 #25056)

[Core] Refactor self.model() to call a helper for subclassing. (@patrick-toulme #25084)

[torch.compile]: Add VLLM_DEBUG_DUMP_PATH environment variable (@ZJY0516 #25651)

[Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (@smarterclayton #25766)

[Core] GC Debug callback (@Jialin #24829)

New Contributors

@bwasti first commit is #25603

@Renovamen first commit is #25796

@patrick-toulme first commit is #25084

@kingsmad first commit is #25825

@yingjun-mou first commit is #25827

@zhoukezi first commit is #25854

@leejnau first commit is #25706

@adabeyta first commit is #25513

@acisseJZhong first commit is #25912

@a120092009 first commit is #25942

@Anionex first commit is #25354

@DrStone1971 first commit is #25843

@certainly-param first commit is #25935

@natoscott first commit is #26007

@kmaehashi first commit is #26005

@leo-pony first commit is #25470

@huijjj first commit is #24947

@levunet first commit is #24768

@Egor-Krivov first commit is #25668

@sixiang-google first commit is #25992

@astralord first commit is #26027

@jasl first commit is #26098

@nrghosh first commit is #26148

@southfreebird first commit is #25974

@soldni first commit is #26054

@yuafng first commit is #26219

@ILikeIneine first commit is #25823

@jasonlizhengjian first commit is #25998

@elieserr first commit is #26177

@orangeng first commit is #26266

@ymoslem first commit is #26258

@abhisheksheth28 first commit is #25521

@seven-mile first commit is #26231

@cfRod first commit is #26289

@atalhens first commit is #26265

@gholmes829 first commit is #25164

@dcampora first commit is #25945

@antrec first commit is #26340

@plliao first commit is #26325

@morrison-turnansky first commit is #26113

@isharif168 first commit is #26347

@Barry-Delaney first commit is #25931

@utkarshsharma1 first commit is #26279

@Aydin-ab first commit is #25283

@therealnaveenkamal first commit is #25103

@QierLi first commit is #24926

@zhiyuan1i first commit is #24486

@iwzbi first commit is #16601

@roikoren755 first commit is #25947

@luis5tb first commit is #25593

@wangxiongts first commit is #25550

@sangho-vision first commit is #26563

@muzian666 first commit is #26562

@HsChen-sys first commit is #22100

@FENP first commit is #26574

@gjgjos first commit is #26339

Full Changelog: https://github.com/vllm-project/vllm/compare/v0.11.0...v0.11.1

vllm

Highlights

What's Changed

New Contributors

More Python Projects

AutoGPT

stable-diffusion-webui

transformers

yt-dlp

More Python Projects

AutoGPT

stable-diffusion-webui

transformers

yt-dlp

v0.11.1

Highlights

What's Changed

New Contributors