Unclaimed project
Are you a maintainer of vllm? Claim this project to take control of your public changelog and roadmap.
Changelog
A high-throughput and memory-efficient inference and serving engine for LLMs
Last updated about 2 months ago
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
Stable Diffusion web UI
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
A feature-rich command-line audio/video downloader
v0.15.1 is a patch release with security fixes, RTX Blackwell GPU fixes support, and bug fixes.
This release features 335 commits from 158 contributors (39 new)!
This is a patch release on top of v0.14.0 to address a few security and memory leak fixes.
This release features approximately 660 commits from 251 contributors (86 new contributors).
Breaking Changes:
--no-async-scheduling.
This release features 442 commits from 207 contributors (61 new contributors)!
Breaking Changes: This release includes deprecation removals, PassConfig flag renames, and attention configuration changes from environment variables to CLI arguments. Please review the breaking changes section carefully before upgrading.
This release features 474 commits from 213 contributors (57 new)！
Breaking Changes: This release includes PyTorch 2.9.0 upgrade (CUDA 12.9), V0 deprecations including xformers backend, and scheduled removals - please review the changelog carefully.
Major Features:
This release includes 4 bug fixes on top of v0.11.1:
This release includes 1456 commits from 449 contributors (184 new contributors)!
Key changes include:
torch==2.9.0+cu129, enabling Inductor partitioning and landing multiple fixes in graph-partition rules and compile-cache integration.torch.compile: Generalized batch-invariant suppor...This release features 538 commits, 207 contributors (65 new contributors)!
This release contains 740 commits from 266 contributors (97 new)!
Breaking Changes: This release includes PyTorch 2.8.0 upgrade, V0 deprecations, and API changes - please review the changelog carefully.
aarch64 support: This release features native support for aarch64 allowing usage of vLLM on GB200 platform. The docker image vllm/vllm-openai should already be multip...