Unclaimed project
Are you a maintainer of sglang? Claim this project to take control of your public changelog and roadmap.
Changelog
SGLang is a high-performance serving framework for large language models and multimodal models.
Last updated about 10 hours ago
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
Stable Diffusion web UI
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
A feature-rich command-line audio/video downloader
SGLANG_USE_MODELSCOPE environment variable behavior changed to prevent HuggingFace accessparameter to require_reasoningWe're excited to announce SMG v0.3.1 โ a game-changing release with 10-12x performance improvement and 99% memory reduction in cache-aware routing, plus enterprise-grade security!
Complete optimization overhaul of our cache-aware routing engine with stunning performance and memory gains: ###...
We're thrilled to announce SGLang Model Gateway v0.3.0 โ a major release with powerful new features, architectural improvements, and important breaking changes!
Complete overhaul with new 6-layer metrics architecture covering protocol (HTTP/gRPC), router, worker, streaming (TTFT/TPOT), c...
We're excited to announce SGLang Model Gateway v0.2.4 โ a massive release focused on performance, security, and production-ready observability!
We've invested heavily in performance across the entire stack:
We're excited to announce another powerful update to SGLang Model Gateway with performance improvements and expanded database support!
โก Bucket Mode Routing - 20-30% Performance Boost Introducing our new bucket-based routing algorithm that dramatically improves performance in PD mode. See up to **20-30% imp...
๐ฏ Industry-First Responses API for All Models We're bringing OpenAI's Responses API to the entire open-source ecosystem! Now enjoy native support for Llama, DeepSeek, Qwen, and more โ with built-in chat history management, multi-turn conversations, and seamless MCP integration. This is the first solution to democratiz...