NewAI Enhanced
v0.5.8
SGLang 0.5.7 Release
Breaking Changes
- Transformers reverted to 4.57.1 (was temporarily updated to 5.0.0rc0)
SGLANG_USE_MODELSCOPEenvironment variable behavior changed to prevent HuggingFace access
Unclaimed project
Are you a maintainer of sglang? Claim this project to take control of your public changelog and roadmap.
Changelog
SGLang is a high-performance serving framework for large language models and multimodal models.
Last updated 16 days ago
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
A feature-rich command-line audio/video downloader
Python tool for converting files and office documents to Markdown.
:octocat: 分享 GitHub 上有趣、入门级的开源项目。Share interesting, entry-level open source projects on GitHub.
SGLANG_USE_MODELSCOPE environment variable behavior changed to prevent HuggingFace accessparameter to require_reasoningget_device by @rauletorresc in https://github.com/sgl-project/sglang/pull/14225transfer_engine_bench into maunal test by @hnyls2002 in https://github.com/sgl-project/sglang/pull/14429python.sglang by @hnyls2002 in https://github.com/sgl-project/sglang/pull/14577--fp8-gemm-backend by @b8zhong in https://github.com/sgl-project/sglang/pull/14379test_eagle_infer_beta_dp_attention.py by @hnyls2002 in https://github.com/sgl-project/sglang/pull/14831 PowerOfTwo policy by @ppraneth in https://github.com/sgl-project/sglang/pull/14823num_token_non_padded computation in prefill by @yuchengz816-bot in https://github.com/sgl-project/sglang/pull/14313server_fixtures in sglang.test by @hnyls2002 in https://github.com/sgl-project/sglang/pull/14899parameter to require_reasoning by @JustinTong0323 in https://github.com/sgl-project/sglang/pull/14922code field and unify error responses for router by @fzyzcjy in https://github.com/sgl-project/sglang/pull/15028bench_one_batch_server.py by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15158per_token could not be properly recognized when the token count was 1. by @haoyangli0109 in https://github.com/sgl-project/sglang/pull/14415v_head_dim by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15384truncate argument by @hnyls2002 in https://github.com/sgl-project/sglang/pull/14270sglang generate --perf-dump-path to include per-denoising-step timings by @BBuf in https://github.com/sgl-project/sglang/pull/15397MiMo-V2-Flash day0 support by @acelyc111 in https://github.com/sgl-project/sglang/pull/15207hidden_states_before_norm by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15485--perf-dump-path Desc by @BBuf in https://github.com/sgl-project/sglang/pull/15533--perf-dump-path JSON output (remove duplicate denoise steps) by @BBuf in https://github.com/sgl-project/sglang/pull/15537mtp meaning introduce by mimo by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15632None handling in sglang's environ by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15770ModelRunner by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15802__init__ of TokenizerManager and DetokenizerManager by @merrymercy in https://github.com/sgl-project/sglang/pull/15796ModelRunnerKVCacheMixin to simplify the code. by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15821None bug by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15870test_utils by @hnyls2002 in https://github.com/sgl-project/sglang/pull/15920extend_logprob_start_len calculation by @ch-wan in https://github.com/sgl-project/sglang/pull/15922shlex by @hnyls2002 in https://github.com/sgl-project/sglang/pull/16010extend_logprob_start_len calculation out of prepare_for_extend by @ch-wan in https://github.com/sgl-project/sglang/pull/16105attack204 into CI_PERMISSION by @hnyls2002 in https://github.com/sgl-project/sglang/pull/16131extend_input_len_per_req with eagle. by @hnyls2002 in https://github.com/sgl-project/sglang/pull/16129