New
Dynamo v0.8.1
Dynamo v0.8.1 Release Notes
Summary
Dynamo 0.8.1 is a patch release that adds profiler enhancements for Kubernetes deployments and addresses bug fixes for SGLang and worker identification. This release adds support for mounting model cache PVCs to profiler pods, fixes YAML configuration parsing for boolean flags in SGLang, resolves container build issues for CUDA 13 SGLang environments, and corrects a pod hash calculation issue that could affect worker identification in Kubernetes.
Base Branch: release/0.8.0
Major Features & Improvements
Kubernetes Deployment
- Profiler Model Cache PVC Support: Added ability to mount model cache PVCs to profiler pods when specified in
DynamoGraphDeploymentRequest, enabling profilers to access pre-downloaded model weights without re-downloading (#5212).
Bug Fixes
- SGLang YAML Config Parsing: Fixed YAML config parsing for
store_truearguments (e.g.,trust-remote-code,enable-metrics) that were incorrectly converted to--flag trueinstead of just--flag, breaking boolean configuration options (#5513). - SGLang CUDA 13 Container Build: Fixed NVIDIA package installation in the SGLang CUDA 13 container to install CuDNN 9.16+ based on CUDA version, resolving PyTorch 2.9.1 compatibility issues with
nn.Conv3dthat caused performance degradation and excessive memory usage in multimodal workloads (#5461). - Worker ID Precision Loss: Fixed routing failures caused by
f64precision loss when worker/instance IDs exceeded 2^53, which caused approximately half of workers in large deployments to be unreachable for KV cache routing decisions (#5471).
Documentation
- DGDR SLA Profiler Compatibility: Documented that
DynamoGraphDeploymentRequestprofiling configurations using camelCase field names and model cache PVC options require Dynamo 0.8.1 or later (#5492).
Known Issues
For known issues in this release, refer to the Known Issues section in the Dynamo v0.8.0 Release Notes.