[BUG] Fix UlyssesSPAttentionHF.register_with_transformers() crash with PEFT models by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7737
Add core api update blog by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7738
Fix Nebula checkpoint engine commit() API mismatch by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7740
Fix DecoupledCheckpointEngine deadlock and improve reliability by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7742
Fix OnebitLamb NaN propagation with empty parameters by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7736
fix: remove premature MPI environment variable check in OpenMPIRunner by @leejianwoo-collab in https://github.com/deepspeedai/DeepSpeed/pull/7751
Enable python 3.11 and 3.12 tests by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7007
Add CI workflow to run tests on AWS by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7753
Add fallback to BF16 support check by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7754
Fix DeepCompile for PyTorch 2.8/2.9 compatibility by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7755
Removed amp testcases by @k-artem in https://github.com/deepspeedai/DeepSpeed/pull/7745
fix: avoid IndexError in BF16_Optimizer.destroy() when using DummyOptim by @leejianwoo-collab in https://github.com/deepspeedai/DeepSpeed/pull/7763
New Contributors
@ImaGoodFella made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7715
@k-artem made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7448
@kashif made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7724
@Rakshit-gen made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7735
@leejianwoo-collab made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7751
Full Changelog: https://github.com/deepspeedai/DeepSpeed/compare/v0.18.3...v0.18.4