Tutel

What's New in v0.4.1:

• Renew R1 containers for MI300x: tutelgroup/deepseek-671b:mi300x8-chat-20250319

How to Setup:
python3 -m pip install -v -U --no-build-isolation https://github.com/microsoft/tutel/archive/refs/tags/v0.4.1.tar.gz

What's New in v0.4.0:

• A bunch of Tutel interface enhancements.
• DeepSeek R1 671B support for single MI300x8.

How to Setup:
python3 -m pip install -v -U --no-build-isolation https://github.com/microsoft/tutel/archive/refs/tags/v0.4.0.tar.gz

What's New in v0.3.2:

1. Add --use_tensorcore option for benchmarking in tutel.examples.helloworld.
2. Read TUTEL_GLOBAL_TIMEOUT_SEC from environment variable to configure NCCL timeout setting.
3. Extend tutel.examples.helloworld_custom_expert to explain the way to override MoE with customized expert layers.

How to Setup:
python3 -m pip install -v -U --no-build-isolation http...

What's New in v0.3.1:

1. Enable 2 additional collective communication primitives: net.batch_all_to_all_v(), net.batch_all_gather_v().

How to Setup:
python3 -m pip install -v -U --no-build-isolation https://github.com/microsoft/tutel/archive/refs/tags/v0.3.1.tar.gz

What's New in v0.3.0:

1. Support Megablocks-style dMoE inference (see README.md for more information)

How to Setup:
python3 -m pip install -v -U --no-build-isolation https://github.com/microsoft/tutel/archive/refs/tags/v0.3.0.tar.gz