Qwen3.6

Quantization examples for the Qwen3.6-35B-A3B sparse MoE model.

Note: These examples require transformers >= v5, which can be installed with:

uv pip install --upgrade transformers

With this, the examples can run end-to-end.

• NVFP4 MoE Example

Pre-quantized Checkpoints

• RedHatAI/Qwen3.6-35B-A3B-NVFP4
• RedHatAI/Qwen3.6-35B-A3B-FP8-dynamic