Qwen3.8-27B
Quantization examples for the Qwen3.8-27B vision-language model.
Note: These examples require
With this, the examples can run end-to-end.transformers >= v5, which can be installed with:
Examples
Pre-quantized Checkpoints
| Model | Format | Hugging Face Link |
|---|---|---|
| Qwen3.8-27B | INT4 (W4A16) | RedHatAI/Qwen3.8-27B-INT4 |
| Qwen3.8-27B | NVFP4 | RedHatAI/Qwen3.8-27B-NVFP4 |
| Qwen3.8-27B | MXFP4 | RedHatAI/Qwen3.8-27B-MXFP4 |