Llama 4
Quantization examples for Meta's Llama 4 Scout multimodal model.
Examples
Pre-quantized Checkpoints
Llama 4 Scout
- RedHatAI/Llama-4-Scout-17B-16E-Instruct-NVFP4
- RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-block
- RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16