vllm_omni.platforms.npu.quant ¶
Modules:
| Name | Description |
|---|---|
fish_omni | Ascend block-FP8 experts and linear methods for Drama 3. |
kv_quant_npu | Seeded rotation matrices for MindIE-SD quantized attention. |
vllm_omni.platforms.npu.quant ¶Modules:
| Name | Description |
|---|---|
fish_omni | Ascend block-FP8 experts and linear methods for Drama 3. |
kv_quant_npu | Seeded rotation matrices for MindIE-SD quantized attention. |