vllm_omni.diffusion.lora.layers.column_parallel_linear ¶
DiffusionColumnParallelLinearWithLoRA ¶
Bases: DiffusionBaseLinearLayerWithLoRA, ColumnParallelLinearWithLoRA
Diffusion ColumnParallelLinear with LoRA. Prioritize apply() in DiffusionBaseLinearLayerWithLoRA
DiffusionMergedColumnParallelLinearWithLoRA ¶
Bases: DiffusionBaseLinearLayerWithLoRA, MergedColumnParallelLinearWithLoRA
Diffusion MergedColumnParallelLinear (gate_up_proj) with LoRA. Prioritize apply() in DiffusionBaseLinearLayerWithLoRA
DiffusionMergedQKVParallelLinearWithLoRA ¶
Bases: DiffusionBaseLinearLayerWithLoRA, MergedQKVParallelLinearWithLoRA
Diffusion MergedQKVParallelLinear (to_qkv) with 3 LoRAs. Prioritize apply() in DiffusionBaseLinearLayerWithLoRA
DiffusionQKVParallelLinearWithLoRA ¶
Bases: DiffusionBaseLinearLayerWithLoRA, QKVParallelLinearWithLoRA
Diffusion QKVParallelLinear with single LoRA. Prioritize apply() in DiffusionBaseLinearLayerWithLoRA