https://docs.vllm.ai/en/latest/ 2026-06-03 https://docs.vllm.ai/en/latest/api/ 2026-06-03 https://docs.vllm.ai/en/latest/benchmarking/ 2026-06-03 https://docs.vllm.ai/en/latest/benchmarking/cli/ 2026-06-03 https://docs.vllm.ai/en/latest/benchmarking/dashboard/ 2026-06-03 https://docs.vllm.ai/en/latest/benchmarking/sweeps/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/chat/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/complete/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/run-batch/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/latency/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/mm_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/throughput/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/sweep/plot/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/sweep/plot_pareto/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/sweep/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/bench/sweep/serve_workload/ 2026-06-03 https://docs.vllm.ai/en/latest/cli/launch/render/ 2026-06-03 https://docs.vllm.ai/en/latest/community/contact_us/ 2026-06-03 https://docs.vllm.ai/en/latest/community/meetups/ 2026-06-03 https://docs.vllm.ai/en/latest/community/sponsors/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/conserving_memory/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/engine_args/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/env_vars/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/model_resolution/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/optimization/ 2026-06-03 https://docs.vllm.ai/en/latest/configuration/serve_args/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/deprecation_policy/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/editing-agent-instructions/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/incremental_build/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/profiling/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/vulnerability_management/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/ci/failures/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/ci/nightly_builds/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/ci/update_pytorch_version/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/dockerfile/dockerfile/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/model/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/model/basic/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/model/multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/model/registration/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/model/tests/ 2026-06-03 https://docs.vllm.ai/en/latest/contributing/model/transcription/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/docker/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/k8s/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/nginx/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/anyscale/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/anything-llm/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/autogen/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/bentoml/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/cerebrium/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/chatbox/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/dify/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/dstack/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/haystack/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/helm/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/hf_inference_endpoints/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/litellm/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/lobe-chat/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/lws/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/modal/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/open-webui/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/retrieval_augmented_generation/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/runpod/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/skypilot/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/streamlit/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/frameworks/triton/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/aibrix/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/dynamo/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/kaito/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/kserve/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/kthena/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/kubeai/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/kuberay/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/llamastack/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/llm-d/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/llmaz/ 2026-06-03 https://docs.vllm.ai/en/latest/deployment/integrations/production-stack/ 2026-06-03 https://docs.vllm.ai/en/latest/design/arch_overview/ 2026-06-03 https://docs.vllm.ai/en/latest/design/attention_backends/ 2026-06-03 https://docs.vllm.ai/en/latest/design/cuda_graphs/ 2026-06-03 https://docs.vllm.ai/en/latest/design/cuda_graphs_multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/design/custom_op/ 2026-06-03 https://docs.vllm.ai/en/latest/design/dbo/ 2026-06-03 https://docs.vllm.ai/en/latest/design/debug_vllm_compile/ 2026-06-03 https://docs.vllm.ai/en/latest/design/fused_moe_modular_kernel/ 2026-06-03 https://docs.vllm.ai/en/latest/design/fusions/ 2026-06-03 https://docs.vllm.ai/en/latest/design/huggingface_integration/ 2026-06-03 https://docs.vllm.ai/en/latest/design/hybrid_kv_cache_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/design/io_processor_plugins/ 2026-06-03 https://docs.vllm.ai/en/latest/design/logits_processors/ 2026-06-03 https://docs.vllm.ai/en/latest/design/lora_resolver_plugins/ 2026-06-03 https://docs.vllm.ai/en/latest/design/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/design/mm_processing/ 2026-06-03 https://docs.vllm.ai/en/latest/design/model_runner_v2/ 2026-06-03 https://docs.vllm.ai/en/latest/design/moe_kernel_features/ 2026-06-03 https://docs.vllm.ai/en/latest/design/multiprocessing/ 2026-06-03 https://docs.vllm.ai/en/latest/design/nixl_kv_cache_lease/ 2026-06-03 https://docs.vllm.ai/en/latest/design/optimization_levels/ 2026-06-03 https://docs.vllm.ai/en/latest/design/p2p_nccl_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/design/paged_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/design/plugin_system/ 2026-06-03 https://docs.vllm.ai/en/latest/design/prefix_caching/ 2026-06-03 https://docs.vllm.ai/en/latest/design/torch_compile/ 2026-06-03 https://docs.vllm.ai/en/latest/design/torch_compile_multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/design/vllm_ir/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/applications/chatbot/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/applications/rag/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/basic/offline_inference/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/basic/online_serving/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/deployment/async_llm_streaming/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/deployment/chart-helm/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/deployment/llm_engine_example/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/deployment/sagemaker-entrypoint/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/disaggregated_encoder/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/disaggregated_prefill/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/disaggregated_serving/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/ec_both_encoder/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/example_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/flexkv_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/kv_load_failure_recovery_offline/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/lmcache/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/mooncake_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/disaggregated/p2p_nccl_xpyd/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/automatic_prefix_caching/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/batch_invariance/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/context_extension/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/data_parallel/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/kv_events/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/logging_configuration/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/logits_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/lora/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/openai_batch/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/pause_resume/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/profiling/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/prompt_embed/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/reset_kv/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/sharded_state/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/speculative_decoding/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/structured_outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/tensorize_vllm_model/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/features/torchrun/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/generate/batched_chat_completions_online/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/generate/multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/generate/qwen_1m_offline/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/generate/token_generation_client/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/observability/dashboards/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/observability/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/observability/opentelemetry/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/observability/prometheus_grafana/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/classify/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/embed/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/plugin/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/reward/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/score/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/token_classify/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/pooling/token_embed/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/ray_serving/batch_llm_inference/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/ray_serving/elastic_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/ray_serving/multi-node-serving/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/ray_serving/ray_serve_deepseek/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/ray_serving/run_cluster/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/reasoning/openai_chat_completion_tool_calls_with_reasoning/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/reasoning/openai_chat_completion_with_reasoning/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/reasoning/openai_chat_completion_with_reasoning_streaming/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/reasoning/openai_responses_client/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_async_new_apis/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_http_ipc/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_http_nccl/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_ipc/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_ipc_fsdp_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_nccl/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_nccl_fsdp_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/rlhf_sparse_nccl/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/routed_experts_e2e/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/rl/skip_loading_weights_in_engine_init/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/speech_to_text/lid/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/speech_to_text/openai/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/speech_to_text/realtime/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/chat_with_tools_offline/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/openai_chat_completion_client_with_tools/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/openai_chat_completion_client_with_tools_required/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/openai_chat_completion_client_with_tools_xlam/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/openai_chat_completion_client_with_tools_xlam_streaming/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/openai_responses_client_with_mcp_tools/ 2026-06-03 https://docs.vllm.ai/en/latest/examples/tool_calling/openai_responses_client_with_tools/ 2026-06-03 https://docs.vllm.ai/en/latest/features/ 2026-06-03 https://docs.vllm.ai/en/latest/features/automatic_prefix_caching/ 2026-06-03 https://docs.vllm.ai/en/latest/features/batch_invariance/ 2026-06-03 https://docs.vllm.ai/en/latest/features/context_extension/ 2026-06-03 https://docs.vllm.ai/en/latest/features/custom_arguments/ 2026-06-03 https://docs.vllm.ai/en/latest/features/custom_logitsprocs/ 2026-06-03 https://docs.vllm.ai/en/latest/features/disagg_encoder/ 2026-06-03 https://docs.vllm.ai/en/latest/features/disagg_prefill/ 2026-06-03 https://docs.vllm.ai/en/latest/features/index_cache/ 2026-06-03 https://docs.vllm.ai/en/latest/features/interleaved_thinking/ 2026-06-03 https://docs.vllm.ai/en/latest/features/lora/ 2026-06-03 https://docs.vllm.ai/en/latest/features/mooncake_connector_usage/ 2026-06-03 https://docs.vllm.ai/en/latest/features/mooncake_store_connector_usage/ 2026-06-03 https://docs.vllm.ai/en/latest/features/moriio_connector_usage/ 2026-06-03 https://docs.vllm.ai/en/latest/features/multimodal_inputs/ 2026-06-03 https://docs.vllm.ai/en/latest/features/nixl_connector_compatibility/ 2026-06-03 https://docs.vllm.ai/en/latest/features/nixl_connector_usage/ 2026-06-03 https://docs.vllm.ai/en/latest/features/prompt_embeds/ 2026-06-03 https://docs.vllm.ai/en/latest/features/reasoning_outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/features/sleep_mode/ 2026-06-03 https://docs.vllm.ai/en/latest/features/structured_outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/features/tool_calling/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/auto_awq/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/bnb/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/fp8_vit_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/gguf/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/gptqmodel/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/inc/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/int4/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/int8/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/llm_compressor/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/modelopt/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/online/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/quantized_kvcache/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/quark/ 2026-06-03 https://docs.vllm.ai/en/latest/features/quantization/torchao/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/draft_model/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/extract_hidden_states/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/mlp/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/n_gram/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/parallel_draft_model/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/speculators/ 2026-06-03 https://docs.vllm.ai/en/latest/features/speculative_decoding/suffix/ 2026-06-03 https://docs.vllm.ai/en/latest/getting_started/quickstart/ 2026-06-03 https://docs.vllm.ai/en/latest/getting_started/installation/ 2026-06-03 https://docs.vllm.ai/en/latest/getting_started/installation/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/getting_started/installation/gpu/ 2026-06-03 https://docs.vllm.ai/en/latest/governance/collaboration/ 2026-06-03 https://docs.vllm.ai/en/latest/governance/committers/ 2026-06-03 https://docs.vllm.ai/en/latest/governance/process/ 2026-06-03 https://docs.vllm.ai/en/latest/models/generative_models/ 2026-06-03 https://docs.vllm.ai/en/latest/models/supported_models/ 2026-06-03 https://docs.vllm.ai/en/latest/models/extensions/fastsafetensor/ 2026-06-03 https://docs.vllm.ai/en/latest/models/extensions/instanttensor/ 2026-06-03 https://docs.vllm.ai/en/latest/models/extensions/runai_model_streamer/ 2026-06-03 https://docs.vllm.ai/en/latest/models/extensions/tensorizer/ 2026-06-03 https://docs.vllm.ai/en/latest/models/hardware_supported_models/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/models/hardware_supported_models/xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/classify/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/embed/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/reward/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/scoring/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/specific_models/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/token_classify/ 2026-06-03 https://docs.vllm.ai/en/latest/models/pooling_models/token_embed/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/context_parallel_deployment/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/data_parallel_deployment/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/distributed_troubleshooting/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/expert_parallel_deployment/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/offline_inference/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/parallelism_scaling/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/integrations/claude_code/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/integrations/codex/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/integrations/langchain/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/integrations/llamaindex/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/online_serving/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/online_serving/generative_scoring/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/online_serving/openai_compatible_server/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/online_serving/renderer/ 2026-06-03 https://docs.vllm.ai/en/latest/serving/online_serving/speech_to_text/ 2026-06-03 https://docs.vllm.ai/en/latest/training/async_rl/ 2026-06-03 https://docs.vllm.ai/en/latest/training/layerwise/ 2026-06-03 https://docs.vllm.ai/en/latest/training/rlhf/ 2026-06-03 https://docs.vllm.ai/en/latest/training/trl/ 2026-06-03 https://docs.vllm.ai/en/latest/training/weight_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/training/weight_transfer/base/ 2026-06-03 https://docs.vllm.ai/en/latest/training/weight_transfer/ipc/ 2026-06-03 https://docs.vllm.ai/en/latest/training/weight_transfer/nccl/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/faq/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/reproducibility/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/security/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/troubleshooting/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/usage_stats/ 2026-06-03 https://docs.vllm.ai/en/latest/usage/v1_guide/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/assets/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/assets/audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/assets/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/assets/image/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/assets/video/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/datasets/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/datasets/create_txt_slices_dataset/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/datasets/datasets/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/datasets/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/latency/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/lib/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/lib/endpoint_request_func/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/lib/ready_checker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/lib/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/mm_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/plot/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/startup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/cli/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/param_sweep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/plot/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/plot_pareto/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/serve_workload/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/server/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/startup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/sweep/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/benchmarks/throughput/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/collect_env/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/backends/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/base_static_graph/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/breakable_cudagraph/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/caching/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/codegen/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/compiler_interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/counter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/cuda_graph/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/decorators/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/monitor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/partition_rules/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/act_quant_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/allreduce_rms_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/attn_quant_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/collective_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/matcher_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/mla_attn_quant_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/mla_rope_kvcache_cat_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/qk_norm_rope_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/rms_quant_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/rocm_aiter_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/rope_kvcache_fusion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fusion/sequence_parallelism/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/fx_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/inductor_pass/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/ir/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/ir/clone_elimination/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/ir/inplace_functionalization/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/ir/lowering_pass/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/ir/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/pass_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/utility/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/utility/fix_functionalization/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/utility/noop_elimination/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/utility/post_cleanup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/utility/scatter_split_replace/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/utility/split_coalescing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/passes/vllm_inductor_pass/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/piecewise_backend/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/compilation/wrapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/compilation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/device/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/ec_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/kernel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/kv_events/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/kv_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/load/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/lora/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/mamba/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/model/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/model_arch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/observability/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/offload/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/parallel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/pooler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/profiler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/quantization/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/reasoning/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/scheduler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/speculative/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/speech_to_text/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/structured_outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/vllm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/config/weight_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/connections/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/cute_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/cute_utils/cvt/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/device_allocator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/device_allocator/cumem/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/communication_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/all2all/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/all_reduce_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/base_device_communicator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/cpu_communicator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/cuda_communicator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/cuda_wrapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/custom_all_reduce/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/flashinfer_all_reduce/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/mnnvl_compat/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/pynccl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/pynccl_allocator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/pynccl_wrapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/quick_all_reduce/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/ray_communicator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/shm_broadcast/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/shm_object_storage/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/symm_mem/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/device_communicators/xpu_communicator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ec_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ec_transfer/ec_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ec_transfer/ec_connector/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ec_transfer/ec_connector/example_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ec_transfer/ec_connector/factory/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/ec_transfer/ec_transfer_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/elastic_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/elastic_ep/elastic_execute/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/elastic_ep/elastic_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/elastic_ep/standby_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/async_worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/eplb_communicator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/eplb_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/eplb_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/policy/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/policy/abstract/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/policy/default/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/eplb/rebalance_execute/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_events/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/factory/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/decode_bench_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/example_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/example_hidden_states_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/flexkv_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/hf3fs_client/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/hf3fs_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/hf3fs_metadata_server/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/utils/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/utils/gather_scatter_helper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/hf3fs/utils/hf3fs_mock_client/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/multi_process_adapter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/vllm_v1_adapter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/lmcache_mp_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/mooncake_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/mooncake_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/rdma_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/stats/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/coordinator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/data/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/scheduler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/mooncake/store/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/moriio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/moriio/moriio_common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/moriio/moriio_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/moriio/moriio_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/multi_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/metadata/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/scheduler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/stats/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/tp_mapping/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/nixl/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/offloading/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/offloading/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/offloading/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/offloading/scheduler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/offloading/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/offloading_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/p2p/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/p2p/p2p_nccl_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/p2p/p2p_nccl_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/p2p/tensor_memory_pool/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/simple_cpu_offload_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_connector/v1/ssm_conv_transfer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/kv_transfer/kv_transfer_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/nixl_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/parallel_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/stateless_coordinator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/weight_transfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/weight_transfer/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/weight_transfer/factory/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/weight_transfer/ipc_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/weight_transfer/nccl_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/distributed/weight_transfer/packed_tensor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/engine/arg_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/engine/async_llm_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/engine/llm_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/engine/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/anthropic/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/anthropic/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/anthropic/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/anthropic/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/api_server/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/chat_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/latency/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/main/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/mm_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/startup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/sweep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/benchmark/throughput/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/collect_env/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/launch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/main/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/openai/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/run_batch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/cli/types/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/constants/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/beam_search/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/beam_search/offline/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/beam_search/online/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/beam_search/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/factories/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/generative_scoring/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/generative_scoring/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/generate/generative_scoring/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/grpc_server/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/launcher/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/llm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/logger/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/mcp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/mcp/tool/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/mcp/tool_server/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/offline_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/api_server/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/chat_completion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/chat_completion/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/chat_completion/batch_serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/chat_completion/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/chat_completion/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/chat_completion/stream_harmony/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/cli_args/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/completion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/completion/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/completion/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/completion/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/dp_supervisor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/engine/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/engine/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/fingerprint/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/models/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/models/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/models/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/models/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/orca_metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/parser/harmony_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/parser/responses_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/context/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/harmony/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/streaming_events/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/responses/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/run_batch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/server_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/openai/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/base/io_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/base/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/base/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/classify/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/classify/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/classify/io_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/classify/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/classify/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/embed/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/embed/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/embed/io_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/embed/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/embed/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/factories/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/offline/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/pooling/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/pooling/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/pooling/io_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/pooling/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/pooling/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/io_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/typing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/scoring/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/typing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/pooling/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/sagemaker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/sagemaker/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/cache/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/rlhf/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/rlhf/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/rpc/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/rpc/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/server_info/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/server_info/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/sleep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/dev/sleep/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/disagg/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/disagg/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/disagg/mm_serde/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/disagg/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/disagg/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/elastic_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/elastic_ep/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/elastic_ep/middleware/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/instrumentator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/instrumentator/basic/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/instrumentator/health/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/instrumentator/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/instrumentator/offline_docs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/lora/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/lora/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/lora/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/profile/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/profile/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/render/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/render/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/render/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/tokenize/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/tokenize/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/tokenize/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/serve/tokenize/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/base/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/base/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/factories/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/realtime/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/realtime/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/realtime/connection/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/realtime/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/realtime/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/realtime/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/transcription/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/transcription/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/transcription/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/transcription/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/translation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/translation/api_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/translation/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/speech_to_text/translation/serving/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/ssl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/entrypoints/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/env_override/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/envs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/exceptions/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/forward_context/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/inputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/inputs/engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/inputs/llm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/inputs/preprocess/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ir/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ir/op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ir/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ir/ops/layernorm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ir/tolerances/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ir/util/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/aiter_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/case_key/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/config_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/ops/silu_mul_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/register/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/helion/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/oink_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/triton/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/triton/qkv_padded_fp8_quant/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/vllm_c/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/kernels/xpu_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logger/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/access_log_filter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/dump_input/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/formatter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/lazy/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/log_time/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logging_utils/torch_tensor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logits_process/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/logprobs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/base_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/column_parallel_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/fused_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/logits_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/replicated_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/row_parallel_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/layers/vocal_parallel_embedding/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/lora_model/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/lora_weights/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/model_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/torch_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/torch_ops/lora_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/fp8_kernel_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/fused_moe_lora_fp8_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/fused_moe_lora_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/kernel_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/lora_expand_fp8_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/lora_expand_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/lora_kernel_metadata/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/lora_shrink_fp8_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/lora_shrink_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/triton_ops/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/xpu_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/ops/xpu_ops/lora_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/peft_helper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/punica_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/punica_cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/punica_gpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/punica_selector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/punica_xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/punica_wrapper/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/request/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/resolver/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/lora/worker_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/custom_op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/MPLinearKernel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/allspark/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/conch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/cutlass/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/dynamic_4bit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/exllama/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/machete/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/rdna3_w4a16/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/triton_w4a16/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mixed_precision/zentorch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp4/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp4/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp4/marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp4/xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp8/Mxfp8LinearKernel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp8/emulation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp8/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp8/marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/mxfp8/xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/cutlass/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/emulation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/fbgemm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/nvfp4/marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/BlockScaledMMLinearKernel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/ScaledMMLinearKernel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/aiter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/cutlass/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/deep_gemm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/pytorch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/rocm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/triton/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/scaled_mm/zentorch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/linear/zentorch_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/mhc/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/mhc/aiter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/mhc/tilelang/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/mhc/tilelang_kernels/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/mhc/torch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/kernels/mhc/triton/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/activation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/chunked_local_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/cross_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/encoder_only_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/kv_transfer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/mla_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/mm_encoder_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention/static_sink_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/attention_layer_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/batch_invariant/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/conv/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/chunk/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/chunk_delta_h/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/chunk_o/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/chunk_scaled_dot_kkt/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/cumsum/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/fused_gdn_prefill_post_conv/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/fused_recurrent/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/fused_sigmoid_gating/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/index_py/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/kda/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/l2norm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/layernorm_guard/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/op/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/solve_tril/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fla/ops/wy_fast/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/activation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/all2all_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/cpu_fused_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/deep_gemm_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/eep_reconfigure/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/expert_map_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/aiter_mxfp4_w4a8_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/batched_deep_gemm_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/cpu_int4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/cpu_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/cutlass_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/deep_gemm_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/fallback/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/flashinfer_b12x_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/flashinfer_cutedsl_batched_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/flashinfer_cutedsl_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/flashinfer_cutlass_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/fused_batched_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/fused_humming_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/gpt_oss_triton_kernels_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/lora_context/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/lora_experts_mixin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/marlin_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/nvfp4_emulation_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/ocp_mx_emulation_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/rocm_aiter_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/triton_cutlass_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/triton_deep_gemm_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/triton_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/trtllm_bf16_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/trtllm_fp8_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/trtllm_mxfp4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/trtllm_mxint4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/trtllm_nvfp4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/experts/xpu_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/fused_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/fused_moe_method_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/fused_moe_modular_method/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/layer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/modular_kernel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/moe_align_block_size/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/moe_fused_mul_sum/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/moe_permute_unpermute/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/int_wna16/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/mxfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/mxfp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/unquantized/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/w4a8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/oracle/w4a8_int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/batched/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/deepep_ht/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/deepep_ll/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/flashinfer_nvlink_one_sided/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/flashinfer_nvlink_two_sided/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/mori/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/naive_dp_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/nixl_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/prepare_finalize/no_dp_ep/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/routed_experts_capturer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/aiter_shared_routed_fused_moe_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/base_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/custom_routing_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/fused_moe_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/fused_topk_bias_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/fused_topk_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/gate_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/grouped_topk_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/router_factory/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/routing_simulator_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/router/zero_expert_router/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/runner/moe_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/runner/moe_runner_interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/runner/shared_experts/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/topk_weight_and_reduce/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/unquantized_fused_moe_method/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/fused_moe/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/layernorm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/lightning_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/logits_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/abstract/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/gdn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/gdn/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/gdn/kimi_gdn_linear_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/gdn/olmo_gdn_linear_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/gdn/qwen_gdn_linear_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/linear_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/mamba_mixer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/mamba_mixer2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/mamba_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/causal_conv1d/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/cpu/causal_conv1d/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/cpu/gdn_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/gdn_chunk_cutedsl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/gdn_chunk_cutedsl/kernel_h/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/gdn_chunk_cutedsl/kernel_kkt_inv_uw/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/gdn_chunk_cutedsl/kernel_o/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/layernorm_gated/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/mamba_ssm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ssd_bmm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ssd_chunk_scan/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ssd_chunk_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ssd_combined/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ssd_state_passing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/ssu_dispatch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/ops/triton_helpers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mamba/short_conv/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mhc/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/minimax_rms_norm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/minimax_rms_norm/lamport_workspace/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/minimax_rms_norm/rms_norm_tp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/abstract/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/activations/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/seqwise/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/seqwise/heads/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/seqwise/methods/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/seqwise/poolers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/special/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/tokwise/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/tokwise/heads/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/tokwise/methods/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/pooler/tokwise/poolers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/auto_gptq/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/awq/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/awq_marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/awq_triton/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/base_config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/bitsandbytes/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w4a4_mxfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w4a4_nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w4a8_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w4a8_int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_w8a8_mxfp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_wna16/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors_moe/compressed_tensors_moe_wna16_marlin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_scheme/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a16_nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_mxfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a8_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a8_int/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a16_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w8a8_mxfp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_wNa16/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/transform/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/transform/linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/transform/module/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/transform/schemes/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/transform/schemes/linear_qutlass_nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/transform/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/triton_scaled_mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/experts_int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/fbgemm_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/fp_quant/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/gguf/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/humming/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/inc/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/input_quant_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/kv_cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/modelopt/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/moe_wna16/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/mxfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/online/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/online/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/online/fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/online/int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/online/moe_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/online/mxfp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/quark/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/quark_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/quark_nvfp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/quark_ocp_mx/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/quark_scheme/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/quark_w4a8_mxfp4_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/quark_w8a8_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/schemes/quark_w8a8_int8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/quark/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/qutlass_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/torchao/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/turboquant/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/turboquant/centroids/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/turboquant/config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/allspark_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/flashinfer_fp4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/flashinfer_mxint4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/flashinfer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/fp8_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/gptq_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/humming_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/int8_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/layer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/machete_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/marlin_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/marlin_utils_fp4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/marlin_utils_fp8/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/marlin_utils_test/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/mxfp4_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/mxfp6_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/mxfp8_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/nvfp4_emulation_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/nvfp4_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/ocp_mx_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/quant_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/utils/w8a8_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/resampler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/deepseek_scaling_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/dual_chunk_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/dynamic_ntk_alpha_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/dynamic_ntk_scaling_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/ernie45_vl_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/fope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/gemma4_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/linear_scaling_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/llama3_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/llama4_vision_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/mrope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/mrope_interleaved/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/ntk_scaling_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/phi3_long_rope_scaled_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/telechat3_scaling_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/xdrope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/rotary_embedding/yarn_scaling_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/sparse_attn_indexer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/vocab_parallel_embedding/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/base_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/bitsandbytes_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/default_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/dummy_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/ep_weight_filter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/gguf_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/modelexpress_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/layerwise/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/meta/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/sanitize/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/torchao_decorator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/types/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/reload/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/runai_streamer_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/sharded_state_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/tensorizer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/tensorizer_loader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/model_loader/weight_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/AXK1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/adapters/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/afmoe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/aimv2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/apertus/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/arcee/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/arctic/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/aria/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/audioflamingo3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/aya_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bagel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/baichuan/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bailing_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bailing_moe_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bamba/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bee/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bert/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bert_with_rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/blip/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/blip2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/bloom/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/chameleon/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/chatglm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/cheers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/clip/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/cohere2_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/cohere2_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/cohere_asr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/cohere_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/colbert/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/colmodernvbert/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/colpali/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/colqwen3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/colqwen3_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/commandr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/conformer_encoder/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/cosmos3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/dbrx/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepencoder/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepencoder2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_eagle3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_ocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_ocr2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_v2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/deepseek_vl2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/dots1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/dots_ocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/eagle2_5_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ernie/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ernie45/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ernie45_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ernie45_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ernie45_vl_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ernie_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/exaone/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/exaone4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/exaone4_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/exaone4_5_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/exaone_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/exaone_moe_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/extract_hidden_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/fairseq2_llama/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/falcon/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/falcon_h1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/fireredasr2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/fireredlid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/flex_olmo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/funasr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/funaudiochat/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/fuyu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma3_mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma3n/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma3n_audio_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma3n_mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma4_mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma4_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gemma4_unified/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4_1v/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4_moe_lite/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4_moe_lite_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4_moe_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm4v/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm_ocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glm_ocr_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glmasr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/glmasr_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gpt2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gpt_bigcode/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gpt_j/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gpt_neox/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gpt_oss/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/granite/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/granite4_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/granite_speech/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/granitemoe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/granitemoehybrid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/granitemoeshared/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/gritlm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/grok1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/h2ovl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hunyuan_v1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hunyuan_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hy_v3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hy_v3_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hyperclovax/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hyperclovax_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/hyperclovax_vision_v2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/idefics2_vision_model/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/idefics3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/interfaces/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/interfaces_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/intern_vit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/internlm2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/internlm2_ve/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/interns1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/interns1_pro/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/interns1_vit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/interns2_preview/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/internvl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/iquest_loopcoder/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/isaac/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/jais2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/jamba/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/jina/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/jina_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/kanana_v/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/keye/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/keye_vl1_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/kimi_audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/kimi_k25/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/kimi_k25_vit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/kimi_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/kimi_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/laguna/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/lfm2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/lfm2_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/lfm2_siglip2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/lfm2_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/lightonocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llama/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llama4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llama4_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llama_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llama_eagle3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llava/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llava_next/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llava_next_video/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/llava_onevision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/longcat_flash/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/longcat_flash_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mamba/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mamba2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/medusa/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mellum/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/midashenglm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mimo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mimo_audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mimo_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mimo_v2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mimo_v2_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mimo_v2_omni/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minicpm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minicpm3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minicpm_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minicpmo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minicpmv/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minicpmv4_6/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minimax_m2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minimax_text_01/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/minimax_vl_01/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mistral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mistral3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mistral_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mistral_large_3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mistral_large_3_eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mixtral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mllama4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mlp_speculator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/modernbert/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/module_mapping/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/molmo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/molmo2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/moondream3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/moonvit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/mpt/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/musicflamingo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nano_nemotron_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nemotron/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nemotron_h/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nemotron_h_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nemotron_nas/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nemotron_parse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nemotron_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/nvlm_d/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/olmo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/olmo2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/olmo_hybrid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/olmoe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/opencua/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/openpangu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/openpangu_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/openpangu_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/openvla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/opt/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/orion/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ouro/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ovis/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ovis2_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/paddleocr_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/paligemma/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/parakeet/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/param2moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/persimmon/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi3v/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi4mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi4mm_audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi4mm_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phi4siglip/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/phimoe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/pixtral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/plamo2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/plamo3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qianfan_ocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2_5_omni_thinker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2_5_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2_audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2_rm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen2_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_5_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_asr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_asr_forced_aligner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_asr_realtime/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_dflash/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_next/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_next_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_omni_moe_thinker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen3_vl_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/qwen_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/radio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/rnj1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/roberta/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/rvl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/sarvam/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/seed_oss/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/siglip/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/siglip2navit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/skyworkr1v/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/smolvlm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/solar/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/stablelm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/starcoder2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step3_text/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step3_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step3p5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step3p5_mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step3p7/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/step_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/tarsier/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/telechat2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/teleflm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/terratorch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/causal/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/legacy/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/pooling/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/transformers/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/ultravox/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/voxtral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/voxtral_realtime/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/voyage/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/whisper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/whisper_causal/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/whisper_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/models/zamba2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/offloader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/offloader/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/offloader/prefetch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/offloader/prefetch_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/offloader/uva/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/parameter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/warmup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/warmup/deep_gemm_warmup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_executor/warmup/kernel_warmup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/model_inspection/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/amd/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/amd/model/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/amd/mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/amd/rocm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/cache_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/fused_compress_quant_cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/fused_indexer_q/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/fused_inv_rope_fp8_quant/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/fused_mtp_input_rmsnorm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/fused_qk_rmsnorm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/ops/save_partial_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/common/rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/compressor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/flashmla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/model/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/mtp/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/ops/dequant_gather_k_cutedsl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/ops/fused_indexer_q_cutedsl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/ops/prepare_megamoe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/nvidia/ops/sparse_attn_compress_cutedsl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/models/deepseek_v4/quant_config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/encoder_budget/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/evs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/hasher/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/image/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/inputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/media/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/media/audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/media/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/media/connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/media/image/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/media/video/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/parse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/processing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/processing/context/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/processing/dummy_inputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/processing/inputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/processing/processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/multimodal/video/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/parser/abstract_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/parser/parser_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/cuda/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/rocm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/tpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/xpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/platforms/zen_cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/plugins/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/plugins/io_processors/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/plugins/io_processors/interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/plugins/lora_resolvers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/plugins/lora_resolvers/filesystem_resolver/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/plugins/lora_resolvers/hf_hub_resolver/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/pooling_params/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/profiler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/profiler/layerwise_profile/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/profiler/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/profiler/wrapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ray/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ray/lazy_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/ray/ray_env/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/abs_reasoning_parsers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/basic_parsers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/cohere_command_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/deepseek_r1_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/deepseek_v3_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/ernie45_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/gemma4_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/gemma4_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/gptoss_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/granite_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/hunyuan_a13b_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/hy_v3_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/identity_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/kimi_k2_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/minimax_m2_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/mistral_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/nemotron_v3_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/olmo3_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/poolside_v1_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/qwen3_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/seedoss_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/step3_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/reasoning/step3p5_reasoning_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/deepseek_v32/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/deepseek_v4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/embed_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/grok2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/hf/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/inputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/inputs/preprocess/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/inputs/tokenize/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/mistral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/params/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/renderers/terratorch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/sampling_params/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/scalar_type/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/scripts/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/sequence/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tasks/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/deepseek_v32/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/deepseek_v32_encoding/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/deepseek_v4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/deepseek_v4_encoding/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/detokenizer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/fastokens/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/grok2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/hf/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/kimi_audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/mistral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/protocol/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/qwen_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tokenizers/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/abstract_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/apertus_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/cohere_command_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/deepseekv31_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/deepseekv32_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/deepseekv3_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/deepseekv4_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/ernie45_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/functiongemma_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/gemma4_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/gemma4_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/gigachat3_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/glm47_moe_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/glm4_moe_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/granite4_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/granite_20b_fc_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/granite_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/hermes_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/hunyuan_a13b_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/hy_v3_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/internlm2_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/jamba_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/kimi_k2_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/lfm2_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/llama4_pythonic_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/llama_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/longcat_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/minicpm5xml_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/minimax_m2_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/minimax_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/mistral_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/olmo3_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/openai_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/phi4mini_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/poolside_v1_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/pythonic_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/qwen3coder_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/qwen3xml_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/seed_oss_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/step3_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/step3p5_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/streaming/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/structural_tag_registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tool_parsers/xlam_tool_parser/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tracing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tracing/otel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/tracing/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/chat_templates/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/chat_templates/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/config/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/config_parser_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/AXK1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/afmoe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/arctic/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/bagel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/chatglm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/cheers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/colmodernvbert/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/colpali/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/colqwen3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/cosmos3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/deepseek_v4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/deepseek_vl2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/dotsocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/extract_hidden_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/falcon/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/fireredlid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/flex_olmo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/funaudiochat/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/granite4_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/hunyuan_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/hy_v3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/hyperclovax/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/isaac/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/kimi_k25/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/kimi_linear/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/kimi_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/laguna/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/lfm2_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/medusa/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/mellum/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/midashenglm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/mimo_v2_omni/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/mistral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/mlp_speculator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/moondream3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/moonvit/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/nemotron/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/nemotron_h/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/olmo_hybrid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/openvla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/ovis/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/parakeet/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/qianfan_ocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/qwen3_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/qwen3_5_moe/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/qwen3_asr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/qwen3_next/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/radio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/speculators/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/speculators/algos/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/speculators/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/step3_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/step3p5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/tarsier2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/configs/ultravox/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/dynamic_module/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/gguf_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/model_arch_config_convertor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/bagel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/cheers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/cohere_asr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/deepseek_ocr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/deepseek_vl2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/fireredasr2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/fireredlid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/funasr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/glm4v/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/granite4_vision/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/h2ovl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/hunyuan_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/hunyuan_vl_image/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/internvl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/isaac/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/kimi_audio/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/kimi_k25/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/mimo_v2_omni/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/minicpmo/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/minicpmv/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/moondream3/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/nano_nemotron_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/nemotron_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/nvlm_d/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/openvla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/ovis/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/ovis2_5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/pixtral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/qwen3_asr/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/qwen_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/step3_vl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/processors/voxtral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/repo_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/runai_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/s3_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/transformers_utils/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/triton_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/triton_utils/allocation/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/triton_utils/importing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/triton_utils/jit_monitor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/usage/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/usage/usage_lib/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/argparse_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/async_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/collection_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/counter/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/cpu_resource_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/cpu_triton_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/deep_gemm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/func_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/gc_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/hashing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/import_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/jsontree/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/math_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/mem_constants/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/mem_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/mistral/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/multi_stream_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/nccl/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/network_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/numa_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/nvtx_pytorch_hooks/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/ompmultiprocessing/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/platform_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/print_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/serial_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/system_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/tensor_schema/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/torch_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/utils/tqdm_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backend/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/cpu_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/fa_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/flash_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/flash_attn_diffkv/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/flex_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/gdn_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/linear_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mamba1_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mamba2_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mamba_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/aiter_triton_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/compressor_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/cutlass_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/flashattn_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/flashinfer_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/flashinfer_mla_sparse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/flashmla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/flashmla_sparse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/indexer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/flash_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/flashinfer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/selector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/tokenspeed_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/prefill/trtllm_ragged/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/rocm_aiter_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/rocm_aiter_mla_sparse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/sparse_swa/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/sparse_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/tokenspeed_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/triton_mla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/mla/xpu_mla_sparse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/rocm_aiter_fa/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/rocm_aiter_unified_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/rocm_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/short_conv_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/triton_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/turboquant_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/backends/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/chunked_prefill_paged_decode/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/dcp_alltoall/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/flashmla/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/merge_attn_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/paged_attn/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/prefix_prefill/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/rocm_aiter_mla_sparse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_attention_helpers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_decode_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_merge_attn_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_prefill_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_reshape_and_cache_flash/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_turboquant_decode/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_turboquant_store/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/triton_unified_attention/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/vit_attn_wrappers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/ops/xpu_mla_sparse/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/attention/selector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/block_pool/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/encoder_cache_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/kv_cache_coordinator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/kv_cache_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/kv_cache_metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/kv_cache_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/async_scheduler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/output/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/request_queue/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/scheduler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/sched/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/core/single_type_kv_cache_manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/cudagraph_dispatcher/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/async_llm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/coordinator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/core/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/core_client/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/detokenizer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/exceptions/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/input_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/llm_engine/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/logprobs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/output_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/parallel_sampling/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/tensor_ipc/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/engine/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/abstract/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/multiproc_executor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/ray_env_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/ray_executor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/ray_executor_v2/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/ray_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/uniproc_executor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/executor/vllm_net_devices/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_cache_interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_cache_spec_registry/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/common/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/gpu_worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/policies/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/policies/arc/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/policies/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/policies/lru/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/shared_offload_region/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/spec/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/cpu/swap_blocks_triton/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/factory/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/file_mapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/example/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/example/manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/factory/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/fs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/fs/io/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/fs/manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/fs/thread_pool/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/tiering/spec/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/kv_offload/worker/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/loggers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/perf/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/prometheus/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/ray_wrappers/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/reader/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/stats/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/metrics/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/pool/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/pool/late_interaction/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/pool/metadata/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/request/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/logits_processor/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/logits_processor/builtin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/logits_processor/interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/logits_processor/state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/metadata/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ops/bad_words/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ops/logprobs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ops/penalties/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ops/topk_topp_sampler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/ops/topk_topp_triton/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/rejection_sampler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/sampler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/sample/thinking_budget_state/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/serial_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/simple_kv_offload/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/simple_kv_offload/copy_backend/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/simple_kv_offload/cuda_mem_ops/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/simple_kv_offload/manager/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/simple_kv_offload/metadata/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/simple_kv_offload/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/custom_class_proposer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/dflash/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/draft_model/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/extract_hidden_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/gemma4/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/llm_base_proposer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/medusa/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/metadata/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/ngram_proposer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/ngram_proposer_gpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/step3p5/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/suffix_decoding/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/spec_decode/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/backend_guidance/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/backend_lm_format_enforcer/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/backend_outlines/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/backend_types/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/backend_xgrammar/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/request/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/structured_output/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/block_table/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cp_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cpu/buffer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cpu/model_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cpu/shm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cpu_model_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/cpu_worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/dp_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/ec_connector_model_runner_mixin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/encoder_cudagraph/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/encoder_cudagraph_defs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/async_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/attn_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/block_table/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/buffer_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/cp_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/cudagraph_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/dp_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/eplb_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/input_batch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/kv_connector/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/lora_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/metrics/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/metrics/logits/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/mm/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/mm/encoder_cache/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/mm/encoder_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/mm/rope/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/model_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/model_states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/model_states/default/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/model_states/interface/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/model_states/mamba_hybrid/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/model_states/whisper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/pool/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/pool/late_interaction_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/pool/pooling_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/pp_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/bad_words/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/gumbel/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/logit_bias/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/logprob/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/min_p/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/output/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/penalties/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/prompt_logprob/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/sampler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/sample/states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/shutdown/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/eagle/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/eagle/cudagraph/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/eagle/eagle3_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/eagle/speculator/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/eagle/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/rejection_sampler/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/rejection_sampler_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/spec_decode/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/states/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/structured_outputs/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu/warmup/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu_input_batch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu_model_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu_ubatch_wrapper/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/gpu_worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/kv_connector_model_runner_mixin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/lora_model_runner_mixin/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/mamba_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/tpu_input_batch/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/ubatch_utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/ubatching/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/utils/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/worker_base/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/workspace/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/xpu_model_runner/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/v1/worker/xpu_worker/ 2026-06-03 https://docs.vllm.ai/en/latest/api/vllm/version/ 2026-06-03