vllm.transformers_utils.configs ¶
Model configs may be defined in this directory for the following reasons:
- There is no configuration file defined by HF Hub or Transformers library.
- There is a need to override the existing config to support vLLM.
- The HF model_type isn't recognized by the Transformers library but can be mapped to an existing Transformers config, such as deepseek-ai/DeepSeek-V3.2-Exp.
Modules:
| Name | Description |
|---|---|
arctic | Arctic model configuration |
bagel | |
falcon | Falcon configuration |
hunyuan_vl | |
isaac | |
jais | JAIS configuration |
kimi_k25 | Kimi-K2.5 Model Configuration. |
lfm2_moe | |
mlp_speculator | |
nemotron | Nemotron model configuration |
nemotron_h | NemotronH model configuration |
ovis | |
qwen3_asr | |
qwen3_next | Qwen3-Next model configuration |
radio | Radio vision model configuration |
speculators | |
tarsier2 | |
ultravox | |