Skip to content

vllm.transformers_utils.configs

Model configs may be defined in this directory for the following reasons:

  • There is no configuration file defined by HF Hub or Transformers library.
  • There is a need to override the existing config to support vLLM.
  • The HF model_type isn't recognized by the Transformers library but can be mapped to an existing Transformers config, such as deepseek-ai/DeepSeek-V3.2-Exp.

Modules:

Name Description
arctic

Arctic model configuration

bagel
falcon

Falcon configuration

hunyuan_vl
isaac
jais

JAIS configuration

kimi_k25

Kimi-K2.5 Model Configuration.

lfm2_moe
mlp_speculator
nemotron

Nemotron model configuration

nemotron_h

NemotronH model configuration

ovis
qwen3_asr
qwen3_next

Qwen3-Next model configuration

radio

Radio vision model configuration

speculators
tarsier2
ultravox