Skip to content

vllm.model_executor.models.transformers

Wrapper around transformers models

Modules:

Name Description
base

Transformers modeling backend base class.
causal

Transformers modeling backend mixin for causal language models.
legacy

Transformers modeling backend mixin for legacy models.
moe

Transformers modeling backend mixin for Mixture of Experts (MoE) models.
multimodal

Transformers modeling backend mixin for multi-modal models.
pooling

Transformers modeling backend mixins for pooling models.
utils

Transformers modeling backend utilities.

__getattr__ 

__getattr__(name: str)

Handle imports of non-existent classes with a helpful error message.

Source code in vllm/model_executor/models/transformers/__init__.py 
119
120
121
122
123
124
125
126
127
def __getattr__(name: str):
    """Handle imports of non-existent classes with a helpful error message."""
    if name not in globals():
        raise AttributeError(
            "The Transformers modeling backend does not currently have a class to "
            f"handle the requested model type: {name}. Please open an issue at "
            "https://github.com/vllm-project/vllm/issues/new"
        )
    return globals()[name]