vllm.distributed.device_communicators.cuda_wrapper ¶
This file is a pure Python wrapper for the cudart library. It avoids the need to compile a separate shared library, and is convenient for use when we just need to call a few functions.