Tensorize vLLM Model
An example of serializing and loading vLLM models with Tensorizer.
vLLMPublic source
Read the documentation
In this reference
An example of serializing and loading vLLM models with Tensorizer.
Cite the original work
Tensorize vLLM Model [Documentation]. vLLM. https://docs.vllm.ai/en/stable/examples/features/tensorize_vllm_model/
View BibTeX
@misc{tensorize_vllm_model,
title = {{Tensorize vLLM Model}},
howpublished = {vLLM},
url = {https://docs.vllm.ai/en/stable/examples/features/tensorize_vllm_model/}
}
