Tensorize vLLM Model
In this reference
An example of serializing and loading vLLM models with Tensorizer.
Cite the original work
Tensorize vLLM Model [Documentation]. vLLM. https://docs.vllm.ai/en/stable/examples/features/tensorize_vllm_model/
View BibTeX
@misc{tensorize_vllm_model,
title = {{Tensorize vLLM Model}},
howpublished = {vLLM},
url = {https://docs.vllm.ai/en/stable/examples/features/tensorize_vllm_model/}
}
