OpenAI-Compatible Server

In this reference
Documentation for serving language models through an OpenAI-compatible API with vLLM.
Cite the original work
OpenAI-Compatible Server [Documentation]. vLLM. https://docs.vllm.ai/en/stable/serving/online_serving/openai_compatible_server/
View BibTeX
@misc{openai_compatible_server,
title = {{OpenAI-Compatible Server}},
howpublished = {vLLM},
url = {https://docs.vllm.ai/en/stable/serving/online_serving/openai_compatible_server/}
}
