Skip to main content

Using vLLM

还没翻译译自英文(docs.vllm.ai)本页 4 段都还没译

Using vLLM

First, vLLM must be installed for your chosen device in either a Python or Docker environment.

Then, vLLM supports the following usage patterns: