本页还没有译文
本页 6 段还没译成简体中文,下面显示的是英文原文。Engine Arguments
还没翻译译自英文(docs.vllm.ai)本页 6 段都还没译
Engine Arguments
Engine arguments control the behavior of the vLLM engine.
- For offline inference, they are part of the arguments to LLM class.
- For online serving, they are part of the arguments to
vllm serve.
The engine argument classes, EngineArgs and AsyncEngineArgs, are a combination of the configuration classes defined in vllm.config. Therefore, if you are interested in developer documentation, we recommend looking at these configuration classes as they are the source of truth for types, defaults and docstrings.
Generated content
This part of the page is generated when upstream builds its site: see it on the original page.
AI 翻译查看英文原文