本页还没有译文
本页 4 段还没译成日本語,下面显示的是英文原文。Using vLLM
还没翻译译自英文(docs.vllm.ai)本页 4 段都还没译
Using vLLM
First, vLLM must be installed for your chosen device in either a Python or Docker environment.
Then, vLLM supports the following usage patterns:
- Inference and Serving: Run a single instance of a model.
- Deployment: Scale up model instances for production.
- Training: Train or fine-tune a model.
AI 翻译查看英文原文