Skip to main content

XPU - Intel® GPUs

还没翻译译自英文(docs.vllm.ai)本页 11 段都还没译

XPU - Intel® GPUs

Validated Hardware

Text-only Language Models

Note: Online FP8 = Online Quantization to FP8.

ModelArchitectureDtype
openai/gpt-oss-20bGPTForCausalLMMXFP4
openai/gpt-oss-120bGPTForCausalLMMXFP4
deepseek-ai/DeepSeek-R1-Distill-Llama-8BLlamaForCausalLMBF16/Online FP8
deepseek-ai/DeepSeek-R1-Distill-Qwen-14BQwenForCausalLMBF16/Online FP8
deepseek-ai/DeepSeek-R1-Distill-Qwen-32BQwenForCausalLMBF16/Online FP8
deepseek-ai/DeepSeek-R1-Distill-Llama-70BLlamaForCausalLMBF16/Online FP8
Qwen/Qwen2.5-72B-InstructQwen2ForCausalLMBF16/Online FP8
Qwen/Qwen3-14BQwen3ForCausalLMBF16/Online FP8
Qwen/Qwen3-32BQwen3ForCausalLMBF16/Online FP8
Qwen/Qwen3-30B-A3BQwen3ForCausalLMBF16/Online FP8
Qwen/Qwen3-30B-A3B-FP8Qwen3ForCausalLMFP8
Qwen/Qwen3-30B-A3B-GPTQ-Int4Qwen3ForCausalLMInt4
Qwen/Qwen3-coder-30B-A3B-InstructQwen3ForCausalLMBF16/Online FP8
Qwen/Qwen3-Next-80B-A3B-InstructQwen3NextForCausalLMBF16/Online FP8
Qwen/Qwen3-Next-80B-A3B-ThinkingQwen3NextForCausalLMBF16/Online FP8
Qwen/QwQ-32BQwenForCausalLMBF16/Online FP8
deepseek-ai/DeepSeek-V2-LiteDeepSeekForCausalLMBF16/Online FP8
deepseek-ai/DeepSeek-V4-FlashDeepseekV4ForCausalLMBF16/Online FP8
meta-llama/Llama-3.1-8B-InstructLlamaForCausalLMBF16/Online FP8
microsoft/Phi-3.5-mini-instructPhi3ForCausalLMBF16/Online FP8
THUDM/GLM-4-9B-chatGLMForCausalLMBF16/Online FP8
THUDM/CodeGeex4-All-9BCodeGeexForCausalLMBF16/Online FP8
chuhac/TeleChat2-35BLlamaForCausalLM (TeleChat2 based on Llama arch)BF16/Online FP8
01-ai/Yi1.5-34B-ChatYiForCausalLMBF16/Online FP8
deepseek-ai/DeepSeek-Coder-33B-baseDeepSeekCoderForCausalLMBF16/Online FP8
meta-llama/Llama-2-13b-chat-hfLlamaForCausalLMFP16/Online FP8
Qwen/Qwen1.5-14B-ChatQwenForCausalLMBF16/Online FP8
Qwen/Qwen1.5-32B-ChatQwenForCausalLMBF16/Online FP8
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamicLlamaForCausalLMFP8

Multimodal Language Models

ModelArchitectureDtype
OpenGVLab/InternVL3_5-8BInternVLForConditionalGenerationBF16/Online FP8
OpenGVLab/InternVL3_5-14BInternVLForConditionalGenerationBF16/Online FP8
OpenGVLab/InternVL3_5-30B-A3BInternVLForConditionalGenerationBF16/Online FP8
OpenGVLab/InternVL3_5-38BInternVLForConditionalGenerationBF16/Online FP8
meta-models/Muse-Glimmer-30BMuseGlimmerForConditionalGenerationBF16/Online FP8
Qwen/Qwen2-VL-7B-InstructQwen2VLForConditionalGenerationBF16/Online FP8
Qwen/Qwen2.5-VL-72B-InstructQwen2VLForConditionalGenerationBF16/Online FP8
Qwen/Qwen2.5-VL-32B-InstructQwen2VLForConditionalGenerationBF16/Online FP8
Qwen/Qwen3-VL-32B-InstructQwen3VLForConditionalGenerationBF16/Online FP8
Qwen/Qwen3.5-35B-A3BQwen3_5MoeForConditionalGenerationBF16/Online FP8
google/gemma-3-27b-itGemma3ForConditionalGenerationBF16/Online FP8
google/gemma-4-31B-itGemma4ForConditionalGenerationBF16/Online FP8
google/gemma-4-26B-A4B-itGemma4ForConditionalGenerationBF16/Online FP8
THUDM/GLM-4v-9BGLM4vForConditionalGenerationBF16/Online FP8
openbmb/MiniCPM-V-4MiniCPMVForConditionalGenerationBF16/Online FP8

Embedding and Reranker Language Models

ModelArchitectureDtype
Qwen/Qwen3-Embedding-8BQwen3ForTextEmbeddingBF16/Online FP8
Qwen/Qwen3-Reranker-8BQwen3ForSequenceClassificationBF16/Online FP8