AI Inference Server
Data center-grade servers for large-scale AI inference.
概览
The AI Inference Server is a high-density, GPU-optimized server platform designed for large-scale AI inference and model serving in data center environments. Supporting up to 8 double-width GPU accelerators and 4TB of system memory, it delivers unmatched throughput for LLM inference and enterprise AI workloads.
处理器
Dual Intel Xeon 6 / AMD EPYC, up to 288 cores
内存
32x DDR5 DIMM slots, up to 4TB ECC
存储
12x NVMe U.2 hot-swap bays, 2x M.2 boot drives
GPU / AI加速器
Up to 8x GPU Accelerators (supports multiple vendors)