Files
developer-roadmap/roadmaps/inference-engineering/content/nvidia@Uq3mE-0WIASHfcBDEnbLj.md

334 B

NVIDIA

NVIDIA GPUs are the dominant hardware for inference due to their combination of Tensor Core compute, HBM bandwidth, NVLink interconnects, and the CUDA software ecosystem. The three most relevant architectures for current inference deployments are Hopper, Blackwell, and the Grace and Vera CPU platforms that pair with them.