Intel has launched its Gaudi 3 AI accelerator, aiming to compete with NVIDIA’s dominant H100 and H200 GPUs by offering a cheaper alternative with a lower total cost of ownership (TCO). While Gaudi 3 falls behind in raw performance, it boasts features optimized for large-scale generative AI and promises seamless integration with popular frameworks like PyTorch and Hugging Face.
NVIDIA’s Hopper H100 and H200 AI GPUs are getting even more powerful with new optimizations in the CUDA stack. The H200, featuring 80% more HBM memory and 40% higher bandwidth than the H100, delivers significant performance gains across a range of benchmarks, including Llama 2 and Mixtral 8x7B. These advancements highlight NVIDIA’s commitment to pushing the boundaries of AI computing.
