Gaudi2 vs H100: Software Tuning Beats Nvidia
Startup Standard Kernel says it tuned Intel’s Gaudi2 to beat Nvidia’s H100 on long-context inference, with 60% higher decode throughput at a fraction of the rental price.
Startup Standard Kernel says it tuned Intel’s Gaudi2 to beat Nvidia’s H100 on long-context inference, with 60% higher decode throughput at a fraction of the rental price.