Colossus AI Supercluster with over 100,000 @NVIDIA H100 GPUs

Source: https://nvidianews.nvidia.com/news/spectrum-x-ethernet-networking-xai-colossus

Inside the @xai Colossus AI Supercluster with over 100,000 @NVIDIA H100 GPUs. If you want to see why the @Supermicro_SMCI liquid-cooled cluster is awesome, then check this one out.

https://youtu.be/Jf8EPSBZU7Y?si=bXBgCpeTLjkctpUe

O čem to video je?

100 000 GPU v datacentru

2 CPU and 8 GPU in 4U server chassis

8x server per rack

Takže 64 GPU per rack

1 563 racků v datacentru

Chlazení kapalinou. Liquid cooling.