OpenAI and chip makers develop protocol to speed up AI supercomputers
OpenAI releases MRC, an open-source network protocol developed with AMD, Broadcom, Intel, Microsoft, and Nvidia that connects over 100,000 GPUs via two switch layers to reduce power use and costs in AI supercomputers.
OpenAI has teamed up with AMD, Broadcom, Intel, Microsoft, and NVIDIA to develop MRC, an open source network protocol that sends data across hundreds of paths simultaneously between GPUs. Instead of three or four switch layers, MRC needs only two to connect over 100,000 GPUs, cutting both power and costs.
The protocol is already running on OpenAI's Stargate supercomputer. The article OpenAI built a networking protocol with AMD, Broadcom, Intel, Microsoft, and NVIDIA to fix AI supercomputer bottlenecks appeared first on The Decoder.