Thursday, April 18, 2024

Cerebras and G42 unveil the world’s largest supercomputer for AI training

Cerebras Systems and United Arab Emirates-based technology group G42 have jointly announced the introduction of Condor Galaxy, a network of nine interconnected supercomputers. This network offers a new approach to AI computing that promises to significantly reduce AI model training time.

The first supercomputer in this network, called Condor Galaxy 1 (CG-1), has 54 million cores and a processing capacity of four exaFLOPs.

Cerebras and G42 are planning to deploy two more such supercomputers, CG-2 and CG-3, in the U.S. in early 2024. With a planned capacity of 36 exaFLOPs in total, this unprecedented supercomputing network is expected to drive groundbreaking advancements in AI on a global scale.

Located in Santa Clara, California, CG-1 links 64 Cerebras CS-2 systems together into a single, easy-to-use AI supercomputer with an AI training capacity of 4 exaFLOPs. The two companies offer CG-1 as a cloud service, simplifying access to high-performance AI computing for customers without the need to manage or distribute models over physical systems.

CG-1 enables G42 and its cloud customers to train large, groundbreaking models quickly and easily, accelerating innovation.

Rendering of the complete Condor Galaxy 1 AI Supercomputer.
Rendering of the complete Condor Galaxy 1 AI Supercomputer. Credit: Rebecca Lewington/ Cerebras Systems

“Delivering 4 exaFLOPs of AI compute at FP 16, CG-1 dramatically reduces AI training timelines while eliminating the pain of distributed compute,” said Andrew Feldman, CEO of Cerebras Systems. “Many cloud companies have announced massive GPU clusters that cost billions of dollars to build, but that are extremely difficult to use.

“Distributing a single model over thousands of tiny GPUs takes months of time from dozens of people with rare expertise. CG-1 eliminates this challenge. Setting up a generative AI model takes minutes, not months, and can be done by a single person. CG-1 is the first of three 4 exaFLOP AI supercomputers to be deployed across the U.S. Over the next year, together with G42, we plan to expand this deployment and stand up a staggering 36 exaFLOPs of efficient, purpose-built AI compute.”

With the Condor Galaxy supercomputing network, the two companies are democratizing AI, enabling simple and easy access to the industry’s leading AI computing. G42’s work with diverse datasets across healthcare, energy, and climate studies will enable users of the systems to train new cutting-edge foundational models.

CG-1 is the first of three 4 exaFLOP AI supercomputers (CG-1, CG-2, and CG-3), built and located in the U.S. These three AI supercomputers will be interconnected in a 12 exaFLOP, 162 million core distributed AI supercomputer consisting of 192 Cerebras CS-2s and fed by more than 218,000 high-performance AMD EPYC CPU cores.

G42 and Cerebras plan to bring online six additional Condor Galaxy supercomputers in 2024, bringing the total compute power to 36 exaFLOPs.