Cerebras reimagines AI cluster design with switchless CS-4 architecture
Cerebras Systems has unveiled the CS-4, a new rack-scale AI system that can connect its wafer-scale processors across racks without network switches, an approach designed to reduce communication latency as AI infrastructure grows more complex.
Cerebras Systems has unveiled the CS-4, a new rack-scale AI system that can connect its wafer-scale processors across racks without network switches, an approach designed to reduce communication latency as AI infrastructure grows more complex.
The short version
- Cerebras, which competes with Nvidia and other AI accelerator suppliers, said the CS-4 can run up to twice as fast as its previous-generation CS-3.
- In a test using the GPT-OSS-120B model, the company said it also delivered up to 30 times the per-user inference speed of GPU-based systems.
- Cerebras said actual throughput can vary depending on the model and serving configuration.
What happened
The CS-4 is the first system based on Cerebras’ new Nexus rack-scale architecture and includes Direct Wafer Links, which the company said can reduce wafer-to-wafer latency to as little as two microseconds. The system also supports RoCE v2 over Ethernet, allowing it to connect with existing data-center networks.
Why it matters
Cerebras said each CS-4 provides up to 7.2 Tbps of system I/O bandwidth.
Summary by Nerd News Network. Read the full article at Network World via the links above and below.