A major AI breakthrough has been made by the maker of the largest chip in history
Cerebras Systems has broken the record of most complex AI models trained on a single device.
Cerebras can now train AI models that have up to 20 billion parameters using one CS-2 system powered by its wafer-sized processor (WSE-2). This is possible thanks to software optimizations.
The company claims that the breakthrough will solve one of the most frustrating AI engineer problems: the need for large-scale models to be partitioned across thousands of GPUs. This will allow for a drastic reduction in the time required to train and develop new models.
Source:
https://www.msn.com/en-us/news/technology/the-maker-of-the-world-s-largest-chip-has-made-a-major-ai-breakthrough/ar-AAYMJg3?rc=1&ocid=winp1taskbar&cvid=b1cf10a1c15846c2baaa2b93f5c8a37b
Leave a Reply