The investment of Microsoft in small hardware startup d-Matrix is a gesture of a shift in the AI industry. d-Matrix has lately launched a processor called Corsair and it is claimed to challenge GPU-based systems. It is offering a more affordable and efficient approach to AI inference by avoiding use of expensive high-bandwidth memory as well as GPUs. The innovation opens door for a broader adoption of advanced AI models and mostly in the commercial applications.
The performance of Corsair is remarkable and it processes tokens at impressive speeds. It can even process resource-heavy generative AI models like Llama3. The capabilities of Corsair could redefine the way businesses approach AI. It uses digital in-memory computation and advanced chiplet packaging.
Micron Technology is a key Nvidia partner and the collaboration with d-Matrix is noteworthy as it reflects growing industry recognition of the need for alternatives to traditional GPU-driven architectures. Nvidia is a leader in the AI hardware space and startups like d-Matrix are demonstrating that there is room for competition.
The launch of Corsair comes at an important time when the demand for generative AI is rising. d-Matrix appears to have seized the opportunity by redesigning its architecture to support transformer models and emerging applications.
d-Matrix CEO and co-founder Sid Sheth said that Corsair is the largest computing opportunity today. He is correct as the current market is based on speed, efficiency and scalability. d-Matrix is said to influence the way AI is deployed in the future as it also has a backing of Microsoft. The success of Corsair is also to inspire other startups to challenge the same. However, it is to watch whether the bold approach can truly reshape the AI hardware segment.
