In a significant move, Arm and Nvidia have teamed up to make AI infrastructure more flexible. Arm announced that its Neoverse CPUs can now work seamlessly with Nvidia's GPUs using NVLink Fusion technology. This is big news for companies that build their own tech, like big cloud providers.

Nvidia is really pushing to be the go-to partner for AI. They're not just teaming up with Arm but also with Intel and AMD. This shows Nvidia wants to be in the middle of everything AI. They're even selling their own AI product called Grace Blackwell, which pairs Nvidia GPUs with an Arm-based CPU.

But why is this important? Well, big tech companies like Microsoft, Amazon, and Google are using Arm-based CPUs in their clouds. They want more control and lower costs. Arm doesn't make the CPUs itself but licenses the tech to others. This lets companies build their own chips quickly.

The new deal means custom Neoverse chips will have a new protocol. This allows them to share data easily with GPUs. In AI servers, up to eight GPUs can work with one CPU. So, this is a big deal for making AI faster and more efficient.

Nvidia has been busy with other deals too. They invested $5 billion in Intel to help their CPUs work better in AI servers. And remember when Nvidia tried to buy Arm for $40 billion? That didn't work out due to regulatory issues. But now, they're still finding ways to work together.

Softbank, which owns most of Arm, sold all its Nvidia shares recently. They're now backing the OpenAI Stargate project. This project will use Arm, Nvidia, and AMD chips. It's clear that everyone is trying to find the best mix of tech for AI.

CUSTOM CHIPS

Arm and Nvidia Join Forces to Power Up AI

Continue reading...