Anime, manga, and games, with a take · A Yukimedia publication

Microsoft Announces RDMA over USB4 for Windows AI Clusters

Microsoft announced RDMA over USB4, a Windows feature that links PCs through USB4 cables so they share memory and GPU compute for large local AI models. Two PCs need one USB4 port each; three need two each.

Reporting from 1 source: GIGAZINE.

Why it matters

The feature lets Windows users build a local AI cluster from machines they already own, with no network adapter, at a latency Microsoft measures well below its own Ethernet over USB4 link.

Microsoft Announces RDMA over USB4 for Windows AI Clusters

Key Facts

  • Microsoft announced RDMA over USB4, which links Windows PCs through USB4 cables to share memory and GPU compute for local AI models.
  • Two PCs need one USB4 port each, and three PCs need two ports each.
  • Exchanging 16KiB of data took 50 microseconds over RDMA over USB4 versus 194 microseconds over Ethernet over USB4.
  • Three AMD Ryzen AI Max PCs with Radeon 8060S and 128GB of memory ran a 4-bit Qwen3-235B-A22B at 21.98 tokens/sec decode.
  • A preview is planned for the Windows Insider Experimental channel, and the provider and sample code are on GitHub.

In a test, three AMD Ryzen AI Max machines with Radeon 8060S and 128GB of memory ran a 4-bit Qwen3-235B-A22B at 21.98 tokens/sec decode. A preview is planned for the Windows Insider Experimental channel.

Microsoft measured the gap against its existing USB4 networking option: exchanging 16KiB of data took 50 microseconds over RDMA over USB4 versus 194 microseconds over Ethernet over USB4. The company says 40Gbps USB4 ports work, while 80Gbps ports help with long contexts. Testing covered PCs with AMD Ryzen AI Max series and Intel Core Ultra Series 3 processors, and Microsoft says other processors may also work. The RDMA over USB4 provider and sample code are published on GitHub, and the preview is planned for the Windows Insider Experimental channel.

Written with AI by Yomimono from the 1 cited source below, including Japanese-language reporting where cited. See our editorial policy.

Add Yomimono as a preferred source on Google

Sources