RDMA over USB4 on Windows Links PCs for Local AI
Microsoft is previewing RDMA over USB4 on Windows so several PCs can split one AI model across their memory and GPUs using ordinary USB4 cables.
Microsoft is previewing RDMA over USB4 on Windows so several PCs can split one AI model across their memory and GPUs using ordinary USB4 cables.
Pete Warden of Useful Sensors argues local AI models already run well on laptops. The real gaps are marketing and usability, not quality.
Open models of 32B parameters or fewer now score above GPT-4.5 on a combined benchmark index, and they run offline on a laptop with 16 to 32 GB of memory.