Modal adopts Nvidia Vera CPU, claiming double task throughput for AI sandboxes
Modal announced it will start using Nvidia's new Vera central processor to host its AI agents, moving away from Intel and AMD chips. In internal tests, Vera handled up to twice as many tasks as an Intel server when running Modal's Sandboxes product, though results are unverified. The switch marks Modal's first use of an Arm-based CPU for its AI workloads.
Why it matters: The performance boost could reduce compute costs and latency for developers building AI agents.
Read the coverage
More in Startups
Startups14h ago2 sources