AMD unveils Helion as agentic AI fuels demand for data center CPUs
AMD has introduced Helion, an open blueprint for data center racks that aims to give CPUs a larger role in running AI agents while allowing customers to configure GPU resources around their inference requirements.
AMD has introduced Helion, an open blueprint for data center racks that aims to give CPUs a larger role in running AI agents while allowing customers to configure GPU resources around their inference requirements.
The short version
- Based on Open Compute Project (OCP) specifications, the architecture supports different combinations of computing hardware.
- AMD cited examples including CPU-only racks for hyperscalers, powered by sixth-generation EPYC processors with up to 32,768 cores, and all-in-one enterprise racks accommodating up to 16 Instinct MI350P GPUs.
- AMD has listed networking bandwidth of up to 102 Tbps for Helion, although the company has not specified how that figure is calculated.
What happened
The specification represents a planned rack capability rather than demonstrated performance in customer environments. An integrated token router is intended to direct AI agents’ requests to different models, allowing enterprises to use cloud-hosted frontier models alongside open-source models running within the rack.
Why it matters
AMD said the design supports both air and liquid cooling.
Summary by Nerd News Network. Read the full article at Network World via the links above and below.