Skip to main content
Back to Glossary
ai-infrastructure

AI Factory

A large-scale GPU cluster purpose-built for AI model training and inference, requiring specialised high-density power, liquid cooling, and high-speed network fabric infrastructure.

Full Definition

The term "AI factory" — popularised by NVIDIA CEO Jensen Huang — describes a new class of computing infrastructure where AI model development and inference are treated as an industrial-scale production process. Unlike traditional datacentres optimised for general-purpose computing, AI factories are designed around GPU cluster requirements: very high power density (typically 100–400 kW per rack), liquid cooling, InfiniBand or high-speed Ethernet fabric, and storage optimised for multi-terabyte training datasets.

AI factories are built by hyperscalers (Meta, Google, Microsoft, Amazon), cloud GPU providers (CoreWeave, Lambda Labs), and sovereign AI programmes. Capital expenditure for a 10,000-GPU AI factory can exceed $1 billion when including facility, power, and networking. PODTECH advises on the infrastructure due diligence, DCIM integration, and BMS design for AI factory projects.

Also Known As

AI supercomputerGPU clusterAI datacenter

Source Reference

NVIDIA Jensen Huang GTC 2024 Keynote; McKinsey & Company 'AI infrastructure buildout' (2024)

Related Terms