Palantir Technologies announced a sovereign AI OS reference architecture developed in collaboration with NVIDIA, providing customers with a turnkey solution for AI datacenters from hardware procurement to application deployment.
The Palantir AI OS Reference Architecture (AIOS-RA) aims to deliver a complete, production-ready AI infrastructure. It is based on NVIDIA Enterprise Reference Architectures, which have been tested and qualified to run Palantir’s entire software suite, including AIP, Foundry, Apollo, Rubix, and AIP Hub.
This architecture integrates several key components: NVIDIA AI Infrastructure, running on NVIDIA Blackwell Ultra systems with eight NVIDIA Blackwell Ultra GPUs and NVIDIA Spectrum-X Ethernet networking for AI training and inference; Palantir Compute Infrastructure, a hardened Kubernetes substrate supporting Foundry services; a Unified Management Plane, featuring Rubix for zero-trust Kubernetes and Apollo for autonomous deployment and lifecycle management; the AIP Platform, an enterprise AI platform designed to connect large language models to organizational data and operational systems; and Full-Stack NVIDIA Software Acceleration, encompassing NVIDIA AI Enterprise, NVIDIA CUDA-X Libraries, NVIDIA Nemotron open models, and NVIDIA Magnum IO.
The Palantir AI OS reference architecture is designed for customers with existing GPU infrastructure, latency-sensitive workflows, data sovereignty requirements, and high geographic distribution. The Sovereign AI architecture intends to offer enterprises total control over their data, AI models, and applications. This solution is built to leverage the latest GPU-accelerated open-source AI models and data acceleration libraries, operating on NVIDIA infrastructure for performance.
Akshay Krishnaswamy, Palantir’s Chief Architect, stated, “From our first deployment with the United States government and in every deployment since, our software has had to meet the moment in the most complex and sensitive environments where customers must maintain control. Together with NVIDIA — and building on many customers’ existing investments — we are proud to deliver a fully integrated AI operating system that is optimized for NVIDIA accelerated compute infrastructure and enables customers to realize the promise of on-premise, edge, and sovereign cloud deployments.”Justin Boitano, vice president, Enterprise AI Platforms, NVIDIA, commented, “AI is redefining the infrastructure stack — demanding, latency-sensitive and data-sovereign environments require a full-stack architecture — built from silicon to systems to software. By combining Palantir’s sovereign AI OS reference architecture with NVIDIA AI infrastructure, industries and nations can turn data into intelligence with speed, efficiency, and trust.”Further details and the full reference architecture are available on the Palantir website.
