Oracle has extended its collaboration with NVIDIA to include running strategic NVIDIA AI applications on the new Oracle Cloud Infrastructure (OCI) Supercluster. NVIDIA has selected OCI as the first hyperscale cloud provider to offer NVIDIA DGX Cloud, an AI supercomputing service, at massive scale. In addition, NVIDIA is running NVIDIA AI Foundations, its new generative AI cloud services, which are available through DGX Cloud, on OCI.
“OCI is the first platform to offer an AI supercomputer at scale to thousands of customers across every industry. This is a critical capability as more and more organizations require computing resources for their unique AI use cases. To support this demand, we continue to expand our work with NVIDIA,” said Clay Magouyrk, executive vice president, Oracle Cloud Infrastructure.
“The limitless opportunities for AI-driven innovation are helping transform virtually every business. NVIDIA’s collaboration with Oracle Cloud Infrastructure puts the extraordinary supercomputing performance of NVIDIA’s accelerated computing platform within reach of every enterprise,” said Manuvir Das, vice president of enterprise computing, NVIDIA.
OCI’s New Supercluster
NVIDIA DGX Cloud and the NVIDIA AI Foundations services that run on it leverage OCI’s unique Supercluster which was certified by NVIDIA to ensure it meets the high standards of DGX Cloud.
OCI’s Supercluster includes OCI Compute Bare Metal, an ultra-low latency RoCE cluster based on NVIDIA networking, and a choice of HPC storage. It has been deployed and validated by NVIDIA to support thousands of OCI Compute Bare Metal instances that can efficiently process massively parallel applications. OCI Supercluster networking can now scale up to 4,096 OCI Compute Bare Metal instances with 32,768 A100 GPUs. OCI Compute Bare Metal instances with NVIDIA H100 GPUs are now in limited availability.
Additionally, NVIDIA announced that Oracle is adding NVIDIA BlueField-3 DPUs to its networking stack.
Generative AI Services for Building Custom Enterprise Models
NVIDIA AI Foundations model-making services span language, images, video and 3D, as well as biology. Enterprises can use the NVIDIA NeMo language service and the NVIDIA Picasso image, video and 3D services to build proprietary, domain-specific, generative AI applications for intelligent chat and customer support, professional content creation, digital simulation and more. For biology AI model training and inference, the NVIDIA BioNeMo cloud service offers tools to quickly customize and deploy generative AI applications.
On OCI, custom models built with NVIDIA AI Foundations and model families like GPT-3 benefit from the OCI Supercluster, which includes purpose-built RDMA networking that delivers near line rate performance with microsecond latency and eliminates blocking issues for RDMA-dependent workloads.