IBM and AMD collaborated to deploy AMD Instinct MI300X accelerators as a service on IBM Cloud, aiming to enhance performance and power efficiency for Gen AI models such as high-performance computing (HPC) applications for enterprise clients.
This collaboration will also enable support for AMD Instinct MI300X accelerators within IBM’s watsonx AI and data platform, as well as Red Hat Enterprise Linux AI inferencing support.
“As enterprises continue adopting larger AI models and datasets, it is critical that the accelerators within the system can process compute-intensive workloads with high performance and flexibility to scale,” said Philip Guido, executive vice president and chief commercial officer of AMD.
“AMD Instinct accelerators combined with AMD ROCm software offer wide support including IBM watsonx AI, Red Hat Enterprise Linux AI, and Red Hat OpenShift AI platforms to build leading frameworks using these powerful open ecosystem tools. Our collaboration with IBM Cloud will aim to allow customers to execute and scale Gen AI inferencing without hindering cost, performance, or efficiency,” he added.
IBM and AMD help enterprise clients across industries that are heavily regulated and also support enterprise clients leveraging AI. They are intended to leverage IBM Cloud’s security and compliance capabilities.
“AMD and IBM Cloud share the same vision around bringing AI to enterprises. We’re committed to bringing the power of AI to enterprise clients, helping them prioritize their outcomes, and ensuring they have the power of choice when it comes to their AI deployments,” said Alan Peacock, General Manager of IBM Cloud. “Leveraging AMD’s accelerators on IBM Cloud will give our enterprise clients another option to scale to meet their enterprise AI needs, while also aiming to help them optimize cost and performance.”
For generative AI inferencing workloads, IBM plans to enable support for AMD Instinct MI300X accelerators within IBM’s watsonx AI and data platform, providing watsonx clients with additional AI infrastructure resources for scaling their AI workloads across hybrid cloud environments.
Additionally, Red Hat Enterprise Linux AI and Red Hat OpenShift AI platforms can run Granite family large language models (LLMs) with alignment tooling using InstructLab on MI300X accelerators.
IBM Cloud with AMD Instinct MI300X accelerators are expected to be generally available in the first half of 2025.
Also Read: IBM Announced Its Advanced AI Model, Granite 3.0 for Business
