IBM announced a multi-year, $240 million agreement with Together AI, an AI cloud company that provides infrastructure and software for model inference, training, fine-tuning and agentic workflows. Under the agreement, IBM plans to deploy a large cluster of NVIDIA HGX B300 systems on IBM Cloud, with availability expected in the first quarter of 2027. Together AI will use the cluster to provide inference for open-source AI models.
The deployment will be the first dedicated large-scale inference cluster on IBM Cloud using NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking. According to NVIDIA, the systems are designed to provide 30 times the AI factory output of previous generations.
Together AI recently raised $800 million in a Series C financing round at an $8.3 billion valuation. The company says its inference platform now processes 400 trillion tokens per month. Its platform covers inference, training, fine-tuning and agentic workflows.
The agreement is intended to expand Together AI's capacity to serve enterprise customers using open-source models. Together AI said it selected IBM and NVIDIA based on their product roadmaps and ability to provide GPU capacity for its planned expansion.
"Enterprises want the performance of the best frontier models without the closed-model price tag, and that only works if the infrastructure underneath is fast and reliable at scale," said Vipul Ved Prakash, CEO at Together AI. "Working alongside IBM with NVIDIA gives us that foundation. This cluster lets us bring production-grade inference to more companies, faster, and it's a big step in our push to make open-source AI the obvious choice for enterprises."
The agreement also extends the existing collaboration between IBM and NVIDIA across AI infrastructure and software. IBM Cloud will combine NVIDIA GPUs and NVIDIA Spectrum-X Ethernet networking with Together AI's inference platform.
"Enterprises are in a race to adopt agentic AI at scale to drive real business outcomes," said Alan Peacock, General Manager of IBM Cloud. "IBM and NVIDIA are delivering scalable, economical, enterprise-grade AI infrastructure that can help Together AI accelerate innovation for the next generation of AI infrastructure."
"AI factories are becoming essential enterprise infrastructure—like electricity and telecommunications—turning compute and data into intelligence," said Dion Harris, Senior Director, HPC and AI Infrastructure Solutions, NVIDIA. "With NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking on IBM Cloud, IBM and Together AI will deliver an accelerated computing platform to help enterprises deploy open-source AI with the performance, efficiency and scale required for real-time AI services."
IBM and NVIDIA have also announced work involving GPU-native data analytics, unstructured data extraction, on-premises and cloud infrastructure, and consulting services.
