Today, Fujitsu announced the launch of an AI computing broker middleware technology designed to enhance GPU computational efficiency in AI processing and address the global GPU shortage.
The new technology integrates Fujitsu’s proprietary adaptive GPU allocator technology, which dynamically allocates GPUs for real-time high-efficiency processing with various AI processing optimization techniques.
By addressing the challenges of GPU shortages and power consumption driven by the increasing global demand for AI, Fujitsu aims to contribute to enhanced business productivity and creativity for its customers.
The newly developed AI computing broker middleware integrates adaptive GPU allocator technology with AI processing optimization technologies, automatically identifying and optimizing GPU resource allocation for AI processing in multiple programs.
Fujitsu will continue to provide its AI computing broker technology to end users, including AI service providers seeking to reduce GPU costs by enhancing computational efficiency and cloud service providers aiming to maximize GPU utilization.
Starting in May 2024, Fujitsu has also been conducting trials of this newly developed technology with AWL, Inc., Xtreme-D Inc., and Morgenrot Inc., demonstrating significant improvements in these companies’ operations.
Following successful pilot trials, TRADOM Inc. will begin utilizing solutions based on AI computing broker technology in October 2024.
Junichi Kayamoto, Chief Data Science Officer, TRADOM Inc. comments: “Our company delivers cutting-edge AI-powered solutions for managing foreign exchange risk. The trial of Fujitsu’s AI computing broker technology proved its ability to significantly streamline GPU resource allocation for AI model generation, enabling the development of substantially more accurate models in significantly less time through AI learning process multiplexing.”
“We are committed to leveraging this technology, in continued collaboration with Fujitsu, to proactively expand our solution offerings, driving both TRADOM’s growth and the advancement of the FinTech industry,” he added.
Naoki Shibata, Representative Director, CEO and CTO, Xtreme-D Inc., comments: We congratulate Fujitsu on the launch of the AI computing broker. Xtreme-D provides Raplase, a cloud-based service for AI and HPC clients. A critical challenge for our customers is optimizing price/performance through efficient utilization of costly on-premise and bare-metal cloud GPUs. We are confident that Fujitsu’s AI computing broker will significantly address this challenge, and we are actively collaborating with Fujitsu to integrate this solution into our customer offerings.”
The newly developed technology will be available to customers in Japan starting October 22, 2024, and to users globally.
Also Read: Fujitsu and MoBagel collaborate for advanced AI models