SK hynix unveiled and demonstrated AiMX1, a prototype generative AI accelerator2 card based on GDDR6-AiM, at the AI Hardware & Edge AI Summit 2023 held September 12–14 at the Santa Clara Marriott, California.
This summit, hosted by Kisaco Research, is an annual gathering where global IT companies and prominent startups come together to share their advancements in artificial intelligence (AI) and machine learning. It marked SK hynix's third participation in the event.
During the summit, SK hynix unveiled a groundbreaking prototype called AiMX1, which is an AI accelerator card based on GDDR6-AiM technology. The AiMX1 card aims to boost AI performance and is designed to cater to data-intensive generative AI systems.
One of the key features of AiMX1 is its ability to combine multiple GDDR6-AiM chips, further enhancing its performance capabilities. SK hynix presented the GDDR6-AiM technology itself at the summit, emphasizing the theme of "Boost Your AI: Discover the Power of PIM3 with SK hynix’s AiM4."
The significance of AiMX1 lies in its potential to serve as a low-power, high-speed memory solution capable of efficiently handling vast amounts of data. In the world of generative AI, the performance of AI models improves as they are trained on larger datasets. Therefore, there is a growing demand for high-performance products like AiMX1 that can be applied across a wide range of generative AI systems.
During the event, SK hynix demonstrated the AiMX prototype by running Meta's generative AI Open Pretrained Transformer (OPT) 13B model on a server system equipped with AiMX. The results were impressive, as the AiMX system, featuring GDDR6-AiM chips, significantly reduced data processing time compared to systems with GPUs while consuming only one-fifth of the power.
This demonstration caught the attention of global companies offering AI services by showcasing AiMX's superior performance compared to the latest accelerators in the market.
Additionally, the company conducted a session highlighting the benefits of AiMX. In a presentation titled "Cost-Effective Generative AI Inference Acceleration using AiM," Eui-cheol Lim, the vice president of the Solution Development division, compared the performance of GPUs with that of AiMX. The presentation also delved into the future prospects of next-generation intelligent semiconductor memories.
“SK hynix’s AiMX is a solution that delivers higher performance while consuming less power, and costing less than conventional GPUs,” Lim explained. “We will continue to develop memory technologies that will lead the way in the era of artificial intelligence.”
