Memory and storage: Unleashing the AI revolution

11:35 - 11:55

Abstract

Artificial Intelligence (AI) is rapidly gaining traction and widespread adoption across various industries, revolutionizing the way we approach complex problems. As AI applications become more sophisticated, the role of memory and storage in high-performance computing (HPC) becomes increasingly crucial. This talk will explore the pivotal role of memory technologies (DRAM, NAND, advanced packaging) and memory products (HBM, SSD) will have in accelerating AI applications.  From the datacenter to the intelligent edge, memory plays a key enabling role in unlocking the potential of AI.

AI workloads demand efficient data handling necessitating reimagining and greater optimization of the memory hierarchy to speed adoption and enhance the user experience. DRAM provides the necessary speed for real-time processing, while NAND offers high-capacity, power-efficient storage solutions. High Bandwidth Memory (HBM) bridges the gap between processing speed and data transfer rates, ensuring seamless performance. Solid State Drives (SSDs) provide a performant storage tier while maintaining low cost per bit to drive high capacity at low total cost of ownership. These memory products collectively enable the deployment of large language models (LLMs) at scale.

To fully unlock AI's potential, further innovation in memory performance, bandwidth, and power efficiency is essential. This talk will delve into the latest advancements in memory technologies and their integration into HPC systems. By optimizing advanced memory solutions, we can achieve the high performance required for AI applications, paving the way for groundbreaking developments in the field. Join us to discover how the seamless integration of memory technologies and products will revolutionize AI and drive the next wave of technological innovation.