The spiraling-up need for applications of all kinds that use artificial intelligence or machine learning is sending alarms to foundational IT product suppliers.
Samsung, the world’s largest producer of advanced memory silicon hardware, on July 17 announced that it is increasing production volume of its 8GB High Bandwidth Memory-2 DRAM (dynamic memory) to meet this fast-growing market need.
The high-end solid-state memory is used for a range of applications that include not only artificial intelligence but high-performance computing, advanced graphics, network systems and enterprise servers.
In anticipating the upswing in market demand, Samsung said believes that its volume production of the 8GB HBM2 will cover more than 50 percent of its HBM2 production by the first half of next year.
Samsung’s 8GB HBM2 is known within the industry to deliver a high level of DRAM performance, reliability and energy efficiency. Among the HBM2 and TSV (Through Silicon Via) technologies that were utilized for the latest DRAM solution, more than 850 of them have been submitted for patents or already patented.
First introduced in June 2016, HBM2 boasts a 256GB/s data transmission bandwidth, offering more than an eight-fold increase over a 32GB/s GDDR5 DRAM chip. With capacity double that of 4GB HBM2, the 8GB solution contributes greatly to improving system performance and energy efficiency, offering ideal upgrades to data-intensive, high-end computing applications that deal with machine learning, parallel computing and graphics rendering.
The 8GB HBM2 consists of eight 8-gigabit HBM2 dies and a buffer die at the bottom of the stack, which are all vertically interconnected by TSVs and microbumps. With each die containing more than 5,000 TSVs, a single Samsung 8GB HBM2 package has more than 40,000 TSVs.
The utilization of so many TSVs, including spares, ensures high performance, by enabling data paths to be switched to different TSVs when a delay in data transmission occurs.
The HBM2 is also designed to prevent overheating beyond certain temperature to guarantee high reliability.
“By increasing production of the industry’s only 8GB HBM2 solution now available, we are aiming to ensure that global IT system manufacturers have sufficient supply for timely development of new and upgraded systems,” said Jaesoo Han, Samsung’s Executive Vice-President of Memory Sales and Marketing team.