# High Bandwidth Memory (HBM)
> A JEDEC-standardized stacked DRAM technology delivering terabytes-per-second bandwidth for AI accelerators, dominated by South Korean makers SK Hynix and Samsung.

**Meta:** type: reference · date: 2026-07-03 · heads:  · 4 takes · 4 lenses · 1 regions

## What it is

High Bandwidth Memory is a DRAM architecture in which multiple memory chips are stacked vertically and connected by through-silicon vias, then bonded alongside a logic die, such as a GPU or AI accelerator, on a silicon interposer. The interposer carries an interface 16 to 32 times wider than a conventional DDR channel: 2,048 bits in HBM4, versus 64 bits in DDR5. The result is bandwidth measured in terabytes per second per stack, critical for AI training and inference workloads that must move billions of model-weight parameters every millisecond.

Three companies supply virtually all commercial HBM. South Korea's SK Hynix (Icheon, Gyeonggi Province) holds the largest share. South Korea's Samsung Electronics (Suwon, Gyeonggi Province) is the second supplier. US-based Micron Technology (Boise, Idaho) entered HBM production later and has been rapidly gaining qualification wins. Demand flows primarily through Nvidia's AI accelerators, with AMD's Instinct series and Google's TPU programs as secondary buyers.

## History

AMD and South Korea's SK Hynix began joint development in the late 2000s. JEDEC ratified the first HBM standard (JESD235) in October 2013, targeting 128 GB/s per stack. AMD's Fury graphics cards, released in 2015, were the first commercial HBM products. HBM2 (January 2016) doubled per-stack bandwidth and was adopted in Nvidia's Volta V100 (2017) and AMD's Vega series. HBM2E, an enhanced variant, powered Nvidia's Ampere A100 (2020), delivering an aggregate 2 TB/s.

JEDEC ratified HBM3 on January 27, 2022. SK Hynix produced the first commercial HBM3 and supplied it for Nvidia's H100, carrying 80 GB at an aggregate 3.35 TB/s. HBM3E followed, shipping in Nvidia's H200 at 141 GB and 4.8 TB/s aggregate. In April 2025, JEDEC published HBM4 (JESD270-4), doubling the interface to 2,048 bits and targeting up to 2 TB/s per stack, with 16-layer configurations storing up to 48 GB per stack.

## Current state

Volume HBM4 shipments began in early 2026. In June 2026, Nvidia certified all three memory suppliers for the Vera Rubin GPU generation (see [Nvidia certifies all three memory makers for Vera Rubin HBM4, SK Hynix takes the lion's share](/ko/n/nvidia-vera-rubin-hbm4-allocation)); SK Hynix holds an estimated 60 to 70 percent of Rubin allocation, with Samsung and Micron splitting the remainder. Twelve-layer HBM4 stacks are priced above US$600 per unit. The broader HBM market is valued at roughly US$38 billion in 2025 and is projected at US$58 billion in 2026.

Supply is severely constrained. Micron reported in June 2026 that its entire HBM4 capacity for the fiscal year was already booked (see [마이크론, 사상 최대 분기 실적; HBM 매진, 마진 약 81% 근접](/ko/n/micron-q3-2026-record-hbm)). Industry analysts call the shortage "RAMageddon", a term covering both HBM and conventional DRAM, expected to persist through 2027.

## Relationships

HBM stacks are bonded to GPU dies on interposers produced by Taiwan's TSMC using the CoWoS (Chip on Wafer on Substrate) process; TSMC's CoWoS line capacity is a parallel supply bottleneck. Apple's 2025 device price increases were partly attributed to memory cost pressure from HBM demand competition (see [애플, AI 메모리 수요로 부품 비용 사상 최고 수준 도달하며 맥북·아이패드 가격 인상](/ko/n/apple-price-hike-memory-jun25)). Samsung's foundry division is investing in advanced packaging to reduce reliance on TSMC and recover qualification ground lost to SK Hynix (see [Samsung bets on a memory-plus-foundry dual engine as Tesla and Nvidia knock](/ko/n/samsung-foundry-memory-dual-engine-2026)). On the demand side, hyperscale buildouts such as the Cerebras-OpenAI data-center project (see [Cerebras, OpenAI와 200억 달러 규모 750MW 추론 공급 계약 체결](/ko/n/cerebras-openai-750mw-2026)) represent the scale of the pull on HBM capacity.

## What to watch

The next generation, HBM4E, is under development and is expected to raise per-pin speeds beyond 8 Gb/s. JEDEC is separately preparing SPHBM4, a reduced-pin-count variant targeting edge inference devices. Samsung must pass each successive Nvidia qualification round to recover share; the Vera Rubin outcome established a template in which SK Hynix's yield advantage converts into structural allocation dominance. US export restrictions on advanced AI chips may progressively restrict HBM deliveries to Chinese buyers, adding a geopolitical routing dimension. HBM4 wafer capacity additions in South Korea and the United States, via Micron's Idaho fabs, will determine how quickly the shortage loosens.

## Regional takes (batched by bias / lens)

### HPC industry press
- **HPCwire** (United States, en) — Reports JEDEC's April 2025 publication of the HBM4 standard (JESD270-4): 2,048-bit interface, 8 Gb/s per pin, up to 2 TB/s per stack, developed with AMD, Nvidia, Google, Micron, and SK Hynix.
  Source: https://www.hpcwire.com/off-the-wire/jedec-releases-hbm4-standard-to-advance-ai-and-hpc-memory/

### electronics trade press
- **EE Times** (United States, en) — Surveys HBM4 competitive dynamics at CES 2026 in Las Vegas, including SK Hynix's 16-layer 48 GB stack announcement and market-share data across the three suppliers.
  Source: https://www.eetimes.com/the-state-of-hbm4-chronicled-at-ces-2026/

### PC and hardware press
- **Tom's Hardware** (United States, en) — Details HBM4 technical specs including 32 pseudo-channels per stack and contributions to the JEDEC working group from AMD, Nvidia, Google, Micron, and SK Hynix.
  Source: https://www.tomshardware.com/pc-components/ram/jedec-finalizes-hbm4-memory-standard-with-major-bandwidth-and-efficiency-upgrades

### official record
- **Micron Technology (investor relations)** (United States, en) — Source of record for Micron's HBM capacity guidance, fiscal-year booking disclosures, and HBM4 production-ramp announcements including the mid-2026 sold-out status.
  Source: https://investors.micron.com/

## Across the graph
- Related: [[apple-price-hike-memory-jun25]], [[micron-q3-2026-record-hbm]], [[cerebras-openai-750mw-2026]], [[samsung-foundry-memory-dual-engine-2026]], [[nvidia-vera-rubin-hbm4-allocation]]
- Entities: Hbm, Corporate:sk Hynix, Corporate:samsung, Corporate:micron, Corporate:nvidia, Corporate:tsmc

---
Canonical: https://rbtfl.xyz/ko/n/hbm-dossier