Ultra-Bandwidth Solutions Memory Comparison
| Ultra-Bandwidth Solutions | GDDR6 | GDDR6X | HBM2E |
|---|---|---|---|
| Memory Comparison | AI Inference Accelerator | AI Inference Accelerator | AI Training Accelerator |
| Application Type (Example) |
Titan RTX RX5700 XT |
GeForce® RTX™ 3090 GeForce® RTX™ 3080 |
Expected |
| # of Placements | 12 | 12 | 4-6 |
| Gb/s/pin | 14-16 |
19-21 | 3.2-3.6 |
| GB/s/placement | 56-64 | 76-84 | 410-461 |
| GB/s/system | 672-768 | 912-1008 | 1638-2765 |
| Configuration (Example) |
384 IO (12pcs x 32 IO package) |
384 IO (12pcs x 32 IO package) |
4096 IO 6144 IO |
| Frame Buffer of Typical System | 12GB | 12GB | 32-96GB |
| Average Device Power (pJ/bit) | 7.5 | 7.25 | 6.0 |
| Typical IO Channel |
PCB (P2P SM) |
PCB (P2P SM) |
Si Interposer (2.5D integration) |
