World’s first 256GB SOCAMM2
Enabled by Micron’s breakthrough monolithic 32Gb LPDDR5X, Micron SOCAMM2 expands low‑power AI memory capabilities in the data center.
Featured resources
1 Results are based on Micron internal testing of real-time inference with Llama3 70B model (with FP16 quantization) using 500K context length and 16 concurrent users. The projected TTFT latency improvement is based on a latency of 0.12s for 2TB LPDRAM per CPU vs. 0.28s for 1.5TB LPDRAM per CPU.
2 Results are based on Micron internal LPDDR5x power calculator, assuming estimated AI use case and conditions.