Kioxia CM10: PCIe 6.0 SSD Aimed at Nvidia KV Cache

PromptCube Expert 1h ago 404 views 14 likes 2 min read

The first PCIe 6.0 enterprise SSD that doesn't feel like a rubber-stamp announcement is Kioxia's CM10. While the industry has spent two years debating whether PCIe 6.0 is even necessary, Kioxia is already positioning this drive for something very concrete: Nvidia's CMX KV cache offload. That tells you more about where AI storage is heading than any roadmap slide.

Why KV Cache Offload Changes the Storage Game

KV cache is the memory bottleneck everyone hits when running long-context LLM inference. The transformer holds key-value tensors for every token, and with contexts stretching past 128K tokens, that state either fits in HBM or becomes a serious problem. Nvidia's CMX architecture seems designed to push that cache out of the GPU memory pool, which means the storage tier has to behave more like memory than a typical NVMe drive.

That's exactly where PCIe 6.0 matters. The protocol doubles bandwidth per lane compared to PCIe 5.0 — 64 GT/s instead of 32 GT/s. For an x4 link that's already significant, but for the CM10, the whole point is that you can feed a cache-hungry accelerator without making the I/O path the new bottleneck.

What the CM10 Actually Brings

Kioxia made some choices here that are worth noting:

  • PCIe 6.0 interface with support for the new PAM4 signaling, which is a big leap over NRZ. It's not just marketing — it halves latency per unit of bandwidth.
  • Enterprise durability tier, meaning it's built for sustained writes, not just benchmark reads. KV cache workloads are write-heavy during prompt processing and read-heavy during token generation.
  • A form factor that likely fits standard E3.S or E1.S slots, so you don't need custom backplanes to test it.
  • Targeting Nvidia CMX specifically, which is a strong signal that Kioxia sees this as an accelerator sidecar, not a general-purpose disk replacement.

I don't have the full datasheet in front of me, so I won't quote IOPS or latency numbers I can't verify. The interesting part is the positioning. Instead of selling raw capacity, Kioxia is selling a low-latency, high-bandwidth cache tier that sits between DRAM and conventional storage.

The Catch with PCIe 6.0 SSDs

Real talk: PCIe 6.0 controllers are expensive, and the NAND to saturate even half of that bandwidth isn't cheap either. Most existing flash memory can do maybe 10–15 GB/s per device, while PCIe 6.0 x4 links can theoretically carry over 60 GB/s. So the CM10 is not about maxing out the interface — it's

KioxiaCM10PCIe 6.0KV Cache

All Replies (3)

C
Cameron9 Advanced 1h ago
Been running a CM10 in our inference box for a week; KV cache misses dropped noticeably.
0 Reply
J
Jamie5 Advanced 1h ago
One thing the article skips: the doubled bandwidth matters less than the queue-depth behavior under real inference loads.
0 Reply
M
Max75 Advanced 1h ago
Swapped ours into a memory-bound NVMe-oF setup; the latency consistency is what sold me.
0 Reply

Write a Reply

Markdown supported