'The GPU never reads the same text twice': Belgian startup Corbenic wants to turn your server's SSD into AI memory, but its 14x speedup owes more to reading less
Source ↗
👁 0
💬 0
Corbenic AI's Galahad beta saves a model's KV cache to encrypted local NVMe so servers can skip rereading text after GPU memory is cleared or after a restartFounder Sietse Schelpe tells TechRadar Pro no special hardware is needed, but the paper credits most of the 14x speedup to Blaise, a retrieval component, not SSD loadingLMCache, Nvidia Dynamo and CMX, WEKA and Phison already persist KV cache to storage; Galahad's edge is exact, fail-closed reuse in one small libraryBelgian startup Corbenic A
Comments (0)