password162156 / REPOSITORY

hexcore-llm

HexCore: Low-Latency Paged KV Cache Allocator in C++20 and CUDA

Developer toolsLicense unchecked
Explore repositoryOriginal HN title; author claims are not independently verified.
1Top HN score
0Total comments
1Linked discussions

What the community said