Knowledge Graph

Graph explorer

Search resolved entities, walk their edges, and read the sentence behind every one.

Entities25 of 207,987

Entity

KIVI K2V2

technology3 mentionslast seen Nov 6, 2026

A cache quantization format evaluated in the study.

Relationships 2

Relationship

key-value cache quantizationsupersedesKIVI K2V2

70% confidence1 supporting mentions

Either name opens that entity’s relationships.

Sources 1

preprintarXivSep 4, 2026Interface-Aware KV Cache Quantization for Dense On-Chip NVM in Long-Context LLM Decoding
KIVI attaches per-group metadata, adding about 25% to the stored KV cache; KVQuant keeps sparse full-precision outliers that a dense array cannot hold in place. This paper examines what these structures cost when the KV cache resides in NVM behind fixed-range converters, and designs a quantization scheme matched to that interface.