MosaiChunk: extract four historical KV sections and compose one chunk
Chunk KV
Sections
Encoder
Query
Scores
.32
.72
.91
.63
.94
.96
.36
.82
.61
.52
.88
.98
.47
.66
.57
.62
.55
.60
.44
.58
···
History
Sliding window
···
Top-N
.98
.96
.94
.91
Extract
Extracted Sections
Concat
MosaiChunk
(a) Encode and store
(b) Score historical sections
(c) Extract and compose