Lost in the Middle / Recall vs Position in Context
HIGH
LOW
RECALL ACCURACY
START
MIDDLE
END
TOKEN POSITION IN PROMPT
"lost"
Attention is a finite budget. Put critical data at the
boundaries
; the middle becomes a sea of noise.