800ms
600ms
400ms
200ms
0ms
0
5k
10k
15k
Context Tokens
320ms
340ms
420ms
520ms
TTFT
LLM TTFT Scaling with Context Size