Stage 1: Bi-Encoder Vector Search
~50ms
Stage 2: Cross-Encoder Reranking
~250ms
Total Request Latency
~300ms