KCAE.EVAL:2 - Problem

Retrieval can improve while the final answer remains wrong. A better assessor can appear worse because it receives poorer candidates. An inexpensive model can raise human review or refresh costs. A synthetic test set derived from the same summaries as the index can hide the exact distinctions the arrangement was meant to recover.