Open RAG Eval and the move toward reference-free RAG benchmarks
Open RAG Eval’s core contribution is that UMBRELA and AutoNuggetizer are designed to score RAG quality without golden answers or golden chunks — which makes large-scale benchmarking more practical, but also means the metric family is optimizing for scalable proxy evaluation rather than proving true factual correctness.