notesum.ai
Published at November 8FactLens: Benchmarking Fine-Grained Fact Verification
cs.CL
cs.AI
cs.LG
Released Date: November 8, 2024
Authors: Kushan Mitra1, Dan Zhang1, Sajjadur Rahman1, Estevam Hruschka1
Aff.: 1Megagon Labs

| Correlation | atomicity | sufficiency | fabrication | coverage | redundancy | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| LLM | 0.40 | 0.39 | 0.14 | 0.09 | 0.34 | 0.43 | 0.43 | 0.45 | 0.56 | 0.52 |
| Statistical | 0.58 | 0.59 | — | — | 0.04 | 0.05 | 0.61 | 0.58 | 0.10 | 0.12 |