notesum.ai
Published at December 5GRAF: Graph Retrieval Augmented by Facts for Legal Question Answering
cs.CL
Released Date: December 5, 2024
Authors: Cristian-George Crăciun, Răzvan-Alexandru Smădu, Dumitru-Clementin Cercel1, Mihaela-Claudia Cercel2
Aff.: 1National University of Science and Technology POLITEHNICA Bucharest; 2Paris 1 Panthéon-Sorbonne University

| Model | Civil | Penal | Proc Civil | Proc Penal | Administrative | Work | Family | International | Comercial | Average |
|---|---|---|---|---|---|---|---|---|---|---|
| QBERT | 35.48 | 38.29 | 35.82 | 40.10 | 36.63 | 40.40 | 38.24 | 39.29 | 39.39 | 38.18 |
| CrossQBERT | 41.94 | 36.04 | 37.31 | 41.15 | 41.58 | 35.35 | 34.31 | 42.86 | 36.36 | 38.54 |
| ColBERT | 44.09 | 38.29 | 47.76 | 37.50 | 41.58 | 42.42 | 41.18 | 48.81 | 40.40 | 42.45 |
| LLM | 48.94 | 40.18 | 41.00 | 42.27 | 46.53 | 48.48 | 49.02 | 52.38 | 39.39 | 45.35 |
| LLM RAG | 51.06 | 43.75 | 38.81 | 42.78 | 57.43 | 56.57 | 63.73 | 52.38 | 57.58 | 51.57 |
| LLM LFT | 45.74 | 51.79 | 74.63 | 48.97 | 52.48 | 49.49 | 54.90 | 70.24 | 53.53 | 55.75 |
| \hdashline GRAF(Ours) | 49.46 | 52.70 | 78.46 | 51.05 | 59.18 | 57.29 | 68.69 | 67.12 | 56.84 | 60.09 |