notesum.ai
Published at November 18Understanding Chain-of-Thought in LLMs through Information Theory
cs.CL
cs.AI
Released Date: November 18, 2024
Authors: Jean-Francois Ton, Muhammad Faaiz Taufiq1, Yang Liu2
Aff.: 1ByteDance Research; 2University of California Santa Cruz

| Method | Accuracy | TPR | FPR |
|---|---|---|---|
| IG (Ours) | 0.96 | 0.98 | 0.06 |
| ORM | 0.77 | 0.98 | 0.54 |
| Math-Shepherd | 0.60 | 1.0 | 1.0 |