notesum.ai
Published at November 21Evaluating the Robustness of Analogical Reasoning in Large Language Models
cs.CL
cs.AI
Released Date: November 21, 2024
Authors: Martha Lewis1, Melanie Mitchell2
Aff.: 1ILLC, University of Amsterdam, Amsterdam, The Netherlands; 2Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501

| Num. Generalizations | Alphabets | |||||
|---|---|---|---|---|---|---|
| 0 | 2 | 5 | 10 | 20 | Symb | |
| 0 | 276 | 342 | 336 | 384 | 270 | 268 |
| 1 | 138 | 153 | 156 | 150 | 159 | 300 |
| 2 | 92 | 102 | 104 | 100 | 106 | – |
| 3 | 92 | 102 | 104 | 100 | 106 | – |