notesum.ai
Published at November 14LLM Hallucination Reasoning with Zero-shot Knowledge Test
cs.AI
cs.CL
Released Date: November 14, 2024
Authors: Seongmin Lee1, Hsiang Hsu2, Chun-Fu Chen
Aff.: 1Georgia Institute of Technology; 2JPMorganChase Global Technology Applied Research
| Question | LLM-generated text | Type |
| What is the habitat of Pika? | Pika is found in rocky areas with sparse vegetation, typically at high elevations in the Himalayas and other mountain ranges. | Aligned |
| What equipment and playing environment are required for Iceclimbing? | Ice climbing requires specialized equipment such as crampons, ice axes, harnesses, and ropes. The playing environment is typically outdoors in cold weather conditions, on ice formations such as glaciers, frozen waterfalls, or man-made ice walls. | Aligned |
| What is the habitat of Pika? | Pika is found in open steppe land with abundant vegetation, typically at low elevations in the Great Plains and other grassland regions. | Misaligned |
| What equipment and playing environment are required for Iceclimbing? | Ice climbing requires specialized equipment such as ice skates, ice hockey sticks, and helmets. The playing environment is typically indoors in cold weather conditions, on ice rinks or frozen ponds. | Misaligned |
| What is the habitat of Hornoda? | Hornoda is found in the deserts of North Africa and the Middle East. | Fabricated |
| What equipment and playing environment are required for Cycloling? | Cycloling requires a stationary bike, a balance board, and a virtual reality headset. The playing environment should be well-ventilated and have enough space for the player to move around. | Fabricated |