notesum.ai
Published at October 22Math Neurosurgery: Isolating Language Models' Math Reasoning Abilities Using Only Forward Passes
cs.DC
cs.AI
cs.LG
cs.MA
Released Date: October 22, 2024
Authors: Bryan R. Christ1, Zack Gottesman1, Jonathan Kropko1, Thomas Hartvigsen1
Aff.: 1University of Virginia
| Prompt |
|
Read this passage and answer the multiple choice question below it.
A newspaper reporter’s job can be very interesting. He meets all types of people and lives quite a busy life. He is for news all the time,then after several years he may get a desk job,and life becomes a bit more settled. Let’s look at his work a little more closely. In a day he may have to interview the prime minister of a foreign country, and the next day he may be writing about a football match. Sometimes he may be so busy that he hardly has any time to sleep. And at other times he may go on for days looking out for news materials yet return empty–handed.
In the beginning, a reporter has to cover a very wide field. After the early years he becomes more specialized in his work. For example, he may finaliy be asked to write only on court cases or politics or sports. Some reporters may become so specialized that they are asked only to write on a special thing: horse racing, for example. In most newspaper houses there is at least one special racing correspondent. Some newspapers have book reviews. Their job is delightful. They read the latest book and then write reviews on the ones they like. Then there are those who write on fdms, so they get to see them even before they are shown in the cinema. How lucky, you would say! A reporter’s job can also be very dangerous. If there is a flood or a riot they may get hurt or even be killed. Three years ago there was a reporter whose camera was destroyed by a group of men, because they were angry with him for taking their picture. Dangerous or not, one thing is certain, and that is, their job is never dull! Question: Reporters who write on films are said to be lucky because they [blank]. Answer choices: [’can write anything they like’, ’can see more film stars’, ’can pay less than other people’, ’can see the fdms before most people see them in the cinema’] |
| Response Before Pruning (incorrect) |
| Answer: ’can see more film stars’ |
| Response After Pruning Based on RACE (incorrect) |
| Answer: ’can see more film stars’ |
| Response After Pruning Based on MMLU (incorrect) |
| Answer: A. ’can write anything they like’ |