notesum.ai

Published at December 5

Establishing Task Scaling Laws via Compute-Efficient Model Ladders

cs.CL

cs.AI

Released Date: December 5, 2024

Authors: Akshita Bhagia¹, Jiacheng Liu², Alexander Wettig³, David Heineman¹, Oyvind Tafjord¹, Ananya Harsh Jha², Luca Soldaini¹, Noah A. Smith¹, Dirk Groeneveld¹, Pang Wei Koh¹, Jesse Dodge¹, Hannaneh Hajishirzi¹

Aff.: ¹Allen Institute for Artificial Intelligence; ²Paul G. Allen School of Computer Science & Engineering, University of Washington; ³Princeton University

Arxiv: http://arxiv.org/pdf/2412.04403v1

Original problem	A woman is outside with a bucket and a dog. The dog is running around trying to avoid a bath. She A. rinses the bucket off with soap and blow dry the dog’s head. B. uses a hose to keep it from getting soapy. C. gets the dog wet, then it runs away again. D. gets into a bath tub with the dog. Answer: C
Task loss calculation	Question: A woman is outside with a bucket and a dog. The dog is running around trying to avoid a bath. She Answer: gets the dog wet, then it runs away again.