notesum.ai

Published at November 26

BPP-Search: Enhancing Tree of Thought Reasoning for Mathematical Modeling Problem Solving

cs.AI

Released Date: November 26, 2024

Authors: Teng Wang¹, Wing-Yin Yu², Zhenqi He¹, Zehua Liu¹, Xiongwei Han³, Hailei Gong³, Han Wu², Wei Shi², Ruifeng She², Fangzhou Zhu³, Tao Zhong³

Aff.: ¹Department of Mathematics, the University of Hong Kong, Hong Kong SAR, China; ²Noah's Ark Lab, Huawei, Hong Kong SAR, China; ³Noah's Ark Lab, Huawei, Shenzhen, China

Arxiv: http://arxiv.org/abs/2411.17404v1

Model/Methods	CoT-BMLD	CoT-SPVOC	SC	ToT-Randomly-Chosen	ToT-Rethink	ToT-Fully-Traverse
GPT-4o	19	19	21	21	23	30
GPT-4o-mini	13	14	19	12	19	21
Llama-3-70B	10	17	19	17	17	22
Llama-3.1-70B	18	10	21	5	14	17
Llama-3.2-11B	2	0	1	0	0	8
Qwen-2-72B-Instruct	2	2	4	3	1	5
Qwen-2.5-MATH-72B-Instruct	2	2	0	0	0	4
Qwen-2.5-72B-Instruct	6	5	9	2	2	2
Mixtral-8 $\times$ 7B-v0.1	0	0	0	0	1	1