notesum.ai

Published at December 3

Scaling BERT Models for Turkish Automatic Punctuation and Capitalization Correction

cs.CL

cs.AI

cs.LG

Released Date: December 3, 2024

Authors: Abdulkader Saoud¹, Mahmut Alomeyr¹, Himmet Toprak Kesgin¹, Mehmet Fatih Amasyali¹

Aff.: ¹Yildiz Technical University

Arxiv: http://arxiv.org/pdf/2412.02698v1

Refer to caption

Model	Hidden Size	Num. Attn Heads	Num. Hidden Layers	Num. Parameters (millions)
Tiny	128	2	2	4.6
Mini	256	4	4	11.6
Small	512	8	4	29.6
Medium	512	8	8	42.2
Base	768	12	12	110.7