notesum.ai

Published at November 28

Parameter-Efficient Transfer Learning for Music Foundation Models

cs.SD

cs.LG

eess.AS

Released Date: November 28, 2024

Authors: Yiwei Ding¹, Alexander Lerch²

Aff.: ¹Center for Artificial Intelligence and Data Science, University of Würzburg; ²Music Informatics Group, Georgia Institute of Technology

Arxiv: http://arxiv.org/pdf/2411.19371v1

Refer to caption

		Auto-tagging		Genre	Key		Tempo
		MTAT	MTG-Top50	GTZAN	GTZAN	GiantSteps	GTZAN	GiantSteps
		mAP	mAP	Acc.	Weighted Acc	Weighted Acc	Acc. 1	Acc. 1
MusicFM	FT	.469	.309	.741	.725	.722	.831	.916
	Probing	.472	.302	.841	.642	.671	.817	.924
	Adapter	.493	.319	.841	.673	.712	.845	.931
	Prompt	.469	.297	.850	.604	.685	.838	.916
	Prefix	.487	.308	.835	.717	.724	.848	.924
	BitFit	.479	.308	.831	.632	.705	.845	.908
	SSF	.481	.307	.844	.668	.689	.845	.901
	LoRA	.486	.317	.848	.704	.718	.828	.931
MERT	FT	.444	.296	.638	.536	.681	.752	.908
	Probing	.470	.303	.756	.581	.645	.424	.794
	Adapter	.481	.310	.728	.610	.706	.779	.901
	Prompt	.476	.303	.745	.619	.650	.710	.863
	Prefix	.477	.306	.700	.586	.673	.797	.878
	BitFit	.482	.311	.738	.650	.658	.807	.885
	SSF	.481	.312	.748	.615	.681	.807	.885
	LoRA	.480	.310	.747	.623	.664	.790	.885
DL Baseline		.461 [23]	.298 [23]	.541 [34]	.716* [35]	.706* [35]	.797* [35]	.901* [35]