notesum.ai

Published at December 9

Copyright-Protected Language Generation via Adaptive Model Fusion

cs.LG

cs.CL

cs.CR

Released Date: December 9, 2024

Authors: Javier Abad¹, Konstantin Donhauser¹, Francesco Pinto², Fanny Yang¹

Aff.: ¹ETH Zürich; ²University of Oxford

Arxiv: http://arxiv.org/pdf/2412.06619v1

Refer to caption

Model	Split	EM^$\downarrow$	JP^$\downarrow$	EM^$\downarrow$	BLE^$\downarrow$	LEV^$\uparrow$	EM^$\downarrow$	BLE^$\downarrow$	LEV^$\uparrow$
		Python inst.		MathAbstracts			WritingPrompts
Overfit Split 1	Split 1	1469.80	1.00	1397.68	1.00	0.00	1316.24	1.00	0.00
Overfit Split 1	Split 2	44.60	0.01	31.00	0.01	0.70	22.59	0.03	0.71
Overfit Split 2	Split 1	42.64	0.01	42.12	0.08	0.68	26.11	0.02	0.70
Overfit Split 2	Split 2	1393.88	0.99	1570.88	1.00	0.00	1141.88	1.00	0.00
System Prompt	Split 1	1360.68	1.00	1022.72	0.99	0.00	1118.36	1.00	0.00
System Prompt	Split 2	1373.16	0.99	1005.20	1.00	0.00	1092.20	1.00	0.00
MemFree	Split 1	165.48	0.99	111.12	0.23	0.53	63.84	0.20	0.55
MemFree	Split 2	157.36	0.96	99.40	0.22	0.53	59.04	0.19	0.55
$\text{CP-}\Delta$	Split 1	273.20	1.00	341.60	0.58	0.30	37.40	0.05	0.70
$\text{CP-}\Delta$	Split 2	284.80	0.99	162.80	0.30	0.51	31.29	0.04	0.70
CP-Fuse (Ours)	Split 1	69.58	0.03	55.54	0.14	0.62	27.55	0.02	0.70
CP-Fuse (Ours)	Split 2	68.04	0.03	48.74	0.14	0.63	25.50	0.03	0.70