notesum.ai

Published at November 26

cs.AR

cs.LG

Released Date: November 26, 2024

Authors: Chen Li¹, Corey Lammie², Manuel Le Gallo², Bipin Rajendran¹

Aff.: ¹King's College London; ²IBM Research Zurich

GLUE Task	Score	Score after Conductance Drift
GLUE Task	Score	0s	1h	1d	1w	1m	1y	10y
SST-2	92.8	91.2	90.9	90.8	90.6	90.6	90.4	90.0
MNLI-m/mm	83.3/82.6	82.8/83.3	82.6/83.0	82.4/82.7	82.1/82.6	82.0/82.4	81.7/82.0	81.2/82.6
MRPC	88.8	87.6	87.5	87.5	87.2	87.3	87.1	86.4
QNLI	90.6	90.9	90.9	90.8	90.6	90.3	90.0	89.5
QQP	70.2	86.9	87.0	86.9	86.7	86.6	86.4	86.2
RTE	66.2	52.9	53.4	54.3	55.4	54.2	53.3	53.4
STS-B	84.4	87.5	87.3	87.0	86.9	86.7	86.2	85.6
CoLA	50.5	46.0	44.6	42.7	40.6	39.8	39.1	37.3
GLUE	78.8	78.8	78.6	78.3	78.1	77.8	77.4	76.9