notesum.ai

Published at November 26

What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics

cs.CL

cs.AI

cs.LG

Released Date: November 26, 2024

Authors: Jordan J. Bird¹

Aff.: ¹Department of Computer Science, Nottingham Trent University, Nottingham, Nottinghamshire, NG11 8NS, United Kingdom

Arxiv: http://arxiv.org/abs/2411.17593v1

Refer to caption

Model

Accuracy

Precision

Recall

F1

Parameters

Inference

Time (S)

ELECTRA + ANN

0.997

0.997

0.997

0.996

108907499

0.018

ERNIE + ANN

0.995

0.995

0.995

0.994

109499627

0.018

XLNet + ANN

0.992

0.992

0.992

0.992

116734187

0.025

RoBERTa + ANN

0.987

0.988

0.987

0.987

124661483

0.019

DistilBERT + ANN

0.987

0.987

0.987

0.987

66378731

0.011

Longformer + ANN

0.939

0.951

0.939

0.939

148675307

0.040

BERT + ANN

0.905

0.905

0.905

0.905

109498091

0.018

ALBERT + ANN

0.741

0.862

0.741

0.797

11699435

0.010

BERT

0.750

0.751

0.750

0.750

109485316

0.010

DistilBERT

0.744

0.744

0.744

0.744

66956548

0.006

Longformer

0.741

0.741

0.741

0.740

148662532

0.036

XLNet

0.742

0.740

0.742

0.740

117312004

0.022

ERNIE

0.735

0.740

0.735

0.736

109486852

0.011

RoBERTa

0.731

0.731

0.731

0.731

124648708

0.010

ELECTRA

0.714

0.713

0.714

0.713

109485316

0.011

ALBERT

0.675

0.685

0.675

0.678

11686660

0.009