notesum.ai

Published at December 5

BhashaVerse : Translation Ecosystem for Indian Subcontinent Languages

cs.CL

cs.AI

Released Date: December 5, 2024

Authors: Vandan Mujadia¹, Dipti Misra Sharma¹

Aff.: ¹Language Technologies Research Centre, IIIT-Hyderabad, Hyderabad, Telangana, India

Arxiv: http://arxiv.org/pdf/2412.04351v1

Language Pair

Developed

Parallel Data

Language Pair

Developed

Parallel Data

Language Pair

Developed

Parallel Data

Language Pair

Developed

Parallel Data

Language Pair

Developed

Parallel Data

Language Pair

Developed

Parallel Data

Language Pair

Developed

Parallel Data

asm_Beng_ben_Beng

2111717

brx_Deva_eng_Latn

21161986

eng_Latn_mai_Deva

25730422

guj_Gujr_snd_Deva

7948035

kas_Arab_snd_Arab

872206

mar_Deva_ory_Orya

47036189

pan_Guru_snd_Deva

3246797

asm_Beng_brx_Deva

765615

brx_Deva_gom_Deva

799906

eng_Latn_mal_Mlym

103881922

guj_Gujr_tam_Taml

69922990

kas_Arab_snd_Deva

1231344

mar_Deva_pan_Guru

4421324

pan_Guru_tam_Taml

4207666

asm_Beng_doi_Deva

2317597

brx_Deva_guj_Gujr

3423331

eng_Latn_mar_Deva

98133618

guj_Gujr_tel_Telu

635961470

kas_Arab_tam_Taml

2359634

mar_Deva_san_Deva

1940249

pan_Guru_tel_Telu

80308819

asm_Beng_eng_Latn

30594977

brx_Deva_hin_Deva

7883998

eng_Latn_mni_Beng

13473789

guj_Gujr_urd_Arab

171350512

kas_Arab_tel_Telu

10578313

mar_Deva_sat_Olck

539452

pan_Guru_urd_Arab

7873795

asm_Beng_gom_Deva

828224

brx_Deva_kan_Knda

2247979

eng_Latn_mni_Mtei

24917741

hin_Deva_kan_Knda

27641372

kas_Arab_urd_Arab

3362396

mar_Deva_snd_Arab

2047746

san_Deva_sat_Olck

355047

asm_Beng_guj_Gujr

9163504

brx_Deva_kas_Arab

710060

eng_Latn_npi_Deva

79094284

hin_Deva_kas_Arab

10689877

kas_Deva_mai_Deva

1723270

mar_Deva_snd_Deva

2682147

san_Deva_snd_Arab

1135478

asm_Beng_hin_Deva

8361026

brx_Deva_kas_Deva

1429735

eng_Latn_ory_Orya

434864407

hin_Deva_kas_Deva

18466409

kas_Deva_mal_Mlym

3812953

mar_Deva_tam_Taml

3041800

san_Deva_snd_Deva

1453221

asm_Beng_kan_Knda

2374887

brx_Deva_mai_Deva

780823

eng_Latn_pan_Guru

106211275

hin_Deva_mai_Deva

8774341

kas_Deva_mar_Deva

3342699

mar_Deva_tel_Telu

79927241

san_Deva_tam_Taml

2085085

asm_Beng_kas_Arab

880736

brx_Deva_mal_Mlym

1986655

eng_Latn_san_Deva

43354388

hin_Deva_mal_Mlym

81376763

kas_Deva_mni_Beng

819979

mar_Deva_urd_Arab

40450921

san_Deva_tel_Telu

29210615

asm_Beng_kas_Deva

1577560

brx_Deva_mar_Deva

1462688

eng_Latn_sat_Olck

9625012

hin_Deva_mar_Deva

80444061

kas_Deva_mni_Mtei

1503829

mni_Beng_mni_Mtei

356775

san_Deva_urd_Arab

3636643

asm_Beng_mai_Deva

757165

brx_Deva_mni_Beng

378232

eng_Latn_snd_Arab

31294443

hin_Deva_mni_Beng

3728206

kas_Deva_npi_Deva

2457536

mni_Beng_npi_Deva

389988

sat_Olck_snd_Arab

348940

asm_Beng_mal_Mlym

1776146

brx_Deva_mni_Mtei

758003

eng_Latn_snd_Deva

31606531

hin_Deva_mni_Mtei

9416582

kas_Deva_ory_Orya

19983032

mni_Beng_ory_Orya

3585322

sat_Olck_snd_Deva

489121

asm_Beng_mar_Deva

1418576

brx_Deva_npi_Deva

954826

eng_Latn_tam_Taml

94940774

hin_Deva_npi_Deva

10786012

kas_Deva_pan_Guru

4201119

mni_Beng_pan_Guru

1119674

sat_Olck_tam_Taml

430418

asm_Beng_mni_Beng

312229

brx_Deva_ory_Orya

7615181

eng_Latn_tel_Telu

960415291

hin_Deva_ory_Orya

346421975

kas_Deva_san_Deva

1941751

mni_Beng_san_Deva

525579

sat_Olck_tel_Telu

2579655

asm_Beng_mni_Mtei

888899

brx_Deva_pan_Guru

2189039

eng_Latn_urd_Arab

246732366

hin_Deva_pan_Guru

63333450

kas_Deva_sat_Olck

676632

mni_Beng_sat_Olck

139996

sat_Olck_urd_Arab

976839

asm_Beng_npi_Deva

1009181

brx_Deva_san_Deva

751939

gom_Deva_guj_Gujr

9962240

hin_Deva_san_Deva

29108161

kas_Deva_snd_Arab

1837653

mni_Beng_snd_Arab

609824

snd_Arab_snd_Deva

1292311

asm_Beng_ory_Orya

12801566

brx_Deva_sat_Olck

240046

gom_Deva_hin_Deva

13998575

hin_Deva_sat_Olck

3377744

kas_Deva_snd_Deva

1827310

mni_Beng_snd_Deva

659939

snd_Arab_tam_Taml

1890070

asm_Beng_pan_Guru

2110174

brx_Deva_snd_Arab

900441

gom_Deva_kan_Knda

2432914

hin_Deva_snd_Arab

18584708

kas_Deva_tam_Taml

3329492

mni_Beng_tam_Taml

719910

snd_Arab_tel_Telu

19075895

asm_Beng_san_Deva

1034015

brx_Deva_snd_Deva

1060504

gom_Deva_kas_Arab

907722

hin_Deva_snd_Deva

14552624

kas_Deva_tel_Telu

19804719

mni_Beng_tel_Telu

2192230

snd_Arab_urd_Arab

3048720

asm_Beng_sat_Olck

439289

brx_Deva_tam_Taml

1321496

gom_Deva_kas_Deva

1739739

hin_Deva_tam_Taml

76095904

kas_Deva_urd_Arab

5387510

mni_Beng_urd_Arab

1254597

snd_Deva_tam_Taml

2661636

asm_Beng_snd_Arab

929278

brx_Deva_tel_Telu

6450144

gom_Deva_mai_Deva

760450

hin_Deva_tel_Telu

854298767

mai_Deva_mal_Mlym

2096537

mni_Mtei_npi_Deva

1443672

snd_Deva_tel_Telu

15779583

asm_Beng_snd_Deva

1315760

brx_Deva_urd_Arab

2250715

gom_Deva_mal_Mlym

2020062

hin_Deva_urd_Arab

211718893

mai_Deva_mar_Deva

1616046

mni_Mtei_ory_Orya

9403109

snd_Deva_urd_Arab

4222851

asm_Beng_tam_Taml

1645025

doi_Deva_eng_Latn

56050632

gom_Deva_mar_Deva

1393256

kan_Knda_kas_Arab

2720541

mai_Deva_mni_Beng

549939

mni_Mtei_pan_Guru

2435659

tam_Taml_tel_Telu

74713991

asm_Beng_tel_Telu

17575936

doi_Deva_gom_Deva

2230764

gom_Deva_mni_Beng

389990

kan_Knda_kas_Deva

4425169

mai_Deva_mni_Mtei

849017

mni_Mtei_san_Deva

1042586

tam_Taml_urd_Arab

22118281

asm_Beng_urd_Arab

2786265

doi_Deva_guj_Gujr

13475348

gom_Deva_mni_Mtei

1025298

kan_Knda_mai_Deva

2465368

mai_Deva_npi_Deva

1095355

mni_Mtei_sat_Olck

329603

tel_Telu_urd_Arab

242494781

ben_Beng_brx_Deva

1771330

doi_Deva_hin_Deva

25314841

gom_Deva_npi_Deva

1344302

kan_Knda_mal_Mlym

6077765

mai_Deva_ory_Orya

8857273

mni_Mtei_snd_Arab

1156456

ben_Beng_doi_Deva

5725017

doi_Deva_kan_Knda

6225786

gom_Deva_ory_Orya

11288994

kan_Knda_mar_Deva

4775780

mai_Deva_pan_Guru

2318762

mni_Mtei_snd_Deva

1302097

ben_Beng_eng_Latn

110423482

doi_Deva_kas_Arab

2260841

gom_Deva_pan_Guru

1984080

kan_Knda_mni_Beng

1409277

mai_Deva_san_Deva

1043353

mni_Mtei_tam_Taml

1748302

ben_Beng_gom_Deva

2152903

doi_Deva_kas_Deva

3668955

gom_Deva_san_Deva

942936

kan_Knda_mni_Mtei

2604263

mai_Deva_sat_Olck

360250

mni_Mtei_tel_Telu

8112526

ben_Beng_guj_Gujr

78967455

doi_Deva_mai_Deva

2190770

gom_Deva_sat_Olck

399791

kan_Knda_npi_Deva

3973567

mai_Deva_snd_Arab

1022691

mni_Mtei_urd_Arab

2734445

ben_Beng_hin_Deva

87189520

doi_Deva_mal_Mlym

5447712

gom_Deva_snd_Arab

931740

kan_Knda_ory_Orya

55381962

mai_Deva_snd_Deva

1121301

npi_Deva_ory_Orya

11198582

ben_Beng_kan_Knda

6588212

doi_Deva_mar_Deva

4181626

gom_Deva_snd_Deva

1120965

kan_Knda_pan_Guru

6601794

mai_Deva_tam_Taml

1780322

npi_Deva_pan_Guru

3319821

ben_Beng_kas_Arab

2145259

doi_Deva_mni_Beng

1279927

gom_Deva_tam_Taml

1718214

kan_Knda_san_Deva

3279907

mai_Deva_tel_Telu

11267803

npi_Deva_san_Deva

1565423

ben_Beng_kas_Deva

4232603

doi_Deva_mni_Mtei

2217101

gom_Deva_tel_Telu

13826104

kan_Knda_sat_Olck

928128

mai_Deva_urd_Arab

2769033

npi_Deva_sat_Olck

360263

ben_Beng_mai_Deva

2254028

doi_Deva_npi_Deva

3384768

gom_Deva_urd_Arab

5767926

kan_Knda_snd_Arab

2572544

mal_Mlym_mar_Deva

4080152

npi_Deva_snd_Arab

1382765

ben_Beng_mal_Mlym

5151355

doi_Deva_ory_Orya

26264311

guj_Gujr_hin_Deva

501919187

kan_Knda_snd_Deva

3701804

mal_Mlym_mni_Beng

1005011

npi_Deva_snd_Deva

2383049

ben_Beng_mar_Deva

4356579

doi_Deva_pan_Guru

6035401

guj_Gujr_kan_Knda

45730533

kan_Knda_tam_Taml

4934229

mal_Mlym_mni_Mtei

1994893

npi_Deva_tam_Taml

1780516

ben_Beng_mni_Beng

897884

doi_Deva_san_Deva

2737805

guj_Gujr_kas_Arab

5266708

kan_Knda_tel_Telu

90235065

mal_Mlym_npi_Deva

2336955

npi_Deva_tel_Telu

64765229

ben_Beng_mni_Mtei

2310198

doi_Deva_sat_Olck

849840

guj_Gujr_kas_Deva

10007355

kan_Knda_urd_Arab

8070849

mal_Mlym_ory_Orya

50442690

npi_Deva_urd_Arab

3595423

ben_Beng_npi_Deva

2621108

doi_Deva_snd_Arab

2211042

guj_Gujr_mai_Deva

4852703

kas_Arab_kas_Deva

1799571

mal_Mlym_pan_Guru

5425283

ory_Orya_pan_Guru

48738324

ben_Beng_ory_Orya

52347364

doi_Deva_snd_Deva

2821105

guj_Gujr_mal_Mlym

41472075

kas_Arab_mai_Deva

1140655

mal_Mlym_san_Deva

2397623

ory_Orya_san_Deva

20414334

ben_Beng_pan_Guru

5688148

doi_Deva_tam_Taml

4419242

guj_Gujr_mar_Deva

76034043

kas_Arab_mal_Mlym

2320653

mal_Mlym_sat_Olck

713045

ory_Orya_sat_Olck

3094866

ben_Beng_san_Deva

2876914

doi_Deva_tel_Telu

26541111

guj_Gujr_mni_Beng

1289734

kas_Arab_mar_Deva

2033332

mal_Mlym_snd_Arab

2369219

ory_Orya_snd_Arab

14829766

ben_Beng_sat_Olck

899756

doi_Deva_urd_Arab

6725444

guj_Gujr_mni_Mtei

4373466

kas_Arab_mni_Beng

439988

mal_Mlym_snd_Deva

3280861

ory_Orya_snd_Deva

15923972

ben_Beng_snd_Arab

2322747

eng_Latn_gom_Deva

27718817

guj_Gujr_npi_Deva

30603002

kas_Arab_mni_Mtei

928839

mal_Mlym_tam_Taml

4176661

ory_Orya_tam_Taml

43120335

ben_Beng_snd_Deva

3155804

eng_Latn_guj_Gujr

596740761

guj_Gujr_ory_Orya

217767278

kas_Arab_npi_Deva

1384843

mal_Mlym_tel_Telu

81261194

ory_Orya_tel_Telu

430745670

ben_Beng_tam_Taml

4180758

eng_Latn_hin_Deva

832738952

guj_Gujr_pan_Guru

40878961

kas_Arab_ory_Orya

10958432

mal_Mlym_urd_Arab

6862158

ory_Orya_urd_Arab

61149573

ben_Beng_tel_Telu

87561402

eng_Latn_kan_Knda

115521466

guj_Gujr_san_Deva

14827663

kas_Arab_pan_Guru

2423309

mar_Deva_mni_Beng

869866

pan_Guru_san_Deva

2766113

ben_Beng_urd_Arab

42602867

eng_Latn_kas_Arab

25142330

guj_Gujr_sat_Olck

1541029

kas_Arab_san_Deva

1123349

mar_Deva_mni_Mtei

1763291

pan_Guru_sat_Olck

840630

brx_Deva_doi_Deva

1916922

eng_Latn_kas_Deva

41442708

guj_Gujr_snd_Arab

9319233

kas_Arab_sat_Olck

459615

mar_Deva_npi_Deva

1783813

pan_Guru_snd_Arab

2625050