notesum.ai

Published at April 22

CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

NeurIPS

Released Date: April 22, 2024

Authors: Jiachen Li, Xinyao Wang, Sijie Zhu, Chia-Wen Kuo, Lu XU, Fan Chen, Jitesh Jain, Humphrey Shi, Longyin Wen

Arxiv: https://openreview.net/pdf/f9d3434ee7bc78c3c09f5488b04345aff7f59570.pdf