notesum.ai

Published at May 7

Transformers on Markov data: Constant depth suffices

NeurIPS

Released Date: May 7, 2024

Authors: Nived Rajaraman1, Marco Bondaschi2, Ashok Vardhan Makkuva2, Kannan Ramchandran1, Michael Gastpar2

Aff.: 1UC Berkeley; 2EPFL

Arxiv: https://openreview.net/pdf/3f922424a4972b109b5e294928fdb3fc38a075fd.pdf