Towards Effective Theory of LLMs: A Representation Learning Approach

arXiv:2605.09294v1 Announce Type: cross Abstract: We propose Representational Effective Theory (RET), a framework for describing large language model computation in terms of learned macrostates rather than microscopic details. RET learns these macrostates from hidden-state trajectories using a...