Research2026-05-08
TIDE: Every Layer Knows the Token Beneath the Context
Source: Arxiv CS.AI
arXiv:2605.06216v1 Announce Type: cross Abstract: We revisit a universally accepted but under-examined design choice in every modern LLM: a token index is looked up once at the input embedding layer and then permanently discarded. This single-injection assumption induces two structural failures:...
arxivpapers