Position: LLM Serving Needs Mathematical Optimization and Algorithmic Foundations, Not Just Heuristics

arXiv:2605.01280v1 Announce Type: cross Abstract: This position paper argues that LLM inference serving has outgrown generic heuristics and now demands mathematical optimization and algorithmic foundations. Despite rapid advances in serving systems such as vLLM and SGLang, their algorithmic cores...