Is there "Secret Sauce'' in Large Language Model Development?

arXiv:2602.07238v2 Announce Type: replace Abstract: Do leading LLM developers possess a proprietary ``secret sauce'', or is LLM performance driven by scaling up compute? Using training and benchmark data for 809 models released between 2022 and 2025, we estimate scaling-law regressions with...