3/7 Dead end #2: MoE plug-in “memory cards” → expand experts, route reads through the router → partial win, then pretraining’s ceiling Insight: attention doesn’t care how hidden state got there — if…