What Makes a Large Model a Foundation Model: a Historical Perspective
Traces the evolution from Transformer to ChatGPT, arguing that foundation models' core features are few-shot learning without fine-tuning and conversational UI, with large-scale training being the means rather than the goal.