This article explains the concept of abstraction in neural networks and its connection to generalization. It also discusses how different components in neural networks contribute to abstraction and reveals an interesting duality between abstraction and generalization.