LeNet 与卷积神经网络

1989 年，贝尔实验室的研究者 Yann LeCun 在论文里展示了一个当时看起来有点「不合群」的想法：用多层神经网络直接识别手写数字，而且网络自己学习图像特征，不需要人手工设计任何特征提取器。那一年主流 AI 还在专家系统的余晖里，神经网络因为 1969 年明斯基的批评和算力限制，长期处于边缘地带。LeCun 的论文，是边缘地带里一次扎实的证明。

网络的秘密在于结构。LeCun 没有把图像拉平成一条长长的输入，而是用卷积核在图像上滑动——一小块一小块地扫描，每一处共享同一组权重。这个设计的妙处在于：局部相关性被直接利用了，邻近的像素本来就该一起看；参数数量也因为权重共享被压到很小。卷积之后跟一个池化层，把特征图缩小、对微小的位置变化不敏感。最后再接全连接层输出分类。反向传播负责把错误逐层传回去，调整所有卷积核。

1998 年，LeCun 与合作者发表了 LeNet-5 的系统论文。论文把卷积、池化、全连接、训练细节完整地讲清楚了，还顺手贡献了 MNIST——一个 7 万张手写数字图片的公开基准。LeNet-5 在 MNIST 上达到了当时领先的错误率，而且这套技术真的上了生产：美国银行的支票识别系统用它读支票金额，每天处理上百万张。深度学习第一次在现实世界里干起了正式工作。

但之后是漫长的沉寂。2000 年代，神经网络继续被主流冷落，支持向量机和手工特征主导了视觉研究。LeNet 的卷积思想没有消失，只是蜷缩在少数研究者的论文里。转折发生在 2012 年：AlexNet 在 ImageNet 竞赛上以巨大优势夺冠，用的正是卷积、池化、反向传播这套 LeNet 早已定义的构件，只是更大、更深、跑在 GPU 上。世界仿佛一夜之间想起了卷积网络——而它其实已经默默存在了二十多年。

LeNet 与 AlexNet 的关系，常被概括为「祖父与孙辈」：AlexNet 轰动世界，LeNet 则是那个定义了家族基本基因的祖先。今天每一个卷积神经网络——无论用在自动驾驶、医学影像还是图像生成——都共享着 1989 年这篇论文确立的构件：局部感受野、共享权重、下采样、误差反传。这套设计在边缘地带生长多年，最终成为计算机视觉的地基。

LeCun 后来回忆这段历史时常说，深度学习的复兴靠的不是某一个灵光一现，而是把正确的构件组合起来，然后等待硬件与数据跟上。LeNet 的意义正在于此：它证明了这条路走得通，剩下的只是时间问题。今天回看，那个在 1989 年独自扫过手写数字的小网络，其实已经把未来二十多年视觉 AI 的蓝图画好了。

In 1989, researcher Yann LeCun at Bell Labs demonstrated an idea that looked out of step for its time: recognize handwritten digits directly with a multi-layer neural network whose features are learned by the network itself, with no hand-crafted feature extractor. That year, mainstream AI was still enjoying the afterglow of expert systems, and neural networks—sidelined since Minsky's 1969 critique and constrained by hardware—had spent years on the margins. LeCun's paper was a solid proof from inside those margins.

The secret lay in the structure. LeCun did not flatten an image into one long input. Instead, a convolution kernel slid across the image—scanning small patches, sharing the same set of weights everywhere. The cleverness: local correlations get exploited directly, since neighboring pixels belong together; and shared weights collapse the parameter count dramatically. A pooling layer followed, shrinking feature maps and adding tolerance to small positional shifts. Finally, fully connected layers produced the classification, and backpropagation carried errors backward layer by layer to adjust every kernel.

In 1998 LeCun and collaborators published the LeNet-5 paper. It described convolution, pooling, fully connected layers, and training details systematically, and contributed MNIST—a public benchmark of 70,000 handwritten digits. LeNet-5 achieved leading error rates on MNIST, and the technology actually shipped: US banks used it in check-reading systems processing millions of checks a day. Deep learning had done real production work for the first time.

Then came a long silence. Through the 2000s neural networks stayed out of the mainstream, with support vector machines and hand-crafted features dominating vision research. LeNet's convolutional ideas never vanished; they huddled in a few researchers' papers. The turning point came in 2012: AlexNet won the ImageNet competition by a landslide, using exactly the components LeNet had defined—convolution, pooling, backpropagation—only bigger, deeper, and running on GPUs. The world suddenly remembered convolutional networks, which had already existed quietly for more than two decades.

The relationship between LeNet and AlexNet is often summarized as grandparent and grandchild: AlexNet stunned the world, while LeNet defined the family's basic genes. Every convolutional network today—in self-driving, medical imaging, or image generation—shares the components established in that 1989 paper: local receptive fields, shared weights, downsampling, and error backpropagation. The design grew on the margins for years before becoming the foundation of computer vision.

LeCun often reflected that deep learning's revival was not a single flash of insight but the right components combined, then waiting for hardware and data to catch up. LeNet's significance is that it proved the road was viable; the rest was a matter of time. That small network sweeping handwritten digits alone in 1989 had, in effect, already drawn the blueprint for vision AI over the next two decades.