Get the latest tech news
Backprop Alternative: Augmented Lagrangian Predictive Coding
A local alternative to backpropagation. PC-ALM trains residual MLPs up to 1000 layers, nearly matching backprop's performance despite using only layer-local dynamics. PC-ALM equips each layer with a feedback control dynamical system that distributes and propagates supervision credit throughout a network.
None
Or read this on Hacker News