Bookmarked: Predictive Coding has been Unified with Backpropagation - LessWrong

The paper Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs[1:1] "demonstrate[s] that predictive coding converges asymptotically (and in practice rapidly) to exact backprop gradients on arbitrary computation graphs using only local learning rules." The authors have unified predictive coding and backpropagation into a single theory of neural networks. Predictive coding and backpropagation are separate hardware implementations of what is ultimately the same algorithm

· · communitybot · 0 · 0 · 0
Sign in to participate in the conversation

A gateway into the global open conversation in the fediverse for Boing folks and anyone they know.