Super HN

New Show
   Who Invented Backpropagation? (people.idsia.ch)
> BP's modern version (also called the reverse mode of automatic differentiation)

So... Automatic integration?

Proportional, integrative, derivative. A PID loop sure sounds like what they're talking about.

TIL that the same Shun'ichi Amari who founded information geometry also made early advances to gradient descent.