The Simple Essence of Automatic Differentiation - Conal Elliott
Microsoft Research · 90:45 · Watch on YouTube
Conal Elliott reframes differentiation as computing linear maps and shows that automatic differentiation, including reverse-mode/backpropagation, falls out compositionally from preserving categorical structure via a c...