Computational Graph and Chain Rule

Single-Path Backpropagation

Multipath Backpropagation

Example NN Gradient Calculation

Subgradient for Non-Differentiable Function

Read - Symbolic Library

Read - Reverse Automatic Differentiation: A Tutorial with NumPy Implementation

(Deprecated) Modularized Functions

(Next Year) Retain Graph and Checkpoint Scheme