Loss Function: Bridge between Neural Network and Optimization

Example: Gradient Descent for Logistic Regression

Convexity and Neural Network Loss Surface

Batch and Stochastic Gradient Descent

Hand - Optimize a Neural Network

Read - Inversion of Multiplication

Read - Jacobian Matrix and Weight Gradient Matrix (Next Year)