References and Additional Resources

A Hitchhiker’s Guide to Automatic Differentiation.

Griewank, A. and Walther, A., 2008. Evaluating derivatives: principles and techniques of algorithmic differentiation (Vol. 105). Siam.

Nocedal, J. and Wright, S., 2001. Numerical Optimization, Second Edition. Springer.

Automatic Differentiation in Machine Learning: A Survey.