An Introduction to Automatic Differentiation with a Visualization Tool

• Module 1: The Basics of Forward Mode
  • I. Introduction
  • II. The Basics of Forward Mode
  • III. A Tool for Visualizing Automatic Differentiation
  • IV. A First Demo of Automatic Differentiation
  • V. Exercises
• Module 2: Deeper Into Forward Mode
  • I. The Computational Trace and Practice with the Visualization Tool
  • II. More Theory
  • III. Exercises
• Module 3: The Reverse Mode of Automatic Differentiation
  • I. The Basics of Reverse Mode
  • II. Summary Sketch of Reverse Mode
  • III. The Basic Equations
  • IV. An Example for Intuition
  • V. Practice with the Visualization Tool
  • VI. More Theory
  • VII. A Comparison of Forward and Reverse Mode
  • VIII. Going Forward
  • IX. Exercise
• Module 4: Beyond the Basics: Extensions and Software Development
  • The Dual Numbers
  • Toward Software Implementation
  • Exercises
• References and Additional Resources
• Solutions to Exercises
  • Module 1
  • Module 2
  • Module 3
  • Beyond the Basics

Indices and tables

• Index
• Module Index
• Search Page