In this course, you’ll learn theoretical foundations of optimization methods used for training deep machine learning models. Why does gradient descent work? Specifically, what can we guarantee about ...

GRASP is a new gradient-based planner for learned dynamics (a “world model”) that makes long-horizon planning practical by (1 ...

Dr. James McCaffrey of Microsoft Research explains how to implement a geometry-inspired optimization technique called spiral dynamics optimization (SDO), an alternative to Calculus-based techniques ...

Dr. James McCaffrey of Microsoft Research explains stochastic gradient descent (SGD) neural network training, specifically implementing a bio-inspired optimization technique called differential ...