Optimal Controls 1

This post gives a mathematical framework that will be used in a series of posts to follow on optimal controls. Specifically, we will derive Euler-Lagrange equations, Hamiltonian equations and Dynamic programming based Hamilton-Jacobi-Bellman (HJB) equations.