|  |  | 
 | 1 |  |  |  | Introduction to Dynamic Programming, Examples, Problem Formulation (PDF) | 
 |  |  | 
 |  |  | 
 | 2 |  |  |  | The Dynamic Programming Algorithm (PDF) | 
 |  |  | 
 |  |  | 
 | 3 |  |  |  | Deterministic Systems and the Shortest Path Problem (PDF) | 
 |  |  | 
 |  |  | 
 | 4 |  |  |  | Shortest Path Algorithms (PDF) | 
 |  |  | 
 |  |  | 
 | 5 |  |  |  | Linear Quadratic Problems, Inventory Control (PDF) | 
 |  |  | 
 |  |  | 
 | 6 |  |  |  | Stopping and Scheduling Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 7 |  |  |  | Deterministic Continuous-Time Optimal Control (PDF) | 
 |  |  | 
 |  |  | 
 | 8 |  |  |  | The Pontryagin Minimum Principle I (PDF) | 
 |  |  | 
 |  |  | 
 | 9 |  |  |  | The Pontryagin Minimum Principle II (PDF) | 
 |  |  | 
 |  |  | 
 | 10 |  |  |  | Imperfect State Information Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 11 |  |  |  | Linear Quadratic Problems with Imperfect State Information (PDF) | 
 |  |  | 
 |  |  | 
 | 12 |  |  |  | Imperfect State Information Problems for Finite-State Systems (PDF) | 
 |  |  | 
 |  |  | 
 | 13 |  |  |  | Suboptimal Control I (PDF) | 
 |  |  | 
 |  |  | 
 | 14 |  |  |  | Suboptimal Control II (PDF) | 
 |  |  | 
 |  |  | 
 | 15 |  |  |  | Rollout Algorithms (PDF) | 
 |  |  | 
 |  |  | 
 | 16 |  |  |  | Additional Topics in Suboptimal Control (PDF) | 
 |  |  | 
 |  |  | 
 | 17 |  |  |  | Infinite Horizon Problems - Stochastic Shortest Path Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 18 |  |  |  | Infinite Horizon Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 19 |  |  |  | Stochastic Shortest Path and Discounted Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 20 |  |  |  | Average Cost Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 21 |  |  |  | Semi-Markov Problems (PDF) | 
 |  |  | 
 |  |  | 
 | 22 |  |  |  | Neuro-Dynamic Programming I (PDF) | 
 |  |  | 
 |  |  | 
 | 23 |  |  |  | Neuro-Dynamic Programming II (PDF) | 
 |  |  | 
 |  |  | 
 | 24 |  |  |  | Neuro-Dynamic Programming III (PDF) | 
 |  |  |