ECE411H1

Adaptive Control and Reinforcement Learning

An introduction to adaptive control and reinforcement learning for discrete-time deterministic linear systems. Topics include: discrete-time state space models; stability of discrete time systems; parameter adaptation laws; error models in adaptive control; persistent excitation; controllability and pole placement; observability and observers; classical regulation in discrete-time; adaptive regulation; dynamic programming; Rescorla-Wagner model; value iteration methods; Q-learning; temporal difference learning.