MATH 5350 - Markov Processes

3 hours

The ergodic theorem; regular and ergodic Markov chains; absorbing chains and random walks; mean first passage time; applications to electric circuits, entropy, genetics, games, decision theory and probability.

Prerequisite(s): None