MIT 6.262 Discrete Stochastic Processes - Lecture 17: Countable-state Markov Chains
Lecture 17: Countable-state Markov Chains
Instructor: Prof. Robert Gallager
In this lecture, the professor covers topics such as positive-recurrence and null-recurrence, steady-state for positive-recurrent irreducible Markov chains, birth-death chains, and reversibility.
View the complete course: http://ocw.mit.edu/6-262S11
Robert Gallager and MIT OpenCourseWare