Lecture 17: Markov Chains - II

OCW Scholar

« Previous | Next »

Lecture Topics

  • Review
  • Steady-state behavior
    • Steady-state convergence theorem
    • Balance equations
  • Birth-death process

Lecture Activities

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

Problem Set and Solutions

Work the problems on your own and check your answers when you're done. Problem set 8 covers Lectures 16 and 17.

« Previous | Next »