Markov Chains & Steady States - Linear Algebra
- What is the steady-state vector of the column-stochastic matrix ?
- . gives .
- What is the steady-state vector of the column-stochastic matrix ?
- . gives , so .
- With and , what is ?
- , the first column of .
- In a column-stochastic matrix with , what does entry represent?
- The probability of moving from state to state in one step.
- What is a column-stochastic (transition) matrix?
- A square matrix with nonnegative entries in which every column sums to .
- What makes a stochastic matrix regular?
- Some power has all entries strictly positive.
- What is a steady-state vector of a stochastic matrix ?
- A probability vector with , that is, an eigenvector for eigenvalue scaled so its entries sum to .
- What are the eigenvalues of the column-stochastic matrix ?
- and . One eigenvalue is , and they sum to the trace .
- For a regular stochastic matrix , what happens to as grows?
- It converges to the unique steady-state vector, whatever probability vector is.
- What is a probability vector?
- A vector with nonnegative entries that sum to .
- Why does every column-stochastic matrix have eigenvalue ?
- Each column sums to , so is an eigenvector of for , and has the same eigenvalues as .
- With and , what happens to ?
- It alternates between and and never converges; is not regular.