This module studies discrete-time Markov chains, as well as introducing the most basic continuous-time processes. The basic theory for these stochastic processes is considered in detail. This includes the Chapman Kolmogorov equation, communication of states, periodicity, recurrence and transience properties, asymptotic behaviour, limiting and stationary distributions, and an introduction to Poisson processes. Applications in different areas, in particular in insurance, are considered.