This book is for a first course in stochastic processes taken by undergraduates or master’s students who have had a course in probability theory. It covers Markov chains in discrete and con