Martingales and Markov chains: solved exercises and theory Laurent Mazliak, Paolo Baldi, Pierre Priouret
Publisher: Chapman & Hall

Interestingly Steele's website mentions plans for a problem/solution book. Markov chain pattern distribution theory. With important developments in both theory and applications coming at an accelerating . Exit problems for Markov processes. 3.5.4 Applying the EM algorithm to a hidden Markov chain . Exercise [1.6] shows that an important type of stochastic process, the “moving . The course will cover basic technology platforms, data analysis problems and . He also mentions this book: Martingales and Markov Chains: Solved Exercises and Elements of Theory, Baldi et al. Dr Dalia Chakrabarty, Solving puzzles within Astrophysics, and using numerical and statistical algorithms. Brownian motion, martingales, introduction to stochastic integrals, and their applications. Duality and time-change problems. Stochastic processes (martingale theory and SDEs with jumps) . Markov chains: transition probabilities, stationary distributions, convergence. Dr Sigurd Assing, Probability theory, random processes, stochastic analysis, statistical mechanics and stochastic simulation. Fine properties of diffusions and Lévy processes. The emphasis is on data analysis and visualizationinstead of theory.