Markov Chains with Asymptotically Zero Drift

Denis Denisov is Reader in Probability in the Department of Mathematics at the University of Manchester. His research interests include multidimensional random walks, ordered and conditioned random walks, Markov chains and diffusion processes. Dmitry Korshunov is Professor in the School of Mathematical Sciences at Lancaster University. He is an expert in stochastic processes, Markov chains, large deviation theorems, heavy tail phenomena, and limit theorems. He previously co-authored An Introduction to Heavy-Tailed and Subexponential Distributions (2011, 2013). Vitali Wachtel is Professor for Mathematics at the University of Bielefeld. His research interests include, besides Markov chains, exit times and conditional distributions for multidimensional random walks, branching processes and large deviations.

• 1. Introduction; 2. Lyapunov functions and classification of Markov chains; 3. Down-crossing probabilities for transient Markov chain; 4. Limit theorems for transient and null-recurrent Markov chains with drift proportional to 1/x; 5. Limit theorems for transient Markov chains with drift decreasing slower than 1/x; 6. Asymptotics for renewal measure for transient Markov chain via martingale approach; 7. Doob's h-transform: transition from recurrent to transient chain and vice versa; 8. Tail analysis for recurrent Markov chains with drift proportional to 1/x; 9. Tail analysis for positive recurrent Markov chains with drift going to zero slower than 1/x; 10. Markov chains with asymptotically non-zero drift in Cramér's case; 11. Applications.