Foundations of Reinforcement Learning with Applications in Finance

Inbunden, Engelska, 2022

Av Ashwin Rao, Tikhon Jelvis, USA) Rao, Ashwin (Stanford University

1 449 kr

Beställningsvara. Skickas inom 7-10 vardagar

Fri frakt för medlemmar vid köp för minst 249 kr.

Foundations of Reinforcement Learning with Applications in Finance aims to demystify Reinforcement Learning, and to make it a practically useful tool for those studying and working in applied areas — especially finance.Reinforcement Learning is emerging as a powerful technique for solving a variety of complex problems across industries that involve Sequential Optimal Decisioning under Uncertainty. Its penetration in high-profile problems like self-driving cars, robotics, and strategy games points to a future where Reinforcement Learning algorithms will have decisioning abilities far superior to humans. But when it comes getting educated in this area, there seems to be a reluctance to jump right in, because Reinforcement Learning appears to have acquired a reputation for being mysterious and technically challenging.This book strives to impart a lucid and insightful understanding of the topic by emphasizing the foundational mathematics and implementing models and algorithms in well-designed Python code, along with robust coverage of several financial trading problems that can be solved with Reinforcement Learning. This book has been created after years of iterative experimentation on the pedagogy of these topics while being taught to university students as well as industry practitioners.Features Focus on the foundational theory underpinning Reinforcement Learning and software design of the corresponding models and algorithmsSuitable as a primary text for courses in Reinforcement Learning, but also as supplementary reading for applied/financial mathematics, programming, and other related coursesSuitable for a professional audience of quantitative analysts or data scientistsBlends theory/mathematics, programming/algorithms and real-world financial nuances while always striving to maintain simplicity and to build intuitive understandingTo access the code base for this book, please go to: https://github.com/TikhonJelvis/RL-book

Produktinformation

Utgivningsdatum2022-12-16
Mått178 x 254 x 35 mm
Vikt1 300 g
FormatInbunden
SpråkEngelska
SerieChapman & Hall/CRC Mathematics and Artificial Intelligence Series
Antal sidor500
FörlagTaylor & Francis Ltd
ISBN9781032124124

Tillhör följande kategorier

Tillämpad matematik inom Naturvetenskap och teknik
Programvaruutveckling inom Data och it
Programspråk inom Data och it
Elektronik och kommunikationer inom Naturvetenskap och teknik
Artificiell intelligens inom Data och it
Finansiering inom Ekonomi och ledarskap

Ashwin Rao is the Chief Science Officer of Wayfair, an e-commerce company where he and his team develop mathematical models and algorithms for supply-chain and logistics, merchandising, marketing, search, personalization, pricing and customer service. Ashwin is also an Adjunct Professor at Stanford University, focusing his research and teaching in the area of Stochastic Control, particularly Reinforcement Learning algorithms with applications in Finance and Retail. Previously, Ashwin was a Managing Director at Morgan Stanley and a Trading Strategist at Goldman Sachs. Ashwin holds a Bachelor’s degree in Computer Science and Engineering from IIT-Bombay and a Ph.D in Computer Science from University of Southern California, where he specialized in Algorithms Theory and Abstract Algebra.Tikhon Jelvis is a programmer who specializes in bringing ideas from programming languages and functional programming to machine learning and data science. He has developed inventory optimization, simulation and demand forecasting systems as a Principal Scientist at Target and is a speaker and open-source contributor in the Haskell community where he serves on the board of directors for Haskell.org.

Section I. Processes and Planning Algorithms. 1. Markov Processes. 2. Markov Decision Processes. 3. Dynamic Programming Algorithms. 4. Function Approximation and Approximate Dynamic Programming. Section II. Modeling Financial Applications. 5. Utility Theory. 6. Dynamic Asset-Allocation and Consumption. 7. Derivatives Pricing and Hedging. 8. Order-Book Trading Algorithms. Section III. Reinforcement Learning Algorithms. 9. Monte-Carlo and Temporal-Difference for Prediction. 10. Monte-Carlo and Temporal-Difference for Control. 11. Batch RL, Experience-Replay, DQN, LSPI, Gradient TD. 12. Policy Gradient Algorithms. Section IV. Finishing Touches. 13. Multi-Armed Bandits: Exploration versus Exploitation. 14. Blending Learning and Planning. 15. Summary and Real-World Considerations. Appendices.

“This book is a nice addition to the literature on Reinforcement Learning (RL), offering comprehensive coverage of both foundational RL techniques and their applications in the field of finance. It has the potential to be a foundational reference for both practitioners and researchers in finance. The book delves into essential RL concepts such as Markov Decision Processes (MDPs), Dynamic Programming, Policy Optimization, Actor-Critic models, Multi-armed Bandits, and Regret Bounds.Despite its finance-oriented approach, individuals without an extensive financial background but possessing a decent machine learning (ML) background will find it easy to read this book.By encompassing all of the major asset classes including equities, fixed income and derivatives, the book caters to a broad range of readers, enabling them to apply RL techniques to diverse financial scenarios. In summary, this book is an outstanding resource that combines RL fundamentals with practical applications in finance.”– Natesh Pillai, Department of Statistics, Harvard University, Unites States of America