Przemyslaw Biecek is a professor in human-oriented machine learning at the Warsaw University of Technology and Principal Data Scientist in Samsung R&D Institute Poland. His main research project is DrWhy.AI - tools and methods for exploration, explanation, visualisation, and debugging of predictive models. Tomasz Burzykowski is professor of biostatistics at Hasselt University and Vice-President for Research at International Drug Development Institute (IDDI). He has published extensively on applications of statistics in medicine and biology.

• I. Introduction 1. Introduction. 2. Model Development. 3. Do-it-yourself. 4. Datasets and models. II. Instance Level. 5. Introduction to Instance-level Exploration. 6. Break-down Plots for Additive Attributions. 7. Break-down Plots for Interactions. 8. Shapley Additive Explanations (SHAP) for Average Attributions. 9. Local Interpretable Model-agnostic Explanations (LIME). 10. Ceteris-paribus Profiles. 11. Ceteris-paribus Oscillations. 12. Local-diagnostics Plots. 13. Summary of Instance-level Exploration. III. Dataset Level. 14. Introduction to Dataset-level Exploration. 15. Model-performance Measures. 16. Variable-importance Measures. 17. Partial-dependence Profiles. 18. Local-dependence and Accumulated-dependence Profiles. 19. Residual Diagnostics Plots. 20. Summary of Model-level Exploration. IV. Use-cases. 21. FIFA 19.

"The structure is well-conceived, with chapters consisting in five sections: intuition, method, example, pros and cons, and code snippets. I sense a teacher’s long experience behind these choices.The chapters contain good mathematical detail on the techniques discussed, but the theory is well balanced with examples and code.The visualizations are great. Often, the gist of a particular technique, and it’s practical, interpretive value, can be gleaned from the visualizations threading through the chapter, along with captions. The authors did a really nice job with this.The rationale for the book is well-described.The discussion of techniques seems both comprehensive (given my sense of the field) and helpfully specific, both at the instance and the dataset levels."-Jeff Webb, University of Utah"The authors are doing a very good job in addressing the potential readers, by providing a clean presentation and practical guidance on diagnostic graphical tools…Having an ‘intuition section’ at the beginning of each chapter is very useful."-Riccardo De Bin, University of Oslo"The book provides a unified presentation of model exploration, visualization, comparison and diagnostics of different machine learning algorithms…This book would be found useful by both students as well as practitioners who analyze their own data. Books including real data examples in R and in Python are needed in this area. (It) will serve as a reference, especially for analyses done with dalex or archivist R package (and )can serve as a textbook of data science courses in many fields including computer science, social sciences, economics and other."-Patricia Martinkova, Institute of Computer Science of the Czech Academy of Sciences"There are books that focus on prediction models, for example the element of statistical learning and an introduction to statistical learning but these are not focused on the evaluation of predictive models which is the main focus on the proposed book and its main advantage. As predictive models become very popular in the last years, such a book that focus on the evaluation of the models and model diagnostics can be very popular."-Ziv Shkedy, Data Science Institute, Hasselt University, Belgium'The book is clearly and consistently structured and well–written. The graphics are explained conceptually and mathematically. There are chapter sections on the pros and cons of what is proposed, where the authors are generally properly cautious and recommend a mixture of approaches.'- Antony Unwin, International Statistical Review, 2021 Volume 89, Issue 3

Przemyslaw Biecek is a professor in human-oriented machine learning at the Warsaw University of Technology and Principal Data Scientist in Samsung R&D Institute Poland. His main research project is DrWhy.AI - tools and methods for exploration, explanation, visualisation, and debugging of predictive models. Tomasz Burzykowski is professor of biostatistics at Hasselt University and Vice-President for Research at International Drug Development Institute (IDDI). He has published extensively on applications of statistics in medicine and biology.

• I. Introduction 1. Introduction. 2. Model Development. 3. Do-it-yourself. 4. Datasets and models. II. Instance Level. 5. Introduction to Instance-level Exploration. 6. Break-down Plots for Additive Attributions. 7. Break-down Plots for Interactions. 8. Shapley Additive Explanations (SHAP) for Average Attributions. 9. Local Interpretable Model-agnostic Explanations (LIME). 10. Ceteris-paribus Profiles. 11. Ceteris-paribus Oscillations. 12. Local-diagnostics Plots. 13. Summary of Instance-level Exploration. III. Dataset Level. 14. Introduction to Dataset-level Exploration. 15. Model-performance Measures. 16. Variable-importance Measures. 17. Partial-dependence Profiles. 18. Local-dependence and Accumulated-dependence Profiles. 19. Residual Diagnostics Plots. 20. Summary of Model-level Exploration. IV. Use-cases. 21. FIFA 19.

"The structure is well-conceived, with chapters consisting in five sections: intuition, method, example, pros and cons, and code snippets. I sense a teacher’s long experience behind these choices.The chapters contain good mathematical detail on the techniques discussed, but the theory is well balanced with examples and code.The visualizations are great. Often, the gist of a particular technique, and it’s practical, interpretive value, can be gleaned from the visualizations threading through the chapter, along with captions. The authors did a really nice job with this.The rationale for the book is well-described.The discussion of techniques seems both comprehensive (given my sense of the field) and helpfully specific, both at the instance and the dataset levels."-Jeff Webb, University of Utah"The authors are doing a very good job in addressing the potential readers, by providing a clean presentation and practical guidance on diagnostic graphical tools…Having an ‘intuition section’ at the beginning of each chapter is very useful."-Riccardo De Bin, University of Oslo"The book provides a unified presentation of model exploration, visualization, comparison and diagnostics of different machine learning algorithms…This book would be found useful by both students as well as practitioners who analyze their own data. Books including real data examples in R and in Python are needed in this area. (It) will serve as a reference, especially for analyses done with dalex or archivist R package (and )can serve as a textbook of data science courses in many fields including computer science, social sciences, economics and other."-Patricia Martinkova, Institute of Computer Science of the Czech Academy of Sciences"There are books that focus on prediction models, for example the element of statistical learning and an introduction to statistical learning but these are not focused on the evaluation of predictive models which is the main focus on the proposed book and its main advantage. As predictive models become very popular in the last years, such a book that focus on the evaluation of the models and model diagnostics can be very popular."-Ziv Shkedy, Data Science Institute, Hasselt University, Belgium'The book is clearly and consistently structured and well–written. The graphics are explained conceptually and mathematically. There are chapter sections on the pros and cons of what is proposed, where the authors are generally properly cautious and recommend a mixture of approaches.'- Antony Unwin, International Statistical Review, 2021 Volume 89, Issue 3

Przemyslaw Biecek is a professor in human-oriented machine learning at the Warsaw University of Technology and Principal Data Scientist in Samsung R&D Institute Poland. His main research project is DrWhy.AI - tools and methods for exploration, explanation, visualisation, and debugging of predictive models. Tomasz Burzykowski is professor of biostatistics at Hasselt University and Vice-President for Research at International Drug Development Institute (IDDI). He has published extensively on applications of statistics in medicine and biology.

• I. Introduction 1. Introduction. 2. Model Development. 3. Do-it-yourself. 4. Datasets and models. II. Instance Level. 5. Introduction to Instance-level Exploration. 6. Break-down Plots for Additive Attributions. 7. Break-down Plots for Interactions. 8. Shapley Additive Explanations (SHAP) for Average Attributions. 9. Local Interpretable Model-agnostic Explanations (LIME). 10. Ceteris-paribus Profiles. 11. Ceteris-paribus Oscillations. 12. Local-diagnostics Plots. 13. Summary of Instance-level Exploration. III. Dataset Level. 14. Introduction to Dataset-level Exploration. 15. Model-performance Measures. 16. Variable-importance Measures. 17. Partial-dependence Profiles. 18. Local-dependence and Accumulated-dependence Profiles. 19. Residual Diagnostics Plots. 20. Summary of Model-level Exploration. IV. Use-cases. 21. FIFA 19.

"The structure is well-conceived, with chapters consisting in five sections: intuition, method, example, pros and cons, and code snippets. I sense a teacher’s long experience behind these choices.The chapters contain good mathematical detail on the techniques discussed, but the theory is well balanced with examples and code.The visualizations are great. Often, the gist of a particular technique, and it’s practical, interpretive value, can be gleaned from the visualizations threading through the chapter, along with captions. The authors did a really nice job with this.The rationale for the book is well-described.The discussion of techniques seems both comprehensive (given my sense of the field) and helpfully specific, both at the instance and the dataset levels."-Jeff Webb, University of Utah"The authors are doing a very good job in addressing the potential readers, by providing a clean presentation and practical guidance on diagnostic graphical tools…Having an ‘intuition section’ at the beginning of each chapter is very useful."-Riccardo De Bin, University of Oslo"The book provides a unified presentation of model exploration, visualization, comparison and diagnostics of different machine learning algorithms…This book would be found useful by both students as well as practitioners who analyze their own data. Books including real data examples in R and in Python are needed in this area. (It) will serve as a reference, especially for analyses done with dalex or archivist R package (and )can serve as a textbook of data science courses in many fields including computer science, social sciences, economics and other."-Patricia Martinkova, Institute of Computer Science of the Czech Academy of Sciences"There are books that focus on prediction models, for example the element of statistical learning and an introduction to statistical learning but these are not focused on the evaluation of predictive models which is the main focus on the proposed book and its main advantage. As predictive models become very popular in the last years, such a book that focus on the evaluation of the models and model diagnostics can be very popular."-Ziv Shkedy, Data Science Institute, Hasselt University, Belgium'The book is clearly and consistently structured and well–written. The graphics are explained conceptually and mathematically. There are chapter sections on the pros and cons of what is proposed, where the authors are generally properly cautious and recommend a mixture of approaches.'- Antony Unwin, International Statistical Review, 2021 Volume 89, Issue 3