Introduction to Machine Learning

Ruye Wang is an Emeritus Professor of Engineering at Harvey Mudd College, with over thirty years of experience in teaching courses in Engineering and Computer Science. Previously a Principal Investigator at the Jet Propulsion Laboratory, NASA, his research interests include image processing, computer vision, machine learning and remote sensing. He is the author of the textbook Introduction to Orthogonal Transforms (2012).

• Part I. Mathematical Foundations: 1. Solving Equations; 2. Unconstrained Optimization; 3. Constrained Optimization; Part II. Regression: 4. Bias-Variance Tradeoff and Overfitting vs Underfitting; 5. Linear Regression; 6. Nonlinear Regression; 7. Logistic and Softmax Regression; 8. Gaussian Process Regression and Classification; Part III. Feature Extraction: 9. Feature Selection; 10. Principal Component Analysis; 11. Variations of PCA; 12. Independent Component Analysis; Part IV. Classification: 13. Statistic Classification; 14. Support Vector machine; 15. Clustering Analysis; 16. Hierarchical Classifiers; 17. Biologically Inspired Networks; 18. Perceptron-Based Networks; 19. Competition-Based Networks; Part VI. Reinforcement Learning: 20. Introduction to Reinforcement Learning; Part VII. Large Language Models: 21. Large Language Models; Appendix A. A Review of Linear Algebra; Appendix B. A Review of Probability and Statistics.

'This book provides clear explanations of fundamental machine learning algorithms alongside practical implementations in both Python and MATLAB. It also offers a brief introduction to modern deep learning techniques, making it an excellent resource for senior undergraduates, graduate students, and aspiring researchers.' Jiang Li, Old Dominion University