DevOps

Len Bass is a senior principal researcher at National ICT Australia Ltd. (NICTA). He joined NICTA in 2011 after 25 years at the Software Engineering Institute (SEI) at Carnegie Mellon University. He is the coauthor of two award-winning books in software architecture—Software Architecture in Practice, Third Edition (Addison-Wesley 2013) and Documenting Software Architectures: Views and Beyond, Second Edition (Addison-Wesley 2011)—as well as several other books and numerous papers in computer science and software engineering on a wide range of topics. Len has more than 50 years’ experience in software development and research, which has resulted in papers on operating systems, database man­agement systems, user interface software, software architecture, product line sys­tems, and computer operations. He has worked or consulted in multiple domains, including scientific analysis, embedded systems, and information and financial systems.  Ingo Weber is a senior researcher in the Software Systems Research Group at NICTA in Sydney, Australia, as well as an adjunct senior lecturer at CSE at the University of New South Wales (UNSW). Prior to NICTA, Ingo held posi­tions at UNSW and at SAP Research Karlsruhe, Germany. His research interests include cloud computing, DevOps, business process management, and artificial intelligence (AI). He has published over 60 peer-reviewed papers, and served as a reviewer or program committee member for many prestigious scientific jour­nals and conferences. Ingo holds a Ph.D. and a Diploma from the University of Karlsruhe, and an MSc from the University of Massachusetts at Amherst.  Liming Zhu is a research group leader and principal researcher at NICTA. He holds conjoint positions at the University of New South Wales (UNSW) and the University of Sydney. Liming has published over 80 peer-reviewed papers. He formerly worked in several technology lead positions in the software industry before obtaining a Ph.D. in software engineering from UNSW. He is a committee member of the Standards Australia IT-015 (system and software engineering), contributing to ISO/SC7. Liming’s research interests include software architec­ture and dependable systems.

• Preface xiPreviewing the Book xiiiAcknowledgments xvLegend xvii  Part I: Background 1  Chapter 1: What Is DevOps? 31.1 Introduction 31.2 Why DevOps? 71.3 DevOps Perspective 111.4 DevOps and Agile 121.5 Team Structure 131.6 Coordination 171.7 Barriers 201.8 Summary 231.9 For Further Reading 24  Chapter 2: The Cloud as a Platform 272.1 Introduction 272.2 Features of the Cloud 292.3 DevOps Consequences of the Unique Cloud Features 412.4 Summary 442.5 For Further Reading 45  Chapter 3: Operations 473.1 Introduction 473.2 Operations Services 473.3 Service Operation Functions 573.4 Continual Service Improvement 583.5 Operations and DevOps 593.6 Summary 613.7 For Further Reading 61  Part II: The Deployment Pipeline 63  Chapter 4: Overall Architecture 654.1 Do DevOps Practices Require Architectural Change? 654.2 Overall Architecture Structure 664.3 Quality Discussion of Microservice Architecture 724.4 Amazon’s Rules for Teams 754.5 Microservice Adoption for Existing Systems 764.6 Summary 774.7 For Further Reading 78  Chapter 5: Building and Testing 795.1 Introduction 795.2 Moving a System Through the Deployment Pipeline 815.3 Crosscutting Aspects 845.4 Development and Pre-commit Testing 865.5 Build and Integration Testing 915.6 UAT/Staging/Performance Testing 955.7 Production 965.8 Incidents 985.9 Summary 985.10 For Further Reading 99  Chapter 6: Deployment 1016.1 Introduction 1016.2 Strategies for Managing a Deployment 1026.3 Logical Consistency 1056.4 Packaging 1116.5 Deploying to Multiple Environments 1146.6 Partial Deployment 1176.7 Rollback 1186.8 Tools 1216.9 Summary 1216.10 For Further Reading 122  Part III: Crosscutting Concerns 125  Chapter 7: Monitoring 1277.1 Introduction 1277.2 What to Monitor 1297.3 How to Monitor 1347.4 When to Change the Monitoring Configuration 1397.5 Interpreting Monitoring Data 1397.6 Challenges 1437.7 Tools 1477.8 Diagnosing an Anomaly from Monitoring Data–the Case of Platformer.com 1487.9 Summary 1527.10 For Further Reading 153  Chapter 8: Security and Security Audits 1558.1 What Is Security? 1568.2 Threats 1578.3 Resources to Be Protected 1598.4 Security Roles and Activities 1628.5 Identity Management 1658.6 Access Control 1698.7 Detection, Auditing, and Denial of Service 1728.8 Development 1738.9 Auditors 1748.10 Application Design Considerations 1758.11 Deployment Pipeline Design Considerations 1768.12 Summary 1778.13 For Further Reading 178  Chapter 9: Other Ilities 1819.1 Introduction 1819.2 Repeatability 1839.3 Performance 1869.4 Reliability 1889.5 Recoverability 1909.6 Interoperability 1919.7 Testability 1929.8 Modifiability 1949.9 Summary 1959.10 For Further Reading 196  Chapter 10: Business Considerations 19710.1 Introduction 19710.2 Business Case 19710.3 Measurements and Compliance to DevOps Practices 20610.4 Points of Interaction Between Dev and Ops 20910.5 Summary 21110.6 For Further Reading 211  Part IV: Case Studies 213  Chapter 11: Supporting Multiple Datacenters 21511.1 Introduction 21511.2 Current State 21611.3 Business Logic and Web Tiers 21611.4 Database Tier 22011.5 Other Infrastructure Tools 22311.6 Datacenter Switch 22511.7 Testing 23211.8 Summary 23311.9 For Further Reading 234  Chapter 12: Implementing a Continuous Deployment Pipeline for Enterprises 23712.1 Introduction 23712.2 Organizational Context 23812.3 The Continuous Deployment Pipeline 24012.4 Baking Security into the Foundations of the CD Pipeline 25712.5 Advanced Concepts 25912.6 Summary 26112.7 For Further Reading 262  Chapter 13: Migrating to Microservices 26313.1 Introduction to Atlassian 26313.2 Building a Platform for Deploying Microservices 26513.3 BlobStore: A Microservice Example 26813.4 Development Process 27313.5 Evolving BlobStore 27913.6 Summary 28413.7 For Further Reading 284  Part V: Moving into the Future 285  Chapter 14: Operations as a Process 28714.1 Introduction 28714.2 Motivation and Overview 28814.3 Offline Activities 28914.4 Online Activities 29414.5 Error Diagnosis 29614.6 Monitoring 29614.7 Summary 29814.8 For Further Reading 298  Chapter 15: The Future of DevOps 29915.1 Introduction 29915.2 Organizational Issues 30015.3 Process Issues 30215.4 Technology Issues 30515.5 What About Error Reporting and Repair? 30915.6 Final Words 31015.7 For Further Reading 310  References 311About the Authors 315Index 317