Cloud Computing Solutions

Souvik Pal is an associate professor in the Department of Computer Science and Engineering at Sister Nivedita University (Techno India Group), Kolkata, India. He has edited about 15 books and published numerous articles in research journals. His research area includes cloud computing, big data, internet of things, wireless sensor network, and data analytics.Dac-Nhuong Le obtained his PhD in computer science from Vietnam National University, Vietnam in 2015. He is Deputy-Head of the Faculty of Information Technology, Haiphong University, Vietnam. His area of research includes evaluation computing and approximate algorithms, network communication, security and vulnerability, network performance analysis and simulation, cloud computing, IoT, and image processing in biomedicine. He has more than 50 publications and edited/authored 15 computer science books. Prasant Kumar Pattnaik, PhD is a professor at the School of Computer Engineering, KIIT Deemed to be University, Bhubaneswar, India. He has published many research papers in peer-reviewed international journals and conferences and has authored many computer science books in the fields of data mining, robotics, graph theory, Turing machine, cryptography, security solutions in cloud computing, mobile computing, and privacy preservation.

• List of Figures xviiList of Tables xixForeword xxiPreface xxiiiAcknowledgments xxvAcronyms xxviiPart I: Cloud Computing Architecture 11 Basics of Cloud Computing 3Souvik Pal, Dac-Nhuong Le, Prasant Kumar Pattnaik1.1 Evolution of Cloud Computing 41.2 Cluster Computing 71.2.1 The Architecture of Cluster Computing Environment 71.2.2 Components of Computer Cluster 81.3 Grid Computing 91.3.1 Grid-Related Technologies 101.3.2 Levels of Deployment 111.3.3 Architecture of Grid Computing Environment 131.4 Mobile Computing 161.4.1 Characteristics of Mobile Computing 171.4.2 Characteristics of Mobile Networks 171.5 Summary 18Exercises 18References 192 Introduction to Cloud Computing 21Souvik Pal, Dac-Nhuong Le, Prasant Kumar Pattnaik2.1 Definition of Cloud Computing 222.2 Characteristics of Cloud 222.2.1 Elasticity and Scalability 232.2.2 Metered and Billing of Service 232.2.3 Self-Service Allocation of Resources 232.2.4 Application Programming Interface (APIs) 242.2.5 Efficiency Measurement Service 242.2.6 Device and Location Interdependency 242.2.7 Customization 242.2.8 Security 252.3 Cloud Computing Environment 252.3.1 Access to Supporting Business Agility 252.3.2 Minimizing Investment Expenditures 252.3.3 Public Cloud Computing Environment 252.3.4 Private Cloud Computing Environment 262.3.5 Hybrid Cloud Computing Environment 272.3.6 Community Cloud Computing Environment 272.4 Cloud Services 282.4.1 Resources as a Service (RaaS) 282.4.2 Infrastructure as a Service (IaaS) 282.4.3 Platform as a Service (PaaS) 292.4.4 Software as a Service (SaaS) 302.4.5 Network as a Service (NaaS) 312.4.6 Desktop as a Service (DaaS/VDI) 322.4.7 Recovery as a Service (DRaaS) 322.5 Security Paradigms and Issues of Cloud Computing 322.6 Major Cloud Service Providers 332.6.1 IaaS CSPs 332.6.2 PaaS CSPs 352.6.3 SaaS CSPs 352.7 Summary 35Exercises 36References 373 Architectural Framework for Cloud Computing 39Souvik Pal, Dac-Nhuong Le, Prasant Kumar Pattnaik3.1 Challenges of Cloud Computing Environment 403.2 Architectural Framework for Cloud Computing 413.2.1 Service-Oriented Architecture (SOA) 413.2.2 SOA Characterization 423.2.3 Life Cycle of Services in SOA 433.2.4 Integrating SOA and the Cloud 453.2.5 Cloud Architecture 463.3 Architectural Workflow and Co-ordination of Multiple Activities 493.3.1 Characteristics of Workflow 503.3.2 Need for Workflow 503.4 Examples of Workflow Tools 523.5 Summary 53Exercises 53References 544 Virtualization Environment in Cloud Computing 57Souvik Pal, Dac-Nhuong Le, Prasant Kumar Pattnaik4.1 Introduction 584.1.1 Need of Virtualization in Cloud Computing Environment 584.1.2 Virtualization versus Traditional Approach 584.2 Virtualization and Virtual Machine 594.2.1 Advantages of Virtualization Technique in Cloud Computing Environment 604.2.2 Category of Virtual Machine 614.3 Virtualization Model for Cloud Computing 644.3.1 Distributed Resources of Physical Hosts 654.3.2 Hypervisor Monitoring Environment (HME) 654.3.3 Platform Service 664.3.4 Software Service 664.3.5 Broker Service 674.3.6 Business Service 674.4 Categorization of Guest OS Virtualization Techniques 684.4.1 Full Virtualization 684.4.2 Paravirtualization 694.4.3 Hardware-Assisted Virtualization 704.5 Mapping Technique of Virtual Machine to Physical Machine in a Private Cloud 714.6 Drawbacks of Virtualization 724.7 Summary 73Exercises 74References 755 Classification of Virtualization Environment 77Souvik Pal, Dac-Nhuong Le, Prasant Kumar Pattnaik5.1 Introduction 785.2 Classification 785.2.1 Scheduling-Based Environment 795.2.2 Load Distribution-Based Environment 805.2.3 Energy-Aware-Based Environment 815.2.4 Operational-Based Environment 825.2.5 Distribution Pattern-Based Environment 855.2.6 Transaction-Based Environment 865.3 Summary 87Exercises 87References 88Part II: Cloud Computing Data Storage 916 An Approach to Live Migration of Virtual Machines in Cloud Computing Environment 93Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik6.1 Introduction 946.2 Need of Live Migration of Virtual Machine 946.3 Advantages of Live Migration 946.4 A Design Approach to Live Migration 956.4.1 Live Migration Process 976.5 Security Issues 996.5.1 Possible Attacks 996.5.2 Solutions 1006.6 Summary 100Exercises 100References 1017 Reliability Issues in Cloud Computing Environment 103Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik7.1 Introduction 1047.1.1 Research Problem Statement 1057.1.2 Research Aim 1057.1.3 Research Question 1057.2 Literature Review 1067.2.1 Cloud Service Models 1077.2.2 Elements of Reliable Cloud Computing 1087.2.3 Cloud Computing Gaps and Concerns 1097.2.4 Trends in Cloud Computing 1107.3 Reliability Issues in Cloud Computing Research 1117.3.1 Research Methodology 1117.3.2 Research Strategy 1117.3.3 Data Collection 1127.3.4 Sampling 1127.3.5 Data Analysis and Findings 1127.4 Findings 1147.4.1 Lack of Effort to Address Reliability and Availability Issues 1147.4.2 Performance Issues 1157.4.3 Privacy Issues 1157.5 Summary 115Exercises 116References 1168 Cloud Database 123Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik8.1 Introduction 1248.2 Non-Relational Data Models 1248.2.1 Transactions in Cloud Databases 1258.2.2 Advantages of Cloud Database 1258.3 Heterogeneous Databases in DaaS 1268.3.1 Relational and Non-Relational Database 1268.3.2 Centralized and Distributed Database 1268.3.3 Structured and Unstructured Database 1278.3.4 Infrastructure-Based and Infrastructureless Databases 1278.3.5 SQL-Based and NoSQL-Based Databases 1288.4 Study of a Document-Oriented Cloud Database - MongoDB 1298.4.1 Data Model 1298.4.2 Replication 1298.4.3 Sharding 1308.4.4 Architecture 1318.4.5 Consistency 1328.4.6 Failure Handling 1328.5 CAP Theorem for Cloud Database Transaction 1328.6 Issues in Live Migration of Databases in Cloud 1338.7 Cloud Database Classification Based on Transaction Processing 1348.7.1 ACID-Based Cloud Database 1348.7.2 NoACID-Based Cloud Database 1358.8 Commercially Available Cloud Database Platform 1368.8.1 Amazon Web Services 1378.8.2 Microsoft Windows Azure 1388.8.3 Google App Engine 1388.9 Summary 138Exercises 138References 1409 Cloud-Based Data Storage 143Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik9.1 Relevant Hadoop Tools 1449.2 Hadoop Distributed File System (HDFS) 1459.2.1 HDFS Architecture 1459.2.2 Data Read Process in HDFS 1469.2.3 Data Write Process in HDFS 1479.2.4 Authority Management of HDFS 1489.2.5 Limitations of HDFS 1489.3 Data Mining Challenges with Big Data 1499.4 MapReduce 1519.4.1 MapReduce Architecture 1519.4.2 MapReduce Procedure 1529.4.3 Limitations of MapReduce 1539.5 Next Generation of MapReduce: YARN 1549.5.1 YARN Compared to MapReduce 1.0 (MRv1) 1559.5.2 YARN and MapReduce 2.0 (MRv2) 1569.5.3 YARN Architecture 1569.5.4 Advantages of YARN 1599.6 Classification of Data Mining Systems 1609.6.1 Classification According to Kind of Databases Mined 1609.6.2 Classification According to Kind of Knowledge Mined 1609.6.3 Classification According to Kind of Techniques Utilized 1619.6.4 Classification According to the Applications Adapted 1619.7 Summary 162Exercises 162References 16310 Auditing Concept in Cloud Computing 165Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik10.1 Introduction 16610.2 Data Security in Cloud Computing Environment 16610.2.1 Characteristics of a Secure Cloud Computing Environment 16610.2.2 Need for Auditing in Cloud Computing Environment 16710.2.3 Auditing Background Within Third-Party Service Provider 16710.3 Cloud Auditing Outsourcing Life Cycle Phases 16710.4 Auditing Classification 16810.5 Auditing Service 16910.5.1 How Third-Party Service Provider is Enabling Auditing Service 17110.5.2 Auditing Process Analysis 17110.5.3 Privacy and Integrity 17410.5.4 Cloud-Auditing Architecture Analysis 17610.6 Summary 177Exercises 178References 178Part III: Cloud Computing Implementation, Security and Applications 18111 Security Paradigms in Cloud Computing 183Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal11.1 Security Paradigms and Issues 18411.2 Cloud Security Challenges 18511.3 Cloud Economics 18711.4 Security of Big Data in Cloud 18711.4.1 The Biggest Risk: Data Breach 18811.4.2 Data Loss 18811.4.3 Account or Service Traffic Hijacking 18911.4.4 Insecure Interfaces and APIs 18911.4.5 Denial of Service 19011.4.6 Malicious Insiders 19011.4.7 Abuse of Cloud Users 19011.4.8 Inadequate Due Diligence 19111.4.9 Vulnerabilities in Shared Technology 19111.5 Security as a Service in Cloud 19111.6 Summary 194Exercises 194References 19512 Privacy Preservation Issues in Cloud Computing 197Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal12.1 Privacy Issues in Cloud Storage 19812.1.1 Encryption Methods 19812.1.2 Access Control Mechanisms 19912.1.3 Query Integrity/Keyword Searches 20012.1.4 Auditability Schemes 20012.2 Privacy and Security 20112.2.1 Performance Unpredictability, Latency and Reliability 20212.2.2 Portability and Interoperability 20312.2.3 Data Breach Through Fiber-Optic Networks 20412.2.4 Data Storage over IP Networks 20412.2.5 Data Storage and Security in Cloud 20512.3 Threats to Security in Cloud Computing 20812.3.1 Basic Security 20812.3.2 Network-Level Security 20912.3.3 Application-Level Security 21112.4 Security Issues in Cloud Deployment Models 21512.4.1 Security Issues in a Public Cloud 21512.4.2 Security Issues in a Private Cloud 21612.5 Ensuring Security Against Various Types of Attacks 21712.6 Survey of Privacy Preservation Using Fuzzy Set and Genetic Algorithm 21912.6.1 Fuzzy-Based Approach for Privacy-Preserving Publication of Data 21912.6.2 Privacy-Preserving Fuzzy Association Rules Hiding in Quantitative Data 22012.6.3 A Rough Computing-Based Performance Evaluation Approach for Educational Institutions 22212.6.4 A New Method for Preserving Privacy in Quantitative Association Rules Using Genetic Algorithm 22312.6.5 Privacy Preserving in Association Rules Using a Genetic Algorithm 22412.7 Summary 225Exercises 225References 22613 Applications of Wireless Sensor Network in Cloud 233Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal13.1 Introduction 23413.2 Architectural Issues of Combining Cloud Computing and Wireless Sensor Networks 23413.3 Sensor Network Overview 23513.3.1 Terminology 23513.3.2 Routing Protocols in WSNs 23613.4 Application Scenarios 23713.4.1 Military Use 23713.4.2 Weather Forecasting 23713.4.3 Healthcare 23813.4.4 Transport Monitoring 23813.5 Summary 238Exercises 239References 23914 Applications of Mobile Cloud Computing 243Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal14.1 What is Mobile Cloud Computing? 24414.2 The Architecture of Mobile Cloud Computing 24514.3 Characteristics of Mobile Cloud Computing 24514.4 Advantages of Mobile Cloud Computing 24614.5 Mobile Cloud Applications 24814.5.1 Mobile Commerce 24814.5.2 Mobile Learning 24914.5.3 Mobile Healthcare 24914.5.4 Mobile Gaming 25014.5.5 Mobile Social Network 25114.5.6 Multimedia Sharing 25214.6 Summary 252Exercises 252References 25315 Big Data in Cloud Computing 257Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal15.1 Introduction to Big Data 25815.2 Big Data vs. Cloud Computing 25915.3 Big Data and the Cloud 26115.4 Cloud Computing to Support Big Data 26215.4.1 Cloud Storage for Big Data Storage 26215.4.2 Cloud Computing for Big Data Processing 26215.4.3 Cloud Computing for Big Data Analytics 26315.4.4 Cloud Computing for Big Data Sharing and Remote Collaboration 26315.5 Opportunities and Challenges 26315.5.1 Pros of Putting Big Data in the Cloud 26315.5.2 Potential Challenges of Big Data in the Cloud 26415.6 Summary 265Exercises 265References 266Part IV: Cloud Computing Simulator Tools 26916 CloudSim: A Simulator for Cloud Computing Environment 271Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik16.1 Introduction 27216.2 Main Features 27216.3 CloudSim Architecture 27316.3.1 Modeling the Cloud 27416.3.2 Modeling the VM Allocation 27516.3.3 Modeling the Cloud Market 27616.3.4 Modeling the Network Behavior 27616.3.5 Modeling a Federation of Clouds 27616.3.6 Modeling Dynamic Workloads 27716.3.7 Modeling Data Center Power Consumption 27816.3.8 Modeling Dynamic Entities Creation 27816.4 Design and Implementation of CloudSim 27916.5 Setting up Development Environments 28216.6 How to Use CloudSim with Eclipse 282References 28517 OpenFaaS 287Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal17.1 Introduction 28817.2 OpenFaaS Architecture 28817.3 OpenFaaS Installation 28917.3.1 Development Environment with Docker Swarm 29017.3.2 Multi-Node Cluster with Docker Swarm 29117.3.3 Production Environment with Kubernetes 29317.3.4 Installing OpenFaaS Using Helm 29717.3.5 Install OpenShift 29817.4 Considerations 30017.5 Operation of OpenFaaS 30017.5.1 Setup and Configuration of the Open FaaS Command Line Tool 30017.5.2 OpenFaaS Store 30117.5.3 Management and Usage of Functions 30117.5.4 Development of Functions 30217.5.5 Working with Docker Registries 30217.5.6 Web UI 303References 30318 OpenNebula 305Prasant Kumar Pattnaik, Dac-Nhuong Le, Souvik Pal18.1 Project Goal and Environment 30618.2 Set Up Masternode with Frontend 30618.2.1 Install Components 30618.2.2 Starting the Frontend 30618.3 Set Up Worker Node with KVM 30718.3.1 Install Components 30718.3.2 Establish an SSH Communication Pipeline between Master and Worker 30818.3.3 Network Configuration 30818.4 Register Worker Node 30818.5 Deploy VM 309References 31119 OpenStack 313Dac-Nhuong Le, Souvik Pal, Prasant Kumar Pattnaik19.1 OpenStack 31419.2 Terminologies in OpenStack 31419.3 OpenStack Architecture 31519.3.1 Compute (Nova) 31619.3.2 Networking (Neuron) 31619.3.3 Image 31619.3.4 Object Storage (Swift) 31619.3.5 Block Storage (Cinder) 31619.4 Logical Architecture 31719.5 OpenStack Installation Guide 31819.5.1 Hardware Requirements 31819.5.2 Networking Requirements 31919.6 OpenStack Work 321References 32220 Eucalyptus 325Souvik Pal, Dac-Nhuong Le, Prasant Kumar Pattnaik20.1 Introduction to Eucalyptus 32620.1.1 Eucalyptus Overview 32620.1.2 Eucalyptus Architecture 32620.1.3 Eucalyptus Components 32720.2 Eucalyptus Installation 32820.2.1 System Requirements 32920.2.2 Services Placement 33020.2.3 Eucalyptus Features 33120.2.4 Networking Modes 33220.2.5 Install Repositories 33220.3 Configure Eucalyptus 33520.4 Amazon Web Services Compatibility 337References 337Glossary 339Authors 365