Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design

Inbunden, Engelska, 2020

1 849 kr

Beställningsvara. Skickas inom 5-8 vardagar. Fri frakt för medlemmar vid köp för minst 249 kr.

Explains current co-design and co-optimization methodologies for building hardware neural networks and algorithms for machine learning applications This book focuses on how to build energy-efficient hardware for neural networks with learning capabilities—and provides co-design and co-optimization methodologies for building hardware neural networks that can learn. Presenting a complete picture from high-level algorithm to low-level implementation details, Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design also covers many fundamentals and essentials in neural networks (e.g., deep learning), as well as hardware implementation of neural networks.The book begins with an overview of neural networks. It then discusses algorithms for utilizing and training rate-based artificial neural networks. Next comes an introduction to various options for executing neural networks, ranging from general-purpose processors to specialized hardware, from digital accelerator to analog accelerator. A design example on building energy-efficient accelerator for adaptive dynamic programming with neural networks is also presented. An examination of fundamental concepts and popular learning algorithms for spiking neural networks follows that, along with a look at the hardware for spiking neural networks. Then comes a chapter offering readers three design examples (two of which are based on conventional CMOS, and one on emerging nanotechnology) to implement the learning algorithm found in the previous chapter. The book concludes with an outlook on the future of neural network hardware. Includes cross-layer survey of hardware accelerators for neuromorphic algorithmsCovers the co-design of architecture and algorithms with emerging devices for much-improved computing efficiencyFocuses on the co-design of algorithms and hardware, which is especially critical for using emerging devices, such as traditional memristors or diffusive memristors, for neuromorphic computingLearning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design is an ideal resource for researchers, scientists, software engineers, and hardware engineers dealing with the ever-increasing requirement on power consumption and response time. It is also excellent for teaching and training undergraduate and graduate students about the latest generation neural networks with powerful learning capabilities.

Produktinformation

Utgivningsdatum2020-01-08
Mått170 x 246 x 23 mm
Vikt640 g
FormatInbunden
SpråkEngelska
SerieIEEE Press
Antal sidor296
FörlagJohn Wiley & Sons Inc
ISBN9781119507383

Tillhör följande kategorier

Elektronik och kommunikationer inom Naturvetenskap och teknik

NAN ZHENG, PhD, received a B. S. degree in Information Engineering from Shanghai Jiao Tong University, China, in 2011, and an M. S. and PhD in Electrical Engineering from the University of Michigan, Ann Arbor, USA, in 2014 and 2018, respectively. His research interests include low-power hardware architectures, algorithms and circuit techniques with an emphasis on machine-learning applications. PINAKI MAZUMDER, PhD, is a professor in the Department of Electrical Engineering and Computer Science at The University of Michigan, USA. His research interests include CMOS VLSI design, semiconductor memory systems, CAD tools and circuit designs for emerging technologies including quantum MOS, spintronics, spoof plasmonics, and resonant tunneling devices.

Preface xiAcknowledgment xix1 Overview 11.1 History of Neural Networks 11.2 Neural Networks in Software 21.2.1 Artificial Neural Network 21.2.2 Spiking Neural Network 31.3 Need for Neuromorphic Hardware 31.4 Objectives and Outlines of the Book 5References 82 Fundamentals and Learning of Artificial Neural Networks 112.1 Operational Principles of Artificial Neural Networks 112.1.1 Inference 112.1.2 Learning 132.2 Neural Network Based Machine Learning 162.2.1 Supervised Learning 172.2.2 Reinforcement Learning 202.2.3 Unsupervised Learning 222.2.4 Case Study: Action-Dependent Heuristic Dynamic Programming 232.2.4.1 Actor-Critic Networks 242.2.4.2 On-Line Learning Algorithm 252.2.4.3 Virtual Update Technique 272.3 Network Topologies 312.3.1 Fully Connected Neural Networks 312.3.2 Convolutional Neural Networks 322.3.3 Recurrent Neural Networks 352.4 Dataset and Benchmarks 382.5 Deep Learning 412.5.1 Pre-Deep-Learning Era 412.5.2 The Rise of Deep Learning 412.5.3 Deep Learning Techniques 422.5.3.1 Performance-Improving Techniques 422.5.3.2 Energy-Efficiency-Improving Techniques 462.5.4 Deep Neural Network Examples 50References 533 Artificial Neural Networks in Hardware 613.1 Overview 613.2 General-Purpose Processors 623.3 Digital Accelerators 633.3.1 A Digital ASIC Approach 633.3.1.1 Optimization on Data Movement and Memory Access 633.3.1.2 Scaling Precision 713.3.1.3 Leveraging Sparsity 763.3.2 FPGA-Based Accelerators 803.4 Analog/Mixed-Signal Accelerators 823.4.1 Neural Networks in Conventional Integrated Technology 823.4.1.1 In/Near-Memory Computing 823.4.1.2 Near-Sensor Computing 853.4.2 Neural Network Based on Emerging Non-volatile Memory 883.4.2.1 Crossbar as a Massively Parallel Engine 893.4.2.2 Learning in a Crossbar 913.4.3 Optical Accelerator 933.5 Case Study: An Energy-Efficient Accelerator for Adaptive Dynamic Programming 943.5.1 Hardware Architecture 953.5.1.1 On-Chip Memory 953.5.1.2 Datapath 973.5.1.3 Controller 993.5.2 Design Examples 101References 1084 Operational Principles and Learning in Spiking Neural Networks 1194.1 Spiking Neural Networks 1194.1.1 Popular Spiking Neuron Models 1204.1.1.1 Hodgkin-Huxley Model 1204.1.1.2 Leaky Integrate-and-Fire Model 1214.1.1.3 Izhikevich Model 1214.1.2 Information Encoding 1224.1.3 Spiking Neuron versus Non-Spiking Neuron 1234.2 Learning in Shallow SNNs 1244.2.1 ReSuMe 1244.2.2 Tempotron 1254.2.3 Spike-Timing-Dependent Plasticity 1274.2.4 Learning Through Modulating Weight-Dependent STDP in Two-Layer Neural Networks 1314.2.4.1 Motivations 1314.2.4.2 Estimating Gradients with Spike Timings 1314.2.4.3 Reinforcement Learning Example 1354.3 Learning in Deep SNNs 1464.3.1 SpikeProp 1464.3.2 Stack of Shallow Networks 1474.3.3 Conversion from ANNs 1484.3.4 Recent Advances in Backpropagation for Deep SNNs 1504.3.5 Learning Through Modulating Weight-Dependent STDP in Multilayer Neural Networks 1514.3.5.1 Motivations 1514.3.5.2 Learning Through Modulating Weight-Dependent STDP 1514.3.5.3 Simulation Results 158References 1675 Hardware Implementations of Spiking Neural Networks 1735.1 The Need for Specialized Hardware 1735.1.1 Address-Event Representation 1735.1.2 Event-Driven Computation 1745.1.3 Inference with a Progressive Precision 1755.1.4 Hardware Considerations for Implementing the Weight-Dependent STDP Learning Rule 1815.1.4.1 Centralized Memory Architecture 1825.1.4.2 Distributed Memory Architecture 1835.2 Digital SNNs 1865.2.1 Large-Scale SNN ASICs 1865.2.1.1 SpiNNaker 1865.2.1.2 TrueNorth 1875.2.1.3 Loihi 1915.2.2 Small/Moderate-Scale Digital SNNs 1925.2.2.1 Bottom-Up Approach 1925.2.2.2 Top-Down Approach 1935.2.3 Hardware-Friendly Reinforcement Learning in SNNs 1945.2.4 Hardware-Friendly Supervised Learning in Multilayer SNNs 1995.2.4.1 Hardware Architecture 1995.2.4.2 CMOS Implementation Results 2055.3 Analog/Mixed-Signal SNNs 2105.3.1 Basic Building Blocks 2105.3.2 Large-Scale Analog/Mixed-Signal CMOS SNNs 2115.3.2.1 CAVIAR 2115.3.2.2 BrainScaleS 2145.3.2.3 Neurogrid 2155.3.3 Other Analog/Mixed-Signal CMOS SNN ASICs 2165.3.4 SNNs Based on Emerging Nanotechnologies 2165.3.4.1 Energy-Efficient Solutions 2175.3.4.2 Synaptic Plasticity 2185.3.5 Case Study: Memristor Crossbar Based Learning in SNNs 2205.3.5.1 Motivations 2205.3.5.2 Algorithm Adaptations 2225.3.5.3 Non-idealities 2315.3.5.4 Benchmarks 238References 2386 Conclusions 2476.1 Outlooks 2476.1.1 Brain-Inspired Computing 2476.1.2 Emerging Nanotechnologies 2496.1.3 Reliable Computing with Neuromorphic Systems 2506.1.4 Blending of ANNs and SNNs 2516.2 Conclusions 252References 253A Appendix 257A.1 Hopfield Network 257A.2 Memory Self-Repair with Hopfield Network 258References 266Index 269

Mer från samma serie

Circuit Simulation

Farid N. Najm

Inbunden, 2010

2 249 kr

Engineering Quantum Mechanics

Doyeol Ahn, Seoung-Hwan Park

Inbunden, 2011

2 259 kr

Domain-Specific Modeling

Steven Kelly, Juha-Pekka Tolvanen

Häftad, 2008

1 959 kr

Automated Defect Prevention

Dorota Huizinga, Adam Kolawa

Inbunden, 2007

2 199 kr

Handbook of Applied Algorithms

Amiya Nayak, Amiya Nayak, Ivan Stojmenovic

Inbunden, 2008

2 209 kr

Practical Image and Video Processing Using MATLAB

Oge Marques

Inbunden, 2011

2 549 kr

High Performance Switches and Routers

H. Jonathan Chao, Bin Liu

Inbunden, 2007

3 049 kr

Advanced FPGA Design

Steve Kilts

Inbunden, 2007

2 049 kr

Grid Converters for Photovoltaic and Wind Power Systems

Remus Teodorescu, Marco Liserre, Pedro Rodriguez

Inbunden, 2011

2 119 kr

Distributed Generation

Loi Lei Lai, Tze Fun Chan

Inbunden, 2007

1 939 kr

Du kanske också är intresserad av

Artificial Plasmonics for VLSI Interconnects

Soumitra R. Joy, Pinaki Mazumder

Inbunden, 2025

2 099 kr

Lectures on Digital Design Principles

Pinaki Mazumder, Idongesit E. Ebong

Inbunden, 2023

1 969 kr

Neuromorphic Circuits for Nanoscale Devices

Pinaki Mazumder, Yalcin Yilmaz, Idongesit Ebong

Häftad, 2024

809 kr

Memristive Computing

Yongbin Yu, Xiangxiang Wang, Xiao Feng, Jiarun Shen, Nyima Tashi, Pinaki Mazumder

Inbunden, 2025

2 289 kr

Memristive Computing

Yongbin Yu, Xiangxiang Wang, Xiao Feng, Jiarun Shen, Nyima Tashi, Pinaki Mazumder

Häftad, 2026

2 289 kr

Neuromorphic Circuits for Nanoscale Devices

Pinaki Mazumder, Yalcin Yilmaz, Idongesit Ebong, Pinaki Mazumder, Yalcin Yilmaz, Idongesit Ebong

Inbunden, 2019

1 519 kr

Ruth Kvarnström-Jones - Systrarna på Sophiahemmet, Inbunden

Nyhet

Del 3

Systrarna på Sophiahemmet

Ruth Kvarnström-Jones

Inbunden, 2026

299 kr329 kr

Nyhet

Del 11

Medusa

Lars Kepler

Inbunden, 2026

289 kr319 kr

Nyhet

Threshing Day (Limited Deluxe Edition)

Rebecca Yarros

Inbunden, 2026

339 kr

Sarah J. Maas - A Court of Splintered Harmony, Häftad

Nyhet

Del 6

A Court of Splintered Harmony

Sarah J. Maas

Häftad, 2026

259 kr

Del i serien IEEE Press

Learning in Energy-Efficient Neuromorphic Computing: Algorithm and Architecture Co-Design

Inbunden, Engelska, 2020

AvNan Zheng,Pinaki Mazumder

1 849 kr

Beställningsvara. Skickas inom 5-8 vardagar. Fri frakt för medlemmar vid köp för minst 249 kr.

Produktinformation

Utgivningsdatum2020-01-08
Mått170 x 246 x 23 mm
Vikt640 g
FormatInbunden
SpråkEngelska
SerieIEEE Press
Antal sidor296
FörlagJohn Wiley & Sons Inc
ISBN9781119507383

Tillhör följande kategorier

Elektronik och kommunikationer inom Naturvetenskap och teknik

Preface xiAcknowledgment xix1 Overview 11.1 History of Neural Networks 11.2 Neural Networks in Software 21.2.1 Artificial Neural Network 21.2.2 Spiking Neural Network 31.3 Need for Neuromorphic Hardware 31.4 Objectives and Outlines of the Book 5References 82 Fundamentals and Learning of Artificial Neural Networks 112.1 Operational Principles of Artificial Neural Networks 112.1.1 Inference 112.1.2 Learning 132.2 Neural Network Based Machine Learning 162.2.1 Supervised Learning 172.2.2 Reinforcement Learning 202.2.3 Unsupervised Learning 222.2.4 Case Study: Action-Dependent Heuristic Dynamic Programming 232.2.4.1 Actor-Critic Networks 242.2.4.2 On-Line Learning Algorithm 252.2.4.3 Virtual Update Technique 272.3 Network Topologies 312.3.1 Fully Connected Neural Networks 312.3.2 Convolutional Neural Networks 322.3.3 Recurrent Neural Networks 352.4 Dataset and Benchmarks 382.5 Deep Learning 412.5.1 Pre-Deep-Learning Era 412.5.2 The Rise of Deep Learning 412.5.3 Deep Learning Techniques 422.5.3.1 Performance-Improving Techniques 422.5.3.2 Energy-Efficiency-Improving Techniques 462.5.4 Deep Neural Network Examples 50References 533 Artificial Neural Networks in Hardware 613.1 Overview 613.2 General-Purpose Processors 623.3 Digital Accelerators 633.3.1 A Digital ASIC Approach 633.3.1.1 Optimization on Data Movement and Memory Access 633.3.1.2 Scaling Precision 713.3.1.3 Leveraging Sparsity 763.3.2 FPGA-Based Accelerators 803.4 Analog/Mixed-Signal Accelerators 823.4.1 Neural Networks in Conventional Integrated Technology 823.4.1.1 In/Near-Memory Computing 823.4.1.2 Near-Sensor Computing 853.4.2 Neural Network Based on Emerging Non-volatile Memory 883.4.2.1 Crossbar as a Massively Parallel Engine 893.4.2.2 Learning in a Crossbar 913.4.3 Optical Accelerator 933.5 Case Study: An Energy-Efficient Accelerator for Adaptive Dynamic Programming 943.5.1 Hardware Architecture 953.5.1.1 On-Chip Memory 953.5.1.2 Datapath 973.5.1.3 Controller 993.5.2 Design Examples 101References 1084 Operational Principles and Learning in Spiking Neural Networks 1194.1 Spiking Neural Networks 1194.1.1 Popular Spiking Neuron Models 1204.1.1.1 Hodgkin-Huxley Model 1204.1.1.2 Leaky Integrate-and-Fire Model 1214.1.1.3 Izhikevich Model 1214.1.2 Information Encoding 1224.1.3 Spiking Neuron versus Non-Spiking Neuron 1234.2 Learning in Shallow SNNs 1244.2.1 ReSuMe 1244.2.2 Tempotron 1254.2.3 Spike-Timing-Dependent Plasticity 1274.2.4 Learning Through Modulating Weight-Dependent STDP in Two-Layer Neural Networks 1314.2.4.1 Motivations 1314.2.4.2 Estimating Gradients with Spike Timings 1314.2.4.3 Reinforcement Learning Example 1354.3 Learning in Deep SNNs 1464.3.1 SpikeProp 1464.3.2 Stack of Shallow Networks 1474.3.3 Conversion from ANNs 1484.3.4 Recent Advances in Backpropagation for Deep SNNs 1504.3.5 Learning Through Modulating Weight-Dependent STDP in Multilayer Neural Networks 1514.3.5.1 Motivations 1514.3.5.2 Learning Through Modulating Weight-Dependent STDP 1514.3.5.3 Simulation Results 158References 1675 Hardware Implementations of Spiking Neural Networks 1735.1 The Need for Specialized Hardware 1735.1.1 Address-Event Representation 1735.1.2 Event-Driven Computation 1745.1.3 Inference with a Progressive Precision 1755.1.4 Hardware Considerations for Implementing the Weight-Dependent STDP Learning Rule 1815.1.4.1 Centralized Memory Architecture 1825.1.4.2 Distributed Memory Architecture 1835.2 Digital SNNs 1865.2.1 Large-Scale SNN ASICs 1865.2.1.1 SpiNNaker 1865.2.1.2 TrueNorth 1875.2.1.3 Loihi 1915.2.2 Small/Moderate-Scale Digital SNNs 1925.2.2.1 Bottom-Up Approach 1925.2.2.2 Top-Down Approach 1935.2.3 Hardware-Friendly Reinforcement Learning in SNNs 1945.2.4 Hardware-Friendly Supervised Learning in Multilayer SNNs 1995.2.4.1 Hardware Architecture 1995.2.4.2 CMOS Implementation Results 2055.3 Analog/Mixed-Signal SNNs 2105.3.1 Basic Building Blocks 2105.3.2 Large-Scale Analog/Mixed-Signal CMOS SNNs 2115.3.2.1 CAVIAR 2115.3.2.2 BrainScaleS 2145.3.2.3 Neurogrid 2155.3.3 Other Analog/Mixed-Signal CMOS SNN ASICs 2165.3.4 SNNs Based on Emerging Nanotechnologies 2165.3.4.1 Energy-Efficient Solutions 2175.3.4.2 Synaptic Plasticity 2185.3.5 Case Study: Memristor Crossbar Based Learning in SNNs 2205.3.5.1 Motivations 2205.3.5.2 Algorithm Adaptations 2225.3.5.3 Non-idealities 2315.3.5.4 Benchmarks 238References 2386 Conclusions 2476.1 Outlooks 2476.1.1 Brain-Inspired Computing 2476.1.2 Emerging Nanotechnologies 2496.1.3 Reliable Computing with Neuromorphic Systems 2506.1.4 Blending of ANNs and SNNs 2516.2 Conclusions 252References 253A Appendix 257A.1 Hopfield Network 257A.2 Memory Self-Repair with Hopfield Network 258References 266Index 269