High Performance Parallelism Pearls Volume One

James Reinders is a senior engineer who joined Intel Corporation in 1989 and has contributed to projects including the world’s first TeraFLOP supercomputer (ASCI Red), as well as compilers and architecture work for a number of Intel processors and parallel systems. James has been a driver behind the development of Intel as a major provider of software development products, and serves as their chief software evangelist. James has published numerous articles, contributed to several books and is widely interviewed on parallelism. James has managed software development groups, customer service and consulting teams, business development and marketing teams. James is sought after to keynote on parallel programming, and is the author/co-author of three books currently in print including Structured Parallel Programming, published by Morgan Kaufmann in 2012. Jim Jeffers was the primary strategic planner and one of the first full-time employees on the program that became Intel ® MIC. He served as lead SW Engineering Manager on the program and formed and launched the SW development team. As the program evolved, he became the workloads (applications) and SW performance team manager. He has some of the deepest insight into the market, architecture and programming usages of the MIC product line. He has been a developer and development manager for embedded and high performance systems for close to 30 years.

• 1. Introduction2. Towards an efficient Godunov's scheme on Phi3. Better Concurrency and SIMD on HBM4. Case Study: Analyzing and Optimizing Concurrency5. Plesiochronous Phasing Barriers6. Parallel Evaluation of Fault Tree Expressions7. Deep-learning and Numerical Optimization8. Optimizing Gather/Scatter Patterns9. A many core implementation of the direct N-body problem10. N-body Methods on Intel® Xeon Phi™ Coprocessors11. Dynamic Load Balancing using OpenMP 4.012. Concurrent Kernel Offloading13. Heterogeneous Computing with MPI14. Power Analysis on the Intel® Xeon Phi™ Coprocessor15. Integrating Intel Xeon Phis into a Cluster16. Native File systems17. NWChem: Quantum Chemistry Simulations at Scale18. Efficient nested parallelism on large scale system19. Performance optimization of Black-Scholes pricing20. Host and Coprocessor Data Transfer through the COI21. High Performance Ray Tracing with Embree22. Portable and Perform with OpenCL23. Characterization and Auto-tuning of 3DFD.24. Profiling-guided optimization of cache performance25. Heterogeneous MPI optimization with ITAC26. Scalable Out-of-core Solvers on a Cluster27. Sparse matrix-vector multiplication: parallelization and vectorization28. Morton Order Improves Performance

"This book will make it much easier in general to exploit high levels of parallelism including programming optimally for the Intel Xeon Phi products. The common programming methodology between the Xeon and Xeon Phi families is good news for the entire scientific and engineering community; the same programming can realize parallel scaling and vectorization for both multicore and many-core." –-from the Foreword by Sverre Jarp, CERN Openlab CTO