Handbook of Research Methods in Industrial and Organizational Psychology

Dr. Steven G. Rogelberg (Associate Professor, Psychology and Adjunct Associate Professor, Business Administration) is Director of the Industrial and Organizational Psychology Program at UNC Charlotte. He has over 45 publications and 25 invited addresses/colloquiums addressing issues such as organizational research methods, team effectiveness, health and employee well-being, meetings at work, and organizational development. He is the Editor-in-Chief of the two-volume Encyclopedia of Industrial and Organizational Psychology (in progress). Recent honors include being named Chair of Education and Training for the Society of Industrial and Organizational Psychology (SIOP), serving as a SIOP Executive Board Member, serving as Guest Editor for Organizational Research Methods, receiving the 2001 Bowling Green State University (BGSU) Psi Chi Professor of the Year Award, and receiving the BGSU Master Teacher Award. Prior to his recent tenure at UNCC, Rogelberg was an Associate Professor of Psychology in the Industrial and Organizational Psychology area at BGSU. Before completing his Ph.D. in Industrial/Organizational Psychology at the University of Connecticut in 1994, he received his undergraduate B.Sc. degree from Tufts University in 1989.

• List of Contributors xPreface xiiAcknowledgments xiiiPart I Foundations 11 History of Research Methods in Industrial and Organizational Psychology: Measurement, Design, Analysis 3James T. Austin, Charles A. Scherbaum, and Robert A. Mahlman2 Ethics in Research 34Herman Aguinis and Christine A. Henle3 Validity and Reliability 57Robert M. Guion4 The Relative Validity and Usefulness of Various Empirical Research Designs 77Eugene F. Stone-Romero5 An Introduction to Qualitative Research: Its Potential for Industrial and Organizational Psychology 99Karen Locke and Karen Golden-Biddle6 Using Power Analysis to Evaluate and Improve Research 119Kevin MurphyPart II Data Collection Procedures and Approaches 1397 Organizational Survey Research 141Steven G. Rogelberg, Allan H. Church, Janine Waclawski, and Jeffrey M. Stanton8 Qualitative Data Collection and Analysis 161Peter D. Bachiochi and Sara P. Weiner9 Computational Modeling 184Michael J. Zickar and Jerel E. Slaughter10 Research Perspectives on Meta-Analysis 198Allen I. Huffcutt11 Methodological Issues In Cross-Cultural Organizational Research 216Michele J. Gelfand, Jana L. Raver, and Karen Holcombe Ehrhart12 Issues in Multilevel Research: Theory Development, Measurement, and Analysis 247David A. Hofmann13 Beyond Online Surveys: Internet Research Opportunities for Industrial-Organizational Psychology 275Jeffrey M. Stanton and Steven G. RogelbergPart III Data Investigation 29514 Outliers and Influential Cases: Handling those Discordant Contaminated Maverick Rogues 297Philip L. Roth and Fred S. Switzer III15 Coping With Missing Data 310Fred S. Switzer III and Philip L. Roth16 Item Analysis: Theory and Practice Using Classical and Modern Test Theory 324Barbara B. Ellis and Alan D. Mead17 Method Variance and Method Bias in Industrial and Organizational Psychology 344James M. Conway18 Basic and Advanced Measurement Models for Confirmatory Factor Analysis 366Larry J. Williams, Lucy R. Ford, and Nhung Nguyen19 Modeling Complex Data Structures: The General Linear Model and Beyond 390Richard P. DeShon and Scott B. Morris20 Longitudinal Modeling 412David Chan21 Modeling Nonlinear Relationships: Neural Networks and Catastrophe Analysis 431Paul J. Hanges, Robert G. Lord, Ellen G. Godfrey, and Jana L. RaverPart IV Concluding Thoughts 45722 Writing Research Articles: Update on the Article Review Checklist 459Erica I. Desrosiers, Kathryn Sherony, Eduardo Barros, Gary A. Ballinger, Sinem Senol, and Michael A. Campion23 Securing our Collective Future: Challenges Facing Those Designing and Doing Research in Industrial and Organizational Psychology 479Steven G. Rogelberg and Margaret E. Brooks-LaberName Index 486Subject Index 506

"This one volume covers both traditional design and measurement issues as well as a host of cutting-edge topics. At last a readable and comprehensive review of research methodology for the organizational scientist!" Robert L. Dipboye, Rice University "This handbook is 'must-reading' for all graduate students in I/O psychology as well as for the more experienced I/O researcher and practitioner who will benefit from a review, an update, and the opportunity to learn new approaches." Sheldon Zedeck, University of California at Berkeley "Rogelberg's handbook is a Rosetta Stone for researchers." Milton D. Hakel, Bowling Green State University "A handbook that brings together the best researchers and thinkers in the areas of social science methodology and data analysis. This informative collection is a 'must-read' for all those interested in method-related issues." Wally Borman, University of South Florida "This volume provides a comprehensive and cutting-edge examination of research and statistical methods that are used in the field. It will be an invaluable resource for faculty and students. I have no doubt that the book will easily meet its goal of helping to improve research quality." James L. Farr, Pennsylvania State University "Excellent coverage of key issues and packed with useful ideas." Peter Warr, University of Sheffield "The topics are well chosen and the chapters are written in an accessible style. The handbook is an indispensable reference for those interested in this important area." Nik Chmiel, Queen's University, Belfast