Advances in Comparative Survey Methods

Timothy P. Johnson, PhD, Director of the Survey Research Laboratory and Professor of Public Administration, University of Illinois at Chicago. Beth-Ellen Pennell, Director of International Survey Operations at the Survey Research Center, Institute for Social Research, University of Michigan. Ineke A. L. Stoop, PhD, Head Methodology Department at The Netherlands Institute for Social Research|SCP and member of the Core Scientific Team of the European Social Survey. Brita Dorer, researcher at GESIS - Leibniz Institute for the Social Sciences in Mannheim, Germany and head of the translation team of the European Social Survey (ESS).

• Preface xixNotes on Contributors xxiiiSection I Introduction 11 The Promise and Challenge of 3MC Research 3Timothy P. Johnson, Beth‐Ellen Pennell, Ineke A.L. Stoop, and Brita Dorer2 Improving Multinational, Multiregional, and Multicultural (3MC) Comparability Using the Total Survey Error (TSE) Paradigm 13Tom W. Smith3 Addressing Equivalence and Bias in Cross‐cultural Survey Research Within a Mixed Methods Framework 45Jose‐Luis Padilla, Isabel Benitez, and Fons J.R. van de VijverSection II Sampling Approaches 654 Innovative Sample Designs Using GIS Technology 67Stephanie Eckman, Kristen Himelein, and Jill A. Dever5 Within‐household Selection of Respondents 93Achim KochSection III Cross‐cultural Questionnaire Design and Testing 1136 Overview of Questionnaire Design and Testing 115Julie A.J. de Jong, Brita Dorer, Sunghee Lee, Ting Yan, and Ana Villar7 Sensitive Questions in Comparative Surveys 139Anna V. Andreenkova and Debra Javeline8 Implementing a Multinational Study of Questionnaire Design 161Henning Silber, Tobias H. Stark, Annelies G. Blom, and Jon A. Krosnick9 Using Anchoring Vignettes to Correct for Differential Response Scale Usage in 3MC Surveys 181Mengyao Hu, Sunghee Lee, and Hongwei Xu10 Conducting Cognitive Interviewing Studies to Examine Survey Question Comparability 203Kristen Miller11 Setting Up the Cognitive Interview Task for Non‐English‐speaking Participants in the United States 227Hyunjoo Park and Patricia L. Goerman12 Working Toward Comparable Meaning of Different Language Versions of Survey Instruments: Do Monolingual and Bilingual Cognitive Testing Respondents Help to Uncover the Same Issues? 251Patricia L. Goerman, Mikelyn Meyers, Mandy Sha, Hyunjoo Park, and Alisu Schoua‐Glusberg13 Examining the Comparability of Behavior Coding Across Cultures 271Timothy P. Johnson, Allyson Holbrook, Young Ik Cho, Sharon Shavitt,Noel Chavez, and Saul WeinerSection IV Languages, Translation, and Adaptation 29314 How to Choose Interview Language in Different Countries 295Anna V. Andreenkova15 Can the Language of Survey Administration Influence Respondents’ Answers? 325Emilia Peytcheva16 Documenting the Survey Translation and Monitoring Process 341Dorothée Behr, Steve Dept, and Elica Krajčeva17 Preventing Differences in Translated Survey Items Using the Survey Quality Predictor 357Diana Zavala‐Rojas, Willem E. Saris, and Irmtraud N. GallhoferSection V Mixed Mode and Mixed Methods 38518 The Design and Implementation of Mixed‐mode Surveys 387Edith D. de Leeuw, Z. Tuba Suzer‐Gurtekin, and Joop J. Hox19 Mixed‐mode Surveys: Design, Estimation, and Adjustment Methods 409Z. Tuba Suzer‐Gurtekin, Richard Valliant, Steven G. Heeringa,and Edith D. de Leeuw20 Mixed Methods in a Comparative Context: Technology and New Opportunities for Social Science Research 431Nathalie E. Williams and Dirgha J. GhimireSection VI Response Styles 45521 Cross‐cultural Comparability of Response Patterns of Subjective Probability Questions 457Sunghee Lee, Florian Keusch, Norbert Schwarz, Mingnan Liu, and Z. Tuba Suzer‐Gurtekin22 Response Styles in Cross‐cultural Surveys 477Mingnan Liu, Z. Tuba Suzer‐Gurtekin, Florian Keusch, and Sunghee Lee23 Examining Translation and Respondents’ Use of Response Scales in 3MC Surveys 501Ting Yan and Mengyao HuSection VII Data Collection Challenges and Approaches 51924 Data Collection in Cross‐national and International Surveys:Regional Case Studies 521Kristen Cibelli Hibben, Beth‐Ellen Pennell, Sarah M. Hughes,Yu‐chieh (Jay) Lin, and Jennifer Kelley25 Survey Data Collection in Sub‐Saharan Africa (SSA): Challenges, Strategies, and Opportunities 533Sarah M. Hughes and Yu‐chieh (Jay) Lin26 Survey Challenges and Strategies in the Middle East and Arab Gulf Regions 555Justin Gengler, Kien Trung Le, and David Howell27 Data Collection in Cross‐national and International Surveys: Latin America and the Caribbean 569J. Daniel Montalvo, Mitchell A. Seligson, and Elizabeth J. Zechmeister28 Survey Research in India and China 583Charles Q. Lau, Ellen Marks, and Ashish Kumar Gupta29 Best Practices for Panel Maintenance and Retention 597Nicole Watson, Eva Leissou, Heidi Guyer, and Mark Wooden30 Collection of Biomeasures in a Cross‐national Setting: Experiences in SHARE 623Luzia M. Weiss, Joseph W. Sakshaug, and Axel Borsch‐Supan31 Multinational Event History Calendar Interviewing 643Yfke P. Ongena, Marieke Haan, and Wil Dijkstra32 Ethical Considerations in the Total Survey Error Context 665Julie A.J. de Jong33 Linking Auxiliary Data to Survey Data: Ethical and Legal Challenges in Europe and the United States 683Kirstine Kolsrud, Linn‐Merethe Rød, and Katrine U. SegadalSection VIII Quality Control and Monitoring 70534 Organizing and Managing Comparative Surveys 707Lesli Scott, Peter Ph. Mohler, and Kristen Cibelli Hibben35 Case Studies on Monitoring Interviewer Behavior in International and Multinational Surveys 731Zeina Mneimneh, Lars Lyberg, Sharan Sharma, Mahesh Vyas,Dhananjay Bal Sathe, Frederic Malter, and Yasmin Altwaijri36 New Frontiers in Detecting Data Fabrication 771Michael RobbinsSection IX Nonresponse 80737 Comparing Nonresponse and Nonresponse Biases in Multinational,Multiregional, and Multicultural Contexts 809James Wagner and Ineke A.L. Stoop38 Geographic Correlates of Nonresponse in California: A Cultural Ecosystems Perspective 835Matt Jans, Kevin McLaughlin, Joseph Viana, David Grant, Royce Park and Ninez A. Ponce39 Additional Languages and Representativeness 859Oliver Lipps and Michael OchsnerSection X Multi‐group Analysis 87940 Measurement Invariance in International Large‐scale Assessments:Integrating Theory and Method 881Deana Desa, Fons J.R. van de Vijver, Ralph Carstens and Wolfram Schulz41 Approximate Measurement Invariance 911Kimberley Lek, Daniel Oberski, Eldad Davidov, Jan Cieciuch, Daniel Seddig, and Peter Schmidt42 Data Harmonization, Data Documentation, and Dissemination 933Peter Granda43 Basic Principles of Survey Data Recycling 937Kazimierz M. Slomczynski and Irina Tomescu‐Dubrow44 Survey Data Harmonization and the Quality of Data Documentation in Cross‐national Surveys 963Marta Kołczyńska and Matthew Schoene45 Identification of Processing Errors in Cross‐national Surveys 985Olena Oleksiyenko, Ilona Wysmulek, and Anastas Vangeli46 Item Metadata as Controls for Ex Post Harmonization of International Survey Projects 1011Marta Kołczyńska and Kazimierz M. Slomczynski47 The Past, Present, and Future of Statistical Weights in International Survey Projects: Implications for Survey Data Harmonization 1035Marcin W. Zieliński, Przemek Powałko, and Marta KołczyńskaSection XII Looking Forward 105348 Prevailing Issues and the Future of Comparative Surveys 1055Lars Lyberg, Lilli Japec, and Can TongurWiley Series In Survey Methodology 1083Index 1087

Select Guide Rating