Advances in Questionnaire Design, Development, Evaluation and Testing

Advances in Questionnaire Design, Development, Evaluation and Testing

PDF Advances in Questionnaire Design, Development, Evaluation and Testing Download

  • Author: Paul C. Beatty
  • Publisher: John Wiley & Sons
  • ISBN: 1119263638
  • Category : Mathematics
  • Languages : en
  • Pages : 816

A new and updated definitive resource for survey questionnaire testing and evaluation Building on the success of the first Questionnaire Development, Evaluation, and Testing (QDET) conference in 2002, this book brings together leading papers from the Second International Conference on Questionnaire Design, Development, Evaluation, and Testing (QDET2) held in 2016. The volume assesses the current state of the art and science of QDET; examines the importance of methodological attention to the questionnaire in the present world of information collection; and ponders how the QDET field can anticipate new trends and directions as information needs and data collection methods continue to evolve. Featuring contributions from international experts in survey methodology, Advances in Questionnaire Design, Development, Evaluation and Testing includes latest insights on question characteristics, usability testing, web probing, and other pretesting approaches, as well as: Recent developments in the design and evaluation of digital and self-administered surveys Strategies for comparing and combining questionnaire evaluation methods Approaches for cross-cultural and cross-national questionnaire development New data sources and methodological innovations during the last 15 years Case studies and practical applications Advances in Questionnaire Design, Development, Evaluation and Testing serves as a forum to prepare researchers to meet the next generation of challenges, making it an excellent resource for researchers and practitioners in government, academia, and the private sector.


Question Evaluation Methods

Question Evaluation Methods

PDF Question Evaluation Methods Download

  • Author: Jennifer Madans
  • Publisher: John Wiley & Sons
  • ISBN: 1118036999
  • Category : Mathematics
  • Languages : en
  • Pages : 299

Insightful observations on common question evaluation methods and best practices for data collection in survey research Featuring contributions from leading researchers and academicians in the field of survey research, Question Evaluation Methods: Contributing to the Science of Data Quality sheds light on question response error and introduces an interdisciplinary, cross-method approach that is essential for advancing knowledge about data quality and ensuring the credibility of conclusions drawn from surveys and censuses. Offering a variety of expert analyses of question evaluation methods, the book provides recommendations and best practices for researchers working with data in the health and social sciences. Based on a workshop held at the National Center for Health Statistics (NCHS), this book presents and compares various question evaluation methods that are used in modern-day data collection and analysis. Each section includes an introduction to a method by a leading authority in the field, followed by responses from other experts that outline related strengths, weaknesses, and underlying assumptions. Topics covered include: Behavior coding Cognitive interviewing Item response theory Latent class analysis Split-sample experiments Multitrait-multimethod experiments Field-based data methods A concluding discussion identifies common themes across the presented material and their relevance to the future of survey methods, data analysis, and the production of Federal statistics. Together, the methods presented in this book offer researchers various scientific approaches to evaluating survey quality to ensure that the responses to these questions result in reliable, high-quality data. Question Evaluation Methods is a valuable supplement for courses on questionnaire design, survey methods, and evaluation methods at the upper-undergraduate and graduate levels. it also serves as a reference for government statisticians, survey methodologists, and researchers and practitioners who carry out survey research in the areas of the social and health sciences.


Usability Testing for Survey Research

Usability Testing for Survey Research

PDF Usability Testing for Survey Research Download

  • Author: Emily Geisen
  • Publisher: Morgan Kaufmann
  • ISBN: 0128036818
  • Category : Computers
  • Languages : en
  • Pages : 252

Usability Testing for Survey Research provides researchers with a guide to the tools necessary to evaluate, test, and modify surveys in an iterative method during the survey pretesting process. It includes examples that apply usability to any type of survey during any stage of development, along with tactics on how to tailor usability testing to meet budget and scheduling constraints. The book's authors distill their experience to provide tips on how usability testing can be applied to paper surveys, mixed-mode surveys, interviewer-administered tools, and additional products. Readers will gain an understanding of usability and usability testing and why it is needed for survey research, along with guidance on how to design and conduct usability tests, analyze and report findings, ideas for how to tailor usability testing to meet budget and schedule constraints, and new knowledge on how to apply usability testing to other survey-related products, such as project websites and interviewer administered tools. - Explains how to design and conduct usability tests and analyze and report the findings - Includes examples on how to conduct usability testing on any type of survey, from a simple three-question survey on a mobile device, to a complex, multi-page establishment survey - Presents real-world examples from leading usability and survey professionals, including a diverse collection of case studies and considerations for using and combining other methods - Discusses the facilities, materials, and software needed for usability testing, including in-lab testing, remote testing, and eye tracking


Design, Evaluation, and Analysis of Questionnaires for Survey Research

Design, Evaluation, and Analysis of Questionnaires for Survey Research

PDF Design, Evaluation, and Analysis of Questionnaires for Survey Research Download

  • Author: Willem E. Saris
  • Publisher: John Wiley & Sons
  • ISBN: 1118634616
  • Category : Mathematics
  • Languages : en
  • Pages : 384

Praise for the First Edition “...this book is quite inspiring, giving many practical ideas for survey research, especially for designing better questionnaires.” —International Statistical Review Reflecting modern developments in the field of survey research, the Second Edition of Design, Evaluation, and Analysis of Questionnaires for Survey Research continues to provide cutting-edge analysis of the important decisions researchers make throughout the survey design process. The new edition covers the essential methodologies and statistical tools utilized to create reliable and accurate survey questionnaires, which unveils the relationship between individual question characteristics and overall question quality. Since the First Edition, the computer program Survey Quality Prediction (SQP) has been updated to include new predictions of the quality of survey questions on the basis of analyses of Multi-Trait Multi-Method experiments. The improved program contains over 60,000 questions, with translations in most European languages. Featuring an expanded explanation of the usage and limitations of SQP 2.0, the Second Edition also includes: • New practice problems to provide readers with real-world experience in survey research and questionnaire design • A comprehensive outline of the steps for creating and testing survey questionnaires • Contemporary examples that demonstrate the many pitfalls of questionnaire design and ways to avoid similar decisions Design, Evaluation, and Analysis of Questionnaires for Survey Research, Second Edition is an excellent textbook for upper-undergraduate and graduate-level courses in methodology and research questionnaire planning, as well as an ideal resource for social scientists or survey researchers needing to design, evaluate, and analyze questionnaires. Design, Evaluation, and Analysis of Questionnaires for Survey Research, Second Edition is an excellent textbook for upper-undergraduate and graduate-level courses in methodology and research questionnaire planning, as well as an ideal resource for social scientists or survey researchers needing to design, evaluate, and analyze questionnaires.Reflecting modern developments in the field of survey research, the Second Edition of Design, Evaluation, and Analysis of Questionnaires for Survey Research continues to provide cutting-edge analysis of the important decisions researchers make throughout the survey design process. The new edition covers the essential methodologies and statistical tools utilized to create reliable and accurate survey questionnaires, which unveils the relationship between individual question characteristics and overall question quality. Since the First Edition, the computer program Survey Quality Prediction (SQP) has been updated to include new predictions of the quality of survey questions on the basis of analyses of Multi-Trait Multi-Method experiments. The improved program contains over 60,000 questions, with translations in most European languages. Featuring an expanded explanation of the usage and limitations of SQP 2.0, the Second Edition also includes: • New practice problems to provide readers with real-world experience in survey research and questionnaire design • A comprehensive outline of the steps for creating and testing survey questionnaires • Contemporary examples that demonstrate the many pitfalls of questionnaire design and ways to avoid similar decisions Design, Evaluation, and Analysis of Questionnaires for Survey Research, Second Edition is an excellent textbook for upper-undergraduate and graduate-level courses in methodology and research questionnaire planning, as well as an ideal resource for social scientists or survey researchers needing to design, evaluate, and analyze questionnaires. WILLEM E. SARIS, PhD, is Emeritus Professor in Methodology of the University of Amsterdam and the Universitat Pompeu Fabra, Barcelona. He is Laureate of the 2005 Descartes Prize for “Best Collaborative Research” as member of the Central Coordinating Team of the European Social Survey (ESS) and Recipient of the World Association of Public Opinion Research’s “Helen Dinerman Award” in 2009 for his lifelong contribution to the methodology of Opinion Research. Dr. Saris also received the “2013 Outstanding Service Prize” of the European Survey Research Association. IRMTRAUD N. GALLHOFER, PhD, is a linguist and was senior researcher on projects of the ESS, Research and Expertise Centre for Survey Methodology at the Universitat Pompeu Fabra, Barcelona. She is Laureate of the 2005 Descartes Prize for “Best Collaborative Research” as a member of the Central Coordinating Team of the ESS.Reflecting modern developments in the field of survey research, the Second Edition of Design, Evaluation, and Analysis of Questionnaires for Survey Research continues to provide cutting-edge analysis of the important decisions researchers make throughout the survey design process. The new edition covers the essential methodologies and statistical tools utilized to create reliable and accurate survey questionnaires, which unveils the relationship between individual question characteristics and overall question quality. Since the First Edition, the computer program Survey Quality Prediction (SQP) has been updated to include new predictions of the quality of survey questions on the basis of analyses of Multi-Trait Multi-Method experiments. The improved program contains over 60,000 questions, with translations in most European languages. Featuring an expanded explanation of the usage and limitations of SQP 2.0, the Second Edition also includes: • New practice problems to provide readers with real-world experience in survey research and questionnaire design • A comprehensive outline of the steps for creating and testing survey questionnaires • Contemporary examples that demonstrate the many pitfalls of questionnaire design and ways to avoid similar decisions Design, Evaluation, and Analysis of Questionnaires for Survey Research, Second Edition is an excellent textbook for upper-undergraduate and graduate-level courses in methodology and research questionnaire planning, as well as an ideal resource for social scientists or survey researchers needing to design, evaluate, and analyze questionnaires. WILLEM E. SARIS, PhD, is Emeritus Professor in Methodology of the University of Amsterdam and the Universitat Pompeu Fabra, Barcelona. He is Laureate of the 2005 Descartes Prize for “Best Collaborative Research” as member of the Central Coordinating Team of the European Social Survey (ESS) and Recipient of the World Association of Public Opinion Research’s “Helen Dinerman Award” in 2009 for his lifelong contribution to the methodology of Opinion Research. Dr. Saris also received the “2013 Outstanding Service Prize” of the European Survey Research Association. IRMTRAUD N. GALLHOFER, PhD, is a linguist and was senior researcher on projects of the ESS, Research and Expertise Centre for Survey Methodology at the Universitat Pompeu Fabra, Barcelona. She is Laureate of the 2005 Descartes Prize for “Best Collaborative Research” as a member of the Central Coordinating Team of the ESS.


Methods for Testing and Evaluating Survey Questionnaires

Methods for Testing and Evaluating Survey Questionnaires

PDF Methods for Testing and Evaluating Survey Questionnaires Download

  • Author: Stanley Presser
  • Publisher: John Wiley & Sons
  • ISBN: 0471654736
  • Category : Mathematics
  • Languages : en
  • Pages : 624

The definitive resource for survey questionnaire testing and evaluation Over the past two decades, methods for the development, evaluation, and testing of survey questionnaires have undergone radical change. Research has now begun to identify the strengths and weaknesses of various testing and evaluation methods, as well as to estimate the methods’ reliability and validity. Expanding and adding to the research presented at the International Conference on Questionnaire Development, Evaluation and Testing Methods, this title presents the most up-to-date knowledge in this burgeoning field. The only book dedicated to the evaluation and testing of survey questionnaires, this practical reference work brings together the expertise of over fifty leading, international researchers from a broad range of fields. The volume is divided into seven sections: Cognitive interviews Mode of administration Supplements to conventional pretests Special populations Experiments Multi-method applications Statistical modeling Comprehensive and carefully edited, this groundbreaking text offers researchers a solid foundation in the latest developments in testing and evaluating survey questionnaires, as well as a thorough introduction to emerging techniques and technologies.


Cognitive Interviewing

Cognitive Interviewing

PDF Cognitive Interviewing Download

  • Author: Gordon B. Willis
  • Publisher: SAGE Publications
  • ISBN: 1483389308
  • Category : Social Science
  • Languages : en
  • Pages : 323

"As both an academic instructor in questionnaire design and a research design methodologist for the federal government, I feel this book is very timely, useful for students and practitioners, and unique in its use of real world practical examples that most everyone can relate." —Terry Richardson, General Accounting Office "The combination of theory and practical application will make this a useful book for students as well as professionals who want to learn how to incorporate cognitive interviewing into the questionnaire design process." —Rachel Caspar, RTI International The design and evaluation of questionnaires—and of other written and oral materials—is a challenging endeavor, fraught with potential pitfalls. Cognitive Interviewing: A Tool for Improving Questionnaire Design describes a means of systematically developing survey questions through investigations that intensively probe the thought processes of individuals who are presented with those inquiries. The work provides general guidance about questionnaire design, development, and pre-testing sequence, with an emphasis on the cognitive interview. In particular, the book gives detailed instructions about the use of verbal probing techniques, and how one can elicit additional information from subjects about their thinking and about the manner in which they react to tested questions. These tools help researchers discover how well their questions are working, where they are failing, and determine what they can do to rectify the wide variety of problems that may surface while working with questionnaires. Cognitive Interviewing is ideally suited as a course text for advanced undergraduate and graduate research courses across the social sciences. Professional researchers and faculty in the social sciences, as well as practice fields such as medicine, business, and education, will also find this an invaluable reference for survey research. There is no other book on the market that covers cognitive interviewing as applied to questionnaire design.


Handbook of Test Development

Handbook of Test Development

PDF Handbook of Test Development Download

  • Author: Suzanne Lane
  • Publisher: Routledge
  • ISBN: 1136242570
  • Category : Education
  • Languages : en
  • Pages : 676

The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.


International Handbook of Survey Methodology

International Handbook of Survey Methodology

PDF International Handbook of Survey Methodology Download

  • Author: Edith D. de Leeuw
  • Publisher: Routledge
  • ISBN: 113691062X
  • Category : Psychology
  • Languages : en
  • Pages : 560

Taking into account both traditional and emerging modes, this comprehensive new Handbook covers all major methodological and statistical issues in designing and analyzing surveys. With contributions from the world's leading survey methodologists and statisticians, this invaluable new resource provides guidance on collecting survey data and creating meaningful results. Featuring examples from a variety of countries, the book reviews such things as how to deal with sample designs, write survey questions, and collect data on the Internet. A thorough review of the procedures associated with multiple modes of collecting sample survey information and applying that combination of methods that fit the situation best is included. The International Handbook of Survey Methodology opens with the foundations of survey design, ranging from sources of error, to ethical issues. This is followed by a section on design that reviews sampling challenges and tips on writing and testing questions for multiple methods. Part three focuses on data collection, from face-to-face interviews, to Internet and interactive voice response, to special challenges involved in mixing these modes within one survey. Analyzing data from both simple and complex surveys is then explored, as well as procedures for adjusting data. The book concludes with a discussion of maintaining quality. Intended for advanced students and researchers in the behavioral, social, and health sciences, this "must have" resource will appeal to those interested in conducting or using survey data from anywhere in the world, especially those interested in comparing results across countries. The book also serves as a state-of-the-art text for graduate level courses and seminars on survey methodology. A companion website contains additional readings and examples.


Sensory Evaluation Practices

Sensory Evaluation Practices

PDF Sensory Evaluation Practices Download

  • Author: Herbert Stone
  • Publisher: Elsevier
  • ISBN: 0323155812
  • Category : Technology & Engineering
  • Languages : en
  • Pages : 327

Sensory Evaluation Practices examines the principles and practices of sensory evaluation. It describes methods and procedures for the analysis of results from sensory tests; explains the reasons for selecting a particular procedure or test method; and discusses the organization and operation of a testing program, the design of a test facility, and the interpretation of results. Comprised of three parts encompassing nine chapters, this volume begins with an overview of sensory evaluation: what it does; how, where, and for whom; and its origin in physiology and psychology. It then discusses measurement, psychological errors in testing, statistics, test strategy, and experimental design. The reader is also introduced to the discrimination, descriptive, and affective methods of testing, along with the criteria used to select a specific method, procedures for data analysis, and the communication of actionable results. The book concludes by looking at problems where sensory evaluation is applicable, including correlation of instrumental and sensory data, measurement of perceived efficacy, storage testing, and product optimization. This book is a valuable resource for sensory professionals, product development and production specialists, research directors, technical managers, and professionals involved in marketing, marketing research, and advertising.


Asking Questions

Asking Questions

PDF Asking Questions Download

  • Author: Norman M. Bradburn
  • Publisher: John Wiley & Sons
  • ISBN: 1119214769
  • Category : Business & Economics
  • Languages : en
  • Pages : 448

Since it was first published more than twenty-five years ago, Asking Questions has become a classic guide for designing questionnaires3⁄4the most widely used method for collecting information about people?s attitudes and behavior. An essential tool for market researchers advertisers, pollsters, and social scientists, this thoroughly updated and definitive work combines time-proven techniques with the most current research, findings, and methods. The book presents a cognitive approach to questionnaire design and includes timely information on the Internet and electronic resources. Comprehensive and concise, Asking Questions can be used to design questionnaires for any subject area, whether administered by telephone, online, mail, in groups, or face-to-face. The book describes the design process from start to finish and is filled with illustrative examples from actual surveys.