This site offers survey researchers, and others, help in addressing two long-standing questions:
- How can we do survey research if different respondents (perhaps from different cultures, countries, or ethnic groups) understand questions in completely different ways, or if investigators mean one thing and respondents think they mean something else?
- How can we develop accurate measures of complicated concepts which we can define only by example ("you know it when you see it"), and when attempts to produce more concrete questions tend to be more concrete but no more valid?
To at least partially ameliorate these problems, we introduce the idea of anchoring vignettes. These are (usually brief) descriptions of hypothetical people or situations that survey researchers can use to correct otherwise inter-personally incomparable survey responses. Survey questions are a function of the actual quantity being measured along with a dose of interpersonal in-comparability (i.e., different for each respondent). The survey literature has focused for decades on asking more concrete questions intended to reduce the incomparable portion, but with only mixed success. The new idea underlying anchoring vignettes is to measure directly, and then subtract off, the incomparable portion. To do this, we ask respondents for self-assessments of the concept being measured along with assessments, on the same scale, of each of several hypothetical individuals described in anchoring vignettes. Since the actual (but not necessarily reported) levels for the people in the vignettes are, by the design of the survey, invariant over respondents, the only reason answers to the vignettes will differ over respondents is interpersonal in-comparability. This provides sufficient information for the statistical models we have designed to correct the self-assessments.
Anchoring vignettes are also being used by philosophers, lawyers, and others to help define (and not necessarily measure) concepts by example, or from the bottom up. Especially when agreeing on broad theoretical concepts is difficult or impossible, it is still often possible to agree on the specifics of individual cases. By defining sets of anchoring vignettes, it is often possible to arrive at a definition inductively using this same approach. The National Research Council's Committee on Privacy in the Information Age used anchoring vignettes to define the concept of privacy; see this report, including example vignettes.
- Academic Articles (& Software)
- Library of Anchoring Vignette Examples, by researchers in many fields
- Frequently Asked Questions
-
Conferences and Talks on Anchoring Vignettes
- A conference sponsored by the Royal Statistical Society, Anchoring Vignettes in Social Science Research, 11/17/2010, in London. See call for papers (also for publication in JRSS-A): .
- Talk: Improving comparability of self-reported health through direct or implied comparisons to anchoring vignettes Joshua A. Salomon, International Health Economics Association, 14 July 2009
- Talk: Anchoring Vignettes for Interpersonal and Cross-Cultural Incomparability in Survey Research, Harvard China Social Development Forum, Harvard University, 10/26/09 (Slides: | Printable Slides: )
- Anchoring Vignettes for Interpersonally Incomparable Survey Responses, Graduate Methods and Models Class, Harvard University, 9/18/09 (Slides: ) | Printable Slides:
- Interpersonal and Cross-Cultural Incomparability in Survey Research, Harvard School of Public Health Visiting Committee, dinner talk (Slides: Slides (for printing)) | Printable Slides:
- What to do about Biases in Survey Research, Keynote address, 9th National Congress of the French Association of Political Science, Toulouse, 9/5-7/2007, (Slides: | Printable Slides: )
- Anchoring Vignettes for Interpersonally Incomparable Survey Responses, World Bank, 1/23/2007 (Slides: Slides (for printing)) | Printable Slides:
- A conference sponsored by NIA and WHO 10/14-10/15/2003 at Harvard.
- Talk on anchoring vignettes on 10/7/2003 in the Social Psychology Workshop at Harvard.
- A special Invited Address on the subject will be given at the American Association of Public Opinion Research (AAPOR) Annual Conference, Sheraton Music City Hotel, Salon F, Nashville, Tennessee, 4-5:30pm, 5/16/03.
- A conference sponsored by the Boston Chapter of the American Statistical Association will be held 3/17/03. To register, contact Sue Perry at 617-965-8000 x 21 or sperry@rhoworld.com.
- The National Institute on Aging held a conference at Harvard University on anchoring vignettes on 9/6/02 for the researchers they support who run major health surveys.
- The World Health Organization held a meeting of experts at Harvard on 10/1/01-10/2/01 to evaluate anchoring vignettes for use in the World Health Survey.
- Anchoring Vignettes Email Discussion list: [Un-]Subscribe or Search archives
- Full length video of a lecture on anchoring vignettes (to the Boston Chapter of the American Statistical Association, filmed by Harvard@Home)
- 10 second video clip with everything you ever wanted to know about interpersonal incomparability
Please send email if you have example vignettes, suggestions for the FAQ, papers, or other information related to anchoring vignettes you would like us to list here.
This research is an outgrowth of an ongoing National Institute on Aging grant on The Global Burden of Disease 2000 in Aging Populations (P01 AG17625-01). We also received support from NSF (grants SES-0112072 and IIS-9874747), the World Health Organization, and the Weatherhead Center for International Affairs and the Institute for Quantitative Social Science at Harvard University.