- Chopit works well even when vignettes are asked of only a random subset of respondents, but chopit is only effective if your survey includes variables (Vi) that can predict the threshold variation across respondents. Chopit will be more effective when γ1 (the effect of V on the thresholds) is stable across respondents.
- Our nonparametric method only works for respondents who have been asked both vignettes and self-assessments. It can be applied to the subset that have been asked both, or both could be asked of all respondents. The advantage of this method is that variables Vi that are necessary to predict the thresholds in chopit are not needed here. So if you are sure you don't have Vi, ask vignettes of all respondents.
- These decisions can be made best by evaluating actual pretest data.
- Adaptive survey methods might be highly efficient here, whereby respondents are offered new vignettes depending on their previous vignette answers. In this situation, a CATI system could locate vignettes to the left and right of a respondent's self-assessment by bisecting the continuum using a small subset of a large list of a priori rank ordered list of vignettes. Each respondent would then be asked a relatively small number of vignettes. Be aware, however, that this strategy would require a new statistical method be developed.
Anchoring Vignettes
- Frequently Asked Questions
- About this document
- Introduction
- Statistical Analyses with Anchoring Vignettes
- Survey Instrumentation
- Are universally applicable, culture-independent survey questions possible?
- Can I use anchoring vignettes if I don't have variables to predict the thresholds?
- Can I use anchoring vignettes to understand why respondents understand survey questions in such different ways?
- Can we avoid DIF by using a panel design, without vignettes?
- Do I need one vignette for each response category?
- Doesn't Anchoring Vignettes merely move the problem of coming up with DIF-free survey questions back one level (from self-assessments to vignettes), and so in the end you have the same problem?
- How is this strategy affected by the finding in social-psychology that assessments of oneself and others differ?
- How many anchoring vignettes should I ask for each concept I want to measure?
- How much expense will anchoring vignettes add?
- If I have a direct physical measurement, such as a medical test, do I need anchoring vignettes?
- In what order should vignettes and self-assessment questions be asked?
- Is there a simpler way of asking questions so we can avoid any statistical analysis?
- Should I ask vignettes questions of all people or a random subset?
- Should the vignette describe the age, sex, etc., of the hypothetical person? Should it be self-referential?
- What are the requirements
- What empirical evidence do you have that it works?
- What has to go wrong for anchoring vignette corrections to bias my results?
- What issues should I consider when writing vignettes?
- When do anchoring vignettes make the most difference?
- Why Use Anchoring Vignettes?
- Why will anchoring vignettes work when we know that putting educational achievement tests on a common scale has not been possible?
Copyright © 2024 The President and Fellows of Harvard College | Accessibility | Digital Accessibility | Report Copyright Infringement