DO PEOPLE MEAN WHAT THEY SAY? IMPLICATIONS FOR SUBJECTIVE SURVEY DATA

DO PEOPLE MEAN WHAT THEY SAY? IMPLICATIONS FOR SUBJECTIVE SURVEY DATA

January 2001 | Marianne Bertrand and Sendhil Mullainathan
The paper "Do People Mean What They Say? Implications for Subjective Survey Data" by Marianne Bertrand and Sendhil Mullainathan explores the reliability of subjective survey questions in economic research. The authors highlight several cognitive and social factors that can affect how people answer such questions, including the order of questions, wording, scales, and social desirability. They argue that these factors can lead to measurement errors in the data, which can bias statistical analyses. The paper presents a measurement error framework to understand the implications of these errors for empirical research. It suggests that while subjective variables can be useful as control variables in predicting outcomes, they should not be used as dependent variables due to the correlation between measurement errors and individual characteristics. The authors also find that changes in reported attitudes do not help predict changes in outcomes, but stable attitudes can explain differences in behavior across individuals. Empirical work using data from the High School & Beyond survey supports these findings, showing that attitudes can predict future income and job satisfaction, but changes in reported attitudes do not predict changes in income or job turnover. The authors conclude that while subjective data can be valuable as explanatory variables, it should be interpreted with caution due to the presence of measurement errors.The paper "Do People Mean What They Say? Implications for Subjective Survey Data" by Marianne Bertrand and Sendhil Mullainathan explores the reliability of subjective survey questions in economic research. The authors highlight several cognitive and social factors that can affect how people answer such questions, including the order of questions, wording, scales, and social desirability. They argue that these factors can lead to measurement errors in the data, which can bias statistical analyses. The paper presents a measurement error framework to understand the implications of these errors for empirical research. It suggests that while subjective variables can be useful as control variables in predicting outcomes, they should not be used as dependent variables due to the correlation between measurement errors and individual characteristics. The authors also find that changes in reported attitudes do not help predict changes in outcomes, but stable attitudes can explain differences in behavior across individuals. Empirical work using data from the High School & Beyond survey supports these findings, showing that attitudes can predict future income and job satisfaction, but changes in reported attitudes do not predict changes in income or job turnover. The authors conclude that while subjective data can be valuable as explanatory variables, it should be interpreted with caution due to the presence of measurement errors.
Reach us at info@study.space
[slides and audio] Do People Mean What They Say%3F Implications for Subjective Survey Data