Multicollinearity and Model Misspecification

Christopher Winship, Bruce Western

Sociological Science, July 26, 2016
DOI 10.15195/v3.a27

Multicollinearity in linear regression is typically thought of as a problem of large standard errors due to near-linear dependencies among independent variables. This problem can be solved by more informative data, possibly in the form of a larger sample. We argue that this understanding of multicollinearity is only partly correct. The near collinearity of independent variables can also increase the sensitivity of regression estimates to small errors in the model misspecification. We examine the classical assumption that independent variables are uncorrelated with the errors. With collinearity, small deviations from this assumption can lead to large changes in estimates. We present a Bayesian estimator that specifies a prior distribution for the covariance between the independent variables and the error term. This estimator can be used to calculate confidence intervals that reflect sampling error and uncertainty about the model specification. A Monte Carlo experiment indicates that the Bayesian estimator has good frequentist properties in the presence of specification errors. We illustrate the new method by estimating a model of the black–white gap in earnings.

Creative Commons LicenseThis work is licensed under a Creative Commons Attribution 4.0 International License.
Christopher Winship: Department of Sociology, Harvard University

Bruce Western: Department of Sociology, Harvard University

Acknowledgements: We thank Kinga Makovi for help in the preparation of the manuscript. We also appreciate the editor’s suggestions for citations that we were unaware of.

  • Citation: Winship, Christopher, and Bruce Western. 2016. “Multicollinearity and Model Misspecification.” Sociological Science 3:627-649.
  • Received: February 5, 2016
  • Accepted: March 5, 2016
  • Editors: Jesper Sørensen, Olav Sorenson
  • DOI: 10.15195/v3.a27

, ,

Reactions to this article are closed.