(68) Assumption violation detection in linear regression: A(nother) cautionary tale

Violating linear regression assumptions, specifically homoskedasticity, can noticeably influence the validity of null hypothesis significance tests on regression coefficients. Commercial software like SPSS already includes many tests for assumption violations, and robust inference alternatives can be applied just as easily. Hence, it may seem reasonable to first test linear regression assumptions, and then, depending on the outcome, decide whether a robust inference method is used instead of the classical method that relies on assumptions being met. This simulation study evaluates the performance of such a two-step decision process in scenarios where neither, one, or both the homoskedasticity and normality assumptions are violated. Additionally, we assess the general performance of four inference methods as well as tests of normality and of homoskedasticity assumptions that are available in SPSS. We find that, if the goal is to generally detect deviations from normality, homoskedasticity, or a combination of both, the z-kurtosis test performs most consistently but has low power in small samples. Further, because of inflated type I error rates in small samples and no additional benefit over choosing a robust inference methods from the get-go in large samples, the typical two-step decision approach can generally not be recommended.

Recommended citation: Rajh-Weber, H., Huber, S. E., & Arendasy, M. (2026). Assumption violation detection in linear regression: A(nother) cautionary tale. Research in Statistics, 4(1), 2746572.
Get Paper