Survey research plays a crucial role in understanding complex issues, such as bias and work climate in medicine. However, the validity of the results heavily depends on the robustness of the statistical methods employed. A recent study by Carnes and colleagues serves as a reminder of the pitfalls of statistical fragility. Low response rates, small effect sizes, and multiple significance tests can lead to misleading conclusions. Researchers should strive for higher response rates and larger effect sizes to ensure the reliability of their findings and to drive meaningful change in their fields.
Heston TF. Statistical Fragility in Surveys. Acad Med 2024 Mar 1;99(3):240. doi: 10.1097/ACM.0000000000005584. Epub 2023 Dec 7.