January 2001 | Kitchenham, B.A.; Pfleeger, S.L.; Pickard, L.M.; Jones, P.W.; Hoaglin, D.C.; El-Emam, Khaled; Rosenberg, J.
The document "Preliminary Guidelines for Empirical Research in Software Engineering" by Kitchenham et al. (2001) aims to improve the quality and reporting of empirical research in software engineering. The guidelines are based on a review of medical research guidelines and the authors' experience in conducting and reviewing software engineering studies. They are intended to assist researchers, reviewers, and meta-analysts in designing, conducting, and evaluating empirical studies. The guidelines cover six main areas: experimental context, experimental design, conducting the experiment and data collection, and analysis. Key points include the importance of specifying industrial context, defining research hypotheses, using appropriate sampling methods, ensuring unbiased allocation of subjects to treatments, defining experimental units, performing pre-experiment calculations for sample size, using appropriate levels of blinding, defining treatments and outcome measures, and controlling for multiple testing in data analysis. The guidelines emphasize the need for clear and consistent reporting to facilitate replication and meta-analysis.The document "Preliminary Guidelines for Empirical Research in Software Engineering" by Kitchenham et al. (2001) aims to improve the quality and reporting of empirical research in software engineering. The guidelines are based on a review of medical research guidelines and the authors' experience in conducting and reviewing software engineering studies. They are intended to assist researchers, reviewers, and meta-analysts in designing, conducting, and evaluating empirical studies. The guidelines cover six main areas: experimental context, experimental design, conducting the experiment and data collection, and analysis. Key points include the importance of specifying industrial context, defining research hypotheses, using appropriate sampling methods, ensuring unbiased allocation of subjects to treatments, defining experimental units, performing pre-experiment calculations for sample size, using appropriate levels of blinding, defining treatments and outcome measures, and controlling for multiple testing in data analysis. The guidelines emphasize the need for clear and consistent reporting to facilitate replication and meta-analysis.