February 26, 2024 | Anne Gärtner, Daniel Leising, Felix D. Schönbrodt
The article discusses the need for a shift in academic research assessment from focusing primarily on quantitative metrics (such as the number of publications, journal impact factors, or h-index) to prioritizing research quality, transparency, reproducibility, and innovation. The authors highlight the limitations of current evaluation systems, which can encourage behaviors that hinder scientific progress. They introduce the RESQUE (Research Quality Evaluation) framework, a holistic and nuanced evaluation method that combines objective metric indicators with in-depth, discursive assessments of research content. RESQUE aims to address the issues by proposing specific criteria for evaluating research articles, datasets, and research software, emphasizing methodological rigor, reproducibility, and transparency. The framework is currently being developed and tested, with a focus on broad applicability across various academic disciplines. The authors argue that this shift can help build a more robust and impactful scientific community.The article discusses the need for a shift in academic research assessment from focusing primarily on quantitative metrics (such as the number of publications, journal impact factors, or h-index) to prioritizing research quality, transparency, reproducibility, and innovation. The authors highlight the limitations of current evaluation systems, which can encourage behaviors that hinder scientific progress. They introduce the RESQUE (Research Quality Evaluation) framework, a holistic and nuanced evaluation method that combines objective metric indicators with in-depth, discursive assessments of research content. RESQUE aims to address the issues by proposing specific criteria for evaluating research articles, datasets, and research software, emphasizing methodological rigor, reproducibility, and transparency. The framework is currently being developed and tested, with a focus on broad applicability across various academic disciplines. The authors argue that this shift can help build a more robust and impactful scientific community.