23 July 2009 | Anita Kothari*1, Nancy Edwards2, Nadia Hamel3 and Maria Judd4
The article "Is research working for you? A self-assessment tool and discussion guide for health services management and policy organizations" by Anita Kothari, Nancy Edwards, Nadia Hamel, and Maria Judd, evaluates the effectiveness of a tool designed to help health organizations assess their capacity to use research. The study involved 32 focus groups with participants from four sectors of Canadian health organizations: federal government branches, long-term care organizations, non-governmental organizations, and community-based organizations. The tool was designed to assess organizations' ability to acquire, assess, adapt, and apply research evidence. Key findings include:
1. **Usability and Response Variability**: The tool demonstrated good usability and strong response variability, indicating that it effectively captures the skills and resources relevant to research use.
2. **Differentiation Between Users**: Higher-end and lower-end research users showed significant differences in scores, suggesting the tool has adequate discriminant validity.
3. **Group Discussion**: The group discussions based on the tool were more useful than the actual scores assigned, highlighting the value of the discussion process in fostering insights and interventions.
4. **Organizational Context**: The tool was less effective in the government sector, suggesting the need for further tailoring to reflect the specific context.
5. **Conclusion**: The tool can serve as a catalyst for discussions about research use, which itself can be an intervention to encourage processes and supports for evidence-informed decision-making in healthcare systems.
The authors recommend that organizations use the tool to distinguish between those capable of acquiring, assessing, adapting, and applying research and those with fewer supports. They also suggest that the tool can be used as a baseline measure to track improvements in research capacity over time.The article "Is research working for you? A self-assessment tool and discussion guide for health services management and policy organizations" by Anita Kothari, Nancy Edwards, Nadia Hamel, and Maria Judd, evaluates the effectiveness of a tool designed to help health organizations assess their capacity to use research. The study involved 32 focus groups with participants from four sectors of Canadian health organizations: federal government branches, long-term care organizations, non-governmental organizations, and community-based organizations. The tool was designed to assess organizations' ability to acquire, assess, adapt, and apply research evidence. Key findings include:
1. **Usability and Response Variability**: The tool demonstrated good usability and strong response variability, indicating that it effectively captures the skills and resources relevant to research use.
2. **Differentiation Between Users**: Higher-end and lower-end research users showed significant differences in scores, suggesting the tool has adequate discriminant validity.
3. **Group Discussion**: The group discussions based on the tool were more useful than the actual scores assigned, highlighting the value of the discussion process in fostering insights and interventions.
4. **Organizational Context**: The tool was less effective in the government sector, suggesting the need for further tailoring to reflect the specific context.
5. **Conclusion**: The tool can serve as a catalyst for discussions about research use, which itself can be an intervention to encourage processes and supports for evidence-informed decision-making in healthcare systems.
The authors recommend that organizations use the tool to distinguish between those capable of acquiring, assessing, adapting, and applying research and those with fewer supports. They also suggest that the tool can be used as a baseline measure to track improvements in research capacity over time.