Performance Measurement

Quality indicators to measure outcomes of community mental health services across providers are infrequently used because most jurisdictions lack standardized clinical data sources which are necessary to develop shared indicators. Consequently important information about the effectiveness and impact of these mental health services often remains unknown. However, the implementation of the Ontario Common Assessment of Need (OCAN), a standardized assessment tool in the community mental health sector, affords an opportunity to leverage data derived from the tool to develop and pilot MHQI in order to support improvement efforts for community mental health services.

In collaboration with CMHA Ontario and approximate 10-15 community mental health providers, CMHA Toronto is leading a study using provincial OCAN data which will:

• Pilot MHQIs derived from the OCAN with community mental health providers
• Evaluate the feasibility of using these MHQIs for caring out outcome measurement of community mental health services, and
• Support providers to improve the quality of their OCAN data

For more information about this study, contact Frank Sirotich at fsirotich@cmhato.org.

Frank Sirotich, Carol Adair, Elizabeth Lin, Christopher Canning
Healthcare Management Forum, 2019; 32:105-112.

To inform the future development of a pan-Canadian Mental Health and Addictions (MHA) performance measurement framework, we undertook a review and comparison of current provincial/territorial MHA policies and performance measurement frameworks. Most did not have performance measurement approaches that were explicitly linked to policy actions but eleven acknowledged the importance of performance measurement. Among the provinces with a framework, there were few performance domains in common. The common policy priorities and areas of convergence in current performance measurement practices may provide a useful starting point for the development of a pan-Canadian MHA performance measurement framework.

Frank Sirotich, Carol Adair, Janet Durbin, Elizabeth Lin, Christopher Canning
Healthcare Management Forum 2019; 32:97-104.

To inform the development of a pan-Canadian Mental Health and Addictions (MHA) performance measurement framework, we undertook a rapid review of the recent Performance Measurement (PM) literature and solicited input from 20 MHA policy and measurement experts. Six key steps for framework development were identified: recognizing and acknowledging key issues, developing shared language and understanding of key concepts, defining overall scope, defining framework dimension/domains, selecting indicators and using systematic engagement and consultation processes with stakeholders. Subject matter experts underscored the need for a comprehensive engagement process which would honour multiple stakeholder viewpoints and attend to key issues in the co-design of features of the PM framework. Findings from this analysis may be used to inform a comprehensive stakeholder consultation process for the development of a pan-Canadian PM framework for MHA.