About the Tools | Past Workshop Agendas and Materials | Upcoming Technical Assistance


State Healthcare Quality Improvement Workshop: Tools You Can Use to Make a Difference
Agency for Healthcare Research and Quality
January 17-18, 2008

In the background is a mountain range with a field and streams. In the foreground is a tree covered in frost.

Slide 1

This presentation uses a landscape of blue skies and frost-covered trees and forests as a template. The AHRQ logo is centered at the bottom of each slide.

DATA to Maine PEOPLE
Information Actually

Dennis Shubert M.D., Ph.D.

Agency for Healthcare Research and Quality

State Healthcare Quality Improvement Workshop:

Tools You Can Use to Make a Difference

January 17-18, 2008

Slide 2

Goals of Presentation

• Brief background and principles of Maine Quality Forum

• Understand Maine 's data advantages

• Demonstrate and explain Maine Hospital Quality Snapshots web site

Slide 3

Data show less nursing care at EMMC Hours logged at Bangor hospital below level of similar centers

By Meg Haskell

OF THE NEWS STAFF

Source:

Bangor Daily News

Thursday, 10/11/2007

Edition: all, Section: a, Page 1

Slide 4

This slide contains a data table entitled EMMC Nursing Care Hours Data (2006).

Source: Maine Quality Forum (Dirigo Health)

Slide 5

Delayed Time to Defibrillation after In-Hospital Cardiac Arrest

The x-axis of the bar graph represents Minutes to Defibrillation and the Y-axis represents the percentage of Survival to Discharge. The approximate percentage of survival to discharge for the minute to defibrillation is 40 percent for less than one minute, 38 percent for two minutes, 33 percent for three minutes, 24 percent for four minutes, 25 percent for five minutes, 20 percent for six minutes, and 15 percent for more than six minutes.

Underneath the bar graph is a data table with columns entitled Minutes to Defibrillation, No. of Patients, Survived to Discharge, Unadjusted Odds Ratio (95% CI), Adjusted Odds Ratio (95% CI), and P Value.

Chan, Krumholz, Nichol, Nallamothu. "Delayed Time to Defibrillation after In-Hospital Cardiac Arrest," New England Journal of Medicine, Vol. 358, No. 1, January 3, 2008, p. 16.

Slide 6

The Maine Quality Forum

• Created as part of the Dirigo Health Agency

• Access, Cost and Quality Triad

• Tasked with assessing the quality of healthcare in Maine and reporting information to the people of Maine

• Tasked with promoting and public reporting of comparative use of best practices in Maine

• Pursue mission of providing actionable information about health care quality in easily accessible format

Slide 7

Addressing the Mandates

• Used IOM definition (STEEEP) as guiding framework

• right thing, the right way, at the right time for each patient

• Employ known levers of change

Slide 8

Levers of Change

• Change requires accountability and transparency

• Both healthcare system and MQF

• The People of Maine as a constituency

• Data describing best practices and outcomes are essential

Slide 9

Supporting Levers of Change

• Both "administrative" data and provider submitted data

• Common understanding of metrics is essential

• Information understandable by the public is a key driving force

• Communication target not necessarily the change target

Slide 10

Maine Advantages

• Tradition of self-examination: Maine Medical Assessment Foundation (MMAF) and small area variation analysis (SAVA)

• Long standing discharge data base

• Leader in "all payer", paid claims database

• Accomplished partners in Maine Health Data Organization (state) and Maine Health Information Center (private)

• MQF drives data submission through rule making (science confused with self interest)

Slide 11

Creating the Maine Snapshots

Slide 12

Data Process

• Started with Small Area Variation Analysis (SAVA)

• Participated in the Tri-partite group of Pathways to Excellence to gain buy in of metrics

• Developed initial website with a key data component

Slide 13

Initial Website

• Used small area variation analysis on procedures and inpatient activity of interest

• Presented data via bar charts developed in Excel

• Graphs presented hospitals significantly different from the expected

• Provided data tables for drill down

• Good start but difficult to understand

• Very difficult to update new data runs

• MQF site for example www.mainequalityforum.gov

Slide 14

Revision Process

• MQF and Advisory Council concurred:

• Simpler representation

•  Don't' Make Me Think

• Broader audience

• More than one view of the data

• Drill down from simplest to most complex (visual to raw data)

• Needed to include new data (Chapter 270)*

Slide 15

Next Steps

• Intrigued by dial graphics representation used by AHRQ Quality Snapshots

• Reached out to AHRQ (Dwight) who brokered relationship with Thomson and Academy Health

• Connected with Thomson (aka Medstat)

• Provided us with code

Slide 16

Medstat

• MQF Determined a need for support

• Methods

• Web design

• Training

• Contracted with Medstat

• Contracted with RADCorp

• Began process of applying methodology to Maine 's data

• Training MHDO Epidemiologist

Slide 17

Methodological Challenges Encountered

• Small "N"

• Limited by number of hospitals

• Small "n"

• Limited by number of measures

• Limited by number of cases within measure

• Regression Model

• Nursing Data

• Phase II SAVA-Geographic Information Systems (GIS) design

Slide 18

Stakeholder Contributions

•  Maine Hospital Association

• PTE process

•  Northern New England Quality Improvement Organization

• Nursing Data

• Public Process

• Advisory Council

• Multi-stakeholder involvement

• Multiple views

• Other political considerations

Slide 19

Common Consistent Stakeholder Differences

• Patient

• If I previously had no information; am I not better off if I have information that provides a better that 50/50 chance of improving the outcome of my choice?

• Provider

• Don't show a difference unless there is a 99/100 chance that there is a substantive difference

Slide 20

Resolutions

• Change to speedometer

• Change methodology

• Regression model

• Data inclusion/exclusion

• Nursing Data Representation

• Descriptive Language

• New MQF data site: 207.103.203.51

Slide 21

Phase II

• GIS maps for variation analyses

• New Chapter 270 data

Slide 22

The background of this slide contains the AHRQ logo centered at the bottom of the slide, and is a picture of a corner of a stone wall.

Maine Quality Forum B Website

http://207.103.203.51

Also, www.mainequalityforum.gov

Slide 23

Cardiology Results

This slide contains a scatter plot entitled Distribution of services vary despite similar risk profile. The x-axis represents time from 8/6/03 until 12/6/04 in two month increments. The y-axis represents three patients.

The dark blue triangles represent Cardiology E&M Visit, magenta triangles represent Other Specialty E&M Visit, green diamond represent Cardiac Test, blue circle represent Cardiac Procedure, and gray box represent Inpatient Stay. There seems to be a random distribution of the points. Underneath the scatter plot are descriptions of Patient 1 and Patient 2.

Copyright Health Dialog Services Corporation 2007. All rights reserved.

The Health Dialog logo is located in the lower right.

Slide 24

This is a blank slide with the template background.

Slide 25

dennis.shubert@gmail.com

The background of this slide is a picture of a snow covered landscape at sunset. The AHRQ logo is centered at the bottom of the slide.

Slide 26

Citations

•  Delayed Time to Defibrillation After In- Hospital Cardiac Arrest

•  NEJM Volume 358:9-17 January 3, 2008 Number 1

• Cardiology Analysis

• Maine Quality Forum with Health Dialog Analytic Solutions 2006 (unpublished)

Back to Top