Hospital Ratings Explained

« Return to Hospital Ratings

Patient Experience

ratings explained

Patient Safety

ratings explained

Select Clinical Quality

ratings explained

Understanding Hospital Ratings for Select Clinical Quality: Basic Explanation

Ribbons and pies represent data that hospitals reported for discharges between January 1st, 2009 and December 31st, 2009.

The Maine Health Management Coalition awards pies and ribbons to hospitals that meet certain standards for quality care. Pies and ribbons are awarded in four areas:

  1. Heart attack (AMI)
  2. Heart failure (CHF)
  3. Pneumonia (PNE)
  4. Surgical care (SCIP)

Starting August 2009, the hospital rating system awards 2 different color ribbons – blue ribbons and blue ribbons with a gold inlay for meeting certain standards of care. These ratings are explained below.

The MHMC gets each hospital’s performance information from the Northeast Health Care Quality Foundation (NHCQF), Maine’s Quality Improvement Organization (QIO). Data is collected and submitted by the hospital every quarter.

The hospital’s performance rate shows the percent of the time that its patients got all of the care they needed. Hospital performance is based on the Appropriate Care Measure (ACM), which is the percent of patients that received ALL the care they were qualified to receive – the right care for every patient every time. This is also known as the “perfect care” measure and is thought to be the most meaningful for patients.

Pies are determined by comparing a hospital’s performance to how other hospitals around the country perform.

What Pie Looks Like What it is Called What Pie Rating Means
One-quarter (¼) pie Lower than U.S. average
Half (½) pie No different than U.S. average
Three-quarter (¾) pie Higher than U.S. average
Full pie Equal to or better than the top hospitals
Unable to Determine No pie, or “unable to determine” is not a reflection of performance. It means that we are unable to evaluate the correct score for statistical reasons (the hospital’s confidence interval spans both the national 50th and 90th percentiles).

Ribbons are then awarded based on the pies:

What Ribbon Looks like What it is Called What Ribbon Rating Means
Blue Ribbon with Gold Inlay Blue ribbon with gold seal inlay Best choice
Blue Ribbon Blue ribbon Better choice
No Ribbon No ribbon Performance is below U.S. average
Unable to Determine Unable to Determine For those we are unable to evaluate

What is Special Recognition? For information on mortality and readmission data, click here.


Understanding Hospital Ratings for Select Clinical Quality: Advanced Explanation

See below for more details about the Select Clinical Quality Ratings.

Process of Care:

Clinical quality facts are collected from hospitals’ patient records. The data is changed to rates that measure:

  1. How well the hospitals care for their patients
  2. The percentage of times that a patient received all of the care that they needed to result in a better outcome

The measures reported are:

MEASURE NAME
Heart Attack Patients Given ACE Inhibitor or ARB for Left Ventricular Systolic Dysfunction (LVSD)
Heart Attack Patients Given Aspirin at Arrival
Heart Attack Patients Given Aspirin at Discharge
Heart Attack Patients Given Beta Blocker at Discharge
Heart Attack Patients Given Smoking Cessation Advice/Counseling
Heart Failure Patients Given ACE Inhibitor or ARB for Left Ventricular Systolic Dysfunction (LVSD)
Heart Failure Patients Given an Evaluation of Left Ventricular Systolic (LVS) Function
Heart Failure Patients Given Discharge Instructions
Heart Failure Patients Given Smoking Cessation Advice/Counseling
Pneumonia Patients Assessed and Given Pneumococcal Vaccination
Pneumonia Patients with Blood Culture Before First Antibiotic
Pneumonia Patients Given Initial Antibiotic(s) within 6 Hours After Arrival
Pneumonia Patients Given Smoking Cessation Advice/Counseling
Pneumonia Patients Given the Most Appropriate Initial Antibiotic(s)
Pneumonia Patients Assessed and Given Influenza Vaccination
Surgery patients who were given an antibiotic at the right time (within one hour before surgery) to help prevent infection
Surgery patients whose preventive antibiotics were stopped at the right time (within 24 hours after surgery)
Surgery patients who were given the right kind of antibiotic to help prevent infection
Cardiac surgery patients with controlled blood glucose
Surgery patients with appropriate hair removal
Patients who got treatment at the right time (within 24 hours before or after their surgery) to help prevent blood clots after certain types of surgery
Surgery patients whose doctors ordered treatments to prevent blood clots after certain types of surgeries

How Does MHMC Turn the Facts Into Ratings?

It is not easy to turn each patient interaction into a quality rating, but below are some examples of how it is done.

Example A:

Hospital A has 100 heart failure patients

Each heart failure patient needs four things done

All 100 patients have all four things done

Hospital A receives a performance score of 100% for heart failure because it provided all of the care for every patient every time

Example B:

Hospital B has 100 heart failure patients

Each heart failure patient needs four things done

Eighty of the 100 patients receive all four things they need. Ten of the patients receive only 3 of the 4 things, and the other ten receive only 2 of the 4 things

Hospital B receives a performance score of 80% for heart failure because it provided all of the care for only eighty of the 100 patients (80/100=80%) every time

Turning Data into Pies for Clinical Care Categories:

Pies are determined by comparing a hospital’s performance to how other hospitals around the country perform. More specifically, pies are based on how the hospital compares to the national average (national 50th percentile) and to the top performers (national 90th percentile).

The absolute performance is not used for comparison (for example the 100% or 80% from examples A & B above) but, rather, what is called the confidence interval.

It is easier to be sure that something will happen again if you are basing your decision on a large sample size versus a small sample.

Example A:

For example, if person A records the time that it takes her to drive to work for sixty days and calculates the average based on sixty days, and person B records the time that it takes him to drive to work for two days and uses that to calculate the average—person A could be much more “confident” and could predict within smaller ranges (confidence intervals would be narrow) the time that it would take to drive to work in the future. Person B with only two days of data would be less “confident” that they could predict the actual time it might take them in the future (confidence intervals would be more wide) because they are basing it on so few data points.

The MHMC considers that some hospitals have more patients and others fewer patients before awarding pies and ribbons. The QIO determines a confidence interval for each hospital based on the number of patients each hospital sees. Hospitals can earn pies as follows:

What Pie Looks Like What it is Called What Pie Rating Means More Detail
Unable to Determine No pie, or unable to determine, is not a reflection of performance. It means that we are unable to evaluate the correct score for statistical reasons (hospital confidence interval that spans both the national 50th and 90th percentiles).
One-quarter (¼) pie Lower than U.S. average If a hospital’s confidence interval falls below the 50th percentile performance of all hospitals that report nation-wide, that hospital receives a ¼ pie.
Half (½) pie No different than U.S. average If a hospital’s confidence interval spans the 50th percentile, they receive ½ pie.
Three-quarter (¾) pie Higher than U.S. average If a hospital’s confidence interval is between the 50th and the 90th percentile performance, they are awarded a ¾ pie.
Full pie Equal to or better than the top hospitals If a hospital’s confidence interval is at or above the 90th percentile performance, they are awarded a full pie.

Turning Data into Ribbons for Clinical Care Categories:

Once the pies are determined, ribbons are awarded as follows:

What Ribbon Looks like What it is Called What Ribbon Rating Means More Detail
Unable to Determine Unable to Determine For those we are unable to evaluate If a hospital’s confidence interval crosses both the 50th and the 90th percentile performance, they are “unable to determine.” This does not mean that a hospital is performing poorly. In fact, many of the hospitals that are unable to be evaluated are actually performing well – they gave the right care to the right patients all of the time! Using our drive-to-work-time example above, Unable To Determine does not mean that Person B does not have actual results better than Person A. It just means that one cannot statistically evaluate if Person B’s results are different from the other drivers.
Blue Ribbon with Gold Inlay Blue ribbon with gold seal inlay Best choice Equal to a full pie at or above national 90th percentile. National 90th percentile is calculated by rating all of the hospitals from highest to lowest, selecting the top performing hospitals that care for 10% of all of the patients, and using the mean of those hospitals as the national 90th percentile benchmark
Blue Ribbon Blue ribbon Better choice Awarded for ½ or ¾ pies. Being at or above the 50th percentile means that the hospital performed better than the average performance in the country
No Ribbon No ribbon Performance is below U.S. average

What is Special Recognition? For information on mortality and readmission data, click here.

MHMC used a variety of data resources to measure patient experience, safety, and clinical quality. If you would like to review these data sources yourself, please click on the links below:

Web site by AvenueVERVE