Data Warehousing & Analytics: Harnessing Metrics That Matter

Dawn Jackson-Freyman's picture

Lifesaving & Life Affirming Power in the Numbers

The Enterprise Data Warehousing & Analytics Team recently launched two new dashboards designed to capture metrics that are important to monitor costs, quality, performance and outcomes in various departments throughout UCSF.

iRocket is a dashboard that measures medical students’ professionalism and their medical knowledge, and in doing so allows both students and faculty to identify strengths and concerns and, as necessary, develop a plan for improvement. iRocket, which was launched January 16, 2015, was developed by the Enterprise Data Warehousing & Analytics Team in partnership with the School of Medicine and Medical Education.

“The School of Medicine and Medical Education wants to formally acknowledge and thank Jeff Love, Sandy Ng and their team for partnering with us on development of the new Medical Education Assessment Dashboard (iRocket),” said Kevin H. Souza, MS, associate dean for Medical Education. “This productive collaboration has a huge impact on the success of students and our new Bridges Curriculum.”

The professionalism section of the dashboard displays information about student professional behavior across the curriculum. The purpose is to summarize professionalism information from the Essential Core (EC), Clinical Core, and CPX clinical performance exam.

The medical knowledge section displays information about student performance on medical knowledge assessments across the curriculum. Student performance in the EC subjects, which are tracked longitudinally, are displayed along with the possible points and the class average for each subject. Also included are student overall EC subject scores. Student clerkship medical knowledge ratings from summary evaluations, clerkship examination scores, and MCAT, USMLE Step 1 and 2 scores, as available, are also included. This integrated view of these data will allow students to gauge their relative strengths and weaknesses in medical knowledge areas.

“We are so very excited to see this dream come to fruition,” said Catherine Lucey, vice dean, School of Medicine. “Please know that this will be hugely impactful in helping our students and their faculty coaches understand how best to ensure that our graduates are top notch!”


Sepsis Dashboard

The Sepsis Dashboard or Sepsisdash, launched February 13, 2015, is an innovative tool that utilizes sepsis alert data generated in APeX to drive sepsis care bundle compliance and to improve patient outcomes. The dashboard provides robust and timely data to help clinical teams proactively monitor and manage sepsis care at UCSF.

Being Vigilant

The sepsis surveillance system continuously scans clinical data for early signs and symptoms of sepsis within vital sign, laboratory, and nursing documentation to generate a Sepsis Best Practice Alert (BPA). The BPAs warn clinicians of possible sepsis from its earliest onset and link to evidence-based order sets established by the Surviving Sepsis Campaign’s recommendations. Clinicians can also use a link within the BPA to summon the Code Sepsis team for assistance with patient assessment, triage, and bundle implementation.

Improving Patient Outcomes

To better study the effectiveness and impact of the surveillance system, Sepsisdash displays sepsis alert information juxtaposed with care bundle compliance details and patient outcomes. This tool allows for high-level reporting and provides drill down capability to the patient level. This analysis provides data to aid in strategies to drive increased performance. Embedding this dashboard within Epic facilitates chart review workflows while maintaining patient information in Epic. Sepsisdash also provides the means to study and improve the accuracy of the surveillance system over time.

“The sepsis dashboard will allow us to more fully understand our sepsis population,” said UCSF Chief Medical Officer Josh Adler, MD. “And it will help us design targeted interventions to help drive down sepsis mortality.”

The innovative approach of combining a real-time surveillance system with a powerful analytic dashboard tool provides increased access to accurate and workflow-specific data to improve patient outcomes. Sepsis bundle compliance and mortality data is now available at the unit, service, and individual provider level with the goal to further understand and improve performance.