Initial Wireframe of the Alerts Drawer: This wireframe represents the first iteration of the Alerts Drawer, designed to display key alerts related to equity disparities, anomalies, and statistical process control. It served as a foundational design to gather initial feedback from stakeholders, ensuring the layout was clear and organized for healthcare professionals. The wireframe included placeholders for alert messages, categorized sections for different types of alerts, and an icon that quickly shows the trend, enabling users to immediately grasp the direction of the data changes. This setup set the stage for further refinement based on user feedback.

Feedback from Stakeholders: After creating the initial designs, I met with data analysts and the web development team to receive feedback. They suggested improvements for the alert icon to enhance clarity and noted that the alert label seemed too much and were looking for a more general word. They recommended gathering further feedback from end-users to refine the alert labels and ensure the information was presented effectively.

Hand-Drawn Design for Metric Snapshot Cards: This sketch represents the initial concept for a list view of metric snapshot cards, created based on stakeholder and user feedback. The design includes key elements such as the current rate of the metric, the change in percentage, and indicators for whether the metric is on track. Additionally, it highlights the number of alerts associated with each metric. The design also incorporates functionalities for adding, sharing, copying, and printing metrics, as well as filtering by date and time period. This hand-drawn prototype was used to visualize and refine ideas before creating digital mockups for further testing and development.

Stakeholder and User Feedback Notes: Following the initial designs, I conducted a series of 10 usability tests with executives and physician leaders to gather their feedback on the Alerts Drawer. The feedback highlighted that the label "alerts" was perceived as too harsh, with a preference for the label "Notes" as a shorter label for notifications. Additionally, stakeholders indicated that significant data changes, specifically movements greater than 2%, should be flagged as notifications, with clear indications of the trend direction and an interpretation provided by the AI/ML system.

Updated Design of the Notification Drawer: This image showcases the refined design of the notification drawer, now labeled as "Notes" based on user feedback. The updated design includes clear and concise alert messages, indicating significant changes in data metrics, such as movements greater than 2%. Each note provides the direction of the trend and an interpretation from the AI/ML system to ensure healthcare professionals can quickly understand and act on the information. The categories for equity disparities, anomalies, and statistical process control remain, but with improved clarity and usability based on feedback from executives and physician leaders.

Updated Metrics List Home Page: This design update showcases the metrics list home page with an integrated notification system that alerts users when specific metrics require attention. The notifications are indicated by icons on the metrics, prompting users to click and view detailed AI/ML-generated insights in the notification drawer. This design was tested with five users and received feedback from the product manager and development team. The feedback was positive, indicating that users found the notifications intuitive and useful for quickly accessing important information. This update ensures that healthcare professionals can easily identify and act on significant changes in their metrics, enhancing the platform's overall utility and responsiveness.