QPP – Resource Library

My role

Research lead, working within a product team made of researchers, designers, engineers, and product managers on a contractor for the Centers for Medicare and Medicaid Services (CMS).

Activities

  • Research recruiting
  • Discussion guide preparation
  • Pilot study
  • Semi-structured interviews
  • Remote, moderated card sorting
  • Research analysis

The policy and mechanics behind the Quality Payment Program are complicated, and users often have detailed questions on it. We helped reduce user burden and support volume by allowing users to more easily answer their own questions. Our research work paved the way for enhancements to the Resource Library – a comprehensive repository of program documentation.

Screenshot of old Resource Library - showing a long index of links
Original Resource Library

A research colleague and I did remote interviews to learn about users’ context of use and card sorting to understand how users would naturally organize the material.

Animation showing a screen where a card sorting participant is dragging cards like "group participation in MIPS 2017" and "2017 MIPS 101 guide" into a group and naming the group "MIPS". They also dragged another card of "2017 Quality Measure Specifications Supporting Documents" into its own group and named it "Quality"
Card sorting in progress
Screenshot of a finished card sort - showing 7 named groups with a few cards in each
Completed card sorting session

Some of our main insights:

  1. The importance of “last updated” dates to help people find recently updated resources. People scanned through the list of resources proactively to see what has changed since their last visit.
  2. People tended to organize resources by performance year, performance category, and reporting track.
  3. People often referred to a few key documents such as the fact sheets (which provide a beginner’s overview to the program) and the final rule (which drives the CMS policy).

We worked with a cross-functional product team who designed and built the New Resource Library, incorporating our insights. We included the “updated” date on every resource and allowed people to sort the list alphabetically or by date updated. We provided filters corresponding to the ways in which people organized resources in card sorting. And the “General Resources” and “Regulatory Resources” at the top of the list offered easy access to these central documents.

Screenshot of the new Resource Library
New Resource Library