
AI Model Platform Notebooks
Data scientists use “notebooks” on Capital One’s Model platform to experiment, create code, and deploy models
The business wanted associates to pause their notebooks to reduce costs
Data scientists want to have the latest data available, and pausing can disrupt active data processing
Leaving a notebook running (“unpaused”) is very expensive
I conducted a workshop with twelve users to understand what could get them to pause their notebooks
My team designed and presented two prototypes for feedback and comparison
Option 1: A pre-selected checkbox
Option 2: Radio buttons
The user feedback suggested users needed to see and make a choice, and understand the impact of that choice
Radio buttons forced users to stop and think about their choice, and to read the options carefully
The winner: Radio buttons
Computing costs decreased 27% after the change went into effect
Lessons learned:
AI modeling is a high-focus environment, so a good user experinece involves automating as much of the process as possible for the data scientists