B2B / Sep 2021 to Jan 2022 — Note: this project is anonymized to respect the client’s NDA
This client is an Intelligent Process Automation software company that helps large companies transform unstructured information (e.g., scanned paper documents) into structured data or insight using Artificial Intelligence and Machine Learning. As lead designer, I collected user data through interviews, identified and helped prioritize key challenge themes to inform a UX vision, and ideated and tested new concepts with users. For this project, I delivered a set of conceptual designs representing the long-term vision for the experience, and a small number of high-resolution designs illustrated smaller changes to the existing product.
Research
Our research allowed us to identify three personas:
the Subject Matter Expert (SME) in charge of manually checking the AI’s work
the Process Owner in charge of overseeing the success of SMEs and training the AI in the long-term
and the System Integrator who supported the process by troubleshooting issues.
We focused our attention on the first two personas as they were experiencing the most pain:
We found that SMEs lacked motivation due to the repetitive nature of their work and felt immense pressure to avoid mistakes because they perceived the experience as unforgiving.
Additionally, Process Owners were frustrated because they were responsible for the SMEs’ output but didn’t have visibility into the progress and quality of their work.
Ideation and definition
This redesign focused on changing the product’s mental model to enable more efficient workflows and providing more context to SMEs so they could make decisions with more confidence. For Process Owners, we introduced new views that gave them visibility into their team’s progress and allowed them to jump in to unblock SMEs when needed.
As mentioned above, the time allotted to high-resolution work during this project was limited. As a result, after finalizing the new conceptual approach, I produced a small number of limited redesigns meant to address key issues with limited changes.
Takeaways
The product was built on a mental model that users were very familiar with but resulted in an experience that felt inefficient, draining, and unforgiving. Imagine a large real estate company that manages thousands of tenants. Traditionally, one of its employees would be responsible for reading each Lease Agreement and entering their data into the company's system (e.g., name of tenants, lease start date, etc.) Now, this new AI application makes the entire process much more straightforward. It processes all these documents automatically using Optical Character Recognition (OCR) technology and Machine Learning algorithms. Humans only need to review the work of the AI at the end of the process. The application was initially designed to allow humans to review one document at a time, as users did before this product existed. And this approach resonated well with users because it felt familiar.
However, we had the opportunity to invent a new different mental model in this case. Humans review one Lease Agreement at a time because they can read one sheet of paper at a time. But software doesn't have this limitation. Software can look at a stack of Lease Agreements and immediately see all the tenant names across all documents. What if the application was built so users could review documents the same way? Our testing revealed that this new mental model allowed advanced users to review documents much more efficiently, even though they had to think of their work differently.
In this example, the mental model users understood most intuitively wasn't the most efficient approach. Testing the new mental model with users proved the value of the approach, which was added to the experience's vision for future changes.