Refocusing Patient Engagement

Provided doctors clinical support through augmented devices like Google Glass and mobile, enabling more focus on patients and less time charting

COMPANY

Augmedix

Location

San Francisco, CA • Multiple sites in India • Dhaka, Bangladesh

Year

Jul 2015 - Jun 2017

ROLE & TEAM

Senior UX leading 3 Junior UX in SF & Bangladesh

Overview

Augmedix is a remote documentation and clinical support service that pairs doctors with Google Glass and remote scribes. By delivering patient information directly through Glass, providers are freed from their computers and can focus entirely on humanizing the patient experience. Commure acquired Augmedix in 2024.

Overview

Augmedix is a remote documentation and clinical support service that pairs doctors with Google Glass and remote scribes. By delivering patient information directly through Glass, providers are freed from their computers and can focus entirely on humanizing the patient experience. Commure acquired Augmedix in 2024.

My Role

As the Lead Interaction Designer within a 6-person UX team, I was tasked with a dual mandate: design the next generation of interfaces—specifically the provider Google Glass interface and the scribe note writer—while conducting global generative research to set the product vision and roadmap. Additionally, I needed to elevate our internal design maturity by improving cross-functional agile processes and mentoring our junior design and research staff spanning two teams across the US and Bangladesh.

My Role

As the Lead Interaction Designer within a 6-person UX team, I was tasked with a dual mandate: design the next generation of interfaces—specifically the provider Google Glass interface and the scribe note writer—while conducting global generative research to set the product vision and roadmap. Additionally, I needed to elevate our internal design maturity by improving cross-functional agile processes and mentoring our junior design and research staff spanning two teams across the US and Bangladesh.

Impact

  • Defined the Product Vision: Led international research and synthesized into a core narrative of the "scribe journey" through collaborative exercises with leadership and affinity wall mapping, fueling the 3-5 year roadmap and inspiring immediate service delivery improvements.

  • Increased Team Velocity: Through structured mentorship and process improvements, I increased the remote design team's velocity by 2-3x while upskilling their interaction design capabilities.

  • Delivered End-to-End Impact: Successfully shipped continuous design evolutions for the Glass interface and Scribe portal, improving the end-to-end lifecycle for both providers and scribes—from training and onboarding to execution.

Let's dive in to learn more…

Impact

  • Defined the Product Vision: Led international research and synthesized into a core narrative of the "scribe journey" through collaborative exercises with leadership and affinity wall mapping, fueling the 3-5 year roadmap and inspiring immediate service delivery improvements.

  • Increased Team Velocity: Through structured mentorship and process improvements, I increased the remote design team's velocity by 2-3x while upskilling their interaction design capabilities.

  • Delivered End-to-End Impact: Successfully shipped continuous design evolutions for the Glass interface and Scribe portal, improving the end-to-end lifecycle for both providers and scribes—from training and onboarding to execution.

Let's dive in to learn more…

Challenges

As Senior Interaction Designer within a 6-person UX team, I stepped in to elevate our design maturity while defining the product's future. Spanning two distributed teams across the US and Bangladesh, I was tasked with tackling several critical hurdles:

  • Ambiguous Product Vision: The company needed a clear, research-backed product roadmap for 2016-2017, which required deep, global generative research to uncover gaps in the provider-scribe workflow.

  • Aging Core Interfaces: The existing provider Google Glass interface and the scribe note writer needed a next-generation redesign to handle complex, end-to-end service workflows.

  • Fragmented Agile Processes: Cross-functional collaboration and handoffs were causing churn. The team needed standardized testing environments, improved JIRA workflows, and cohesive project planning to keep remote teams unblocked.

  • Scaling Team Capabilities: A growing team of junior designers and researchers required structured mentorship to improve their interaction design craft, velocity, and cross-cultural leadership communication.

Challenges

As Senior Interaction Designer within a 6-person UX team, I stepped in to elevate our design maturity while defining the product's future. Spanning two distributed teams across the US and Bangladesh, I was tasked with tackling several critical hurdles:

  • Ambiguous Product Vision: The company needed a clear, research-backed product roadmap for 2016-2017, which required deep, global generative research to uncover gaps in the provider-scribe workflow.

  • Aging Core Interfaces: The existing provider Google Glass interface and the scribe note writer needed a next-generation redesign to handle complex, end-to-end service workflows.

  • Fragmented Agile Processes: Cross-functional collaboration and handoffs were causing churn. The team needed standardized testing environments, improved JIRA workflows, and cohesive project planning to keep remote teams unblocked.

  • Scaling Team Capabilities: A growing team of junior designers and researchers required structured mentorship to improve their interaction design craft, velocity, and cross-cultural leadership communication.

Research and Learning

To support defining the future vision, I planned and executed a multi-method research initiative across the US, Three Sites in India, and Bangladesh. I personally conducted over 100 contextual inquiries and interviews in two months in India, led the team to perform cross-tool heuristic evaluations, and mapped complex provider-scribe interactions to identify critical service gaps.

Facilitated Collaborative Design: I modeled our research into an extensive affinity wall in a lil hallway, leading walkthroughs with leadership and collaborative sketching sessions with 20+ key stakeholders. I championed MVP-defining exercises (like "anchors and engines" and user journeys) to align cross-functional teams and reduce churn towards a 3-5 year vision.

Research and Learning

To support defining the future vision, I planned and executed a multi-method research initiative across the US, Three Sites in India, and Bangladesh. I personally conducted over 100 contextual inquiries and interviews in two months in India, led the team to perform cross-tool heuristic evaluations, and mapped complex provider-scribe interactions to identify critical service gaps.

Facilitated Collaborative Design: I modeled our research into an extensive affinity wall in a lil hallway, leading walkthroughs with leadership and collaborative sketching sessions with 20+ key stakeholders. I championed MVP-defining exercises (like "anchors and engines" and user journeys) to align cross-functional teams and reduce churn towards a 3-5 year vision.

Design and Mentorship

  • Drove High-Volume Execution: Managed 4-5 medium-to-large projects monthly across mobile, desktop, and Glass. I established a highly collaborative workflow using Sketch, InVision, JIRA, and Confluence to keep remote engineering teams unblocked and iterating quickly.

  • Mentored and Scaled the Team: Successfully recruited and mentored a junior researcher and a design intern, guiding them through complex Glass UI explorations. I also held iterative design reviews with our remote visual team in Bangladesh to expand their interaction skills and leadership communication.

  • Instituted Agile Best Practices: Improved JIRA workflows, defined and advanced testing environments, and introduced Blitz testing. I created easy-to-use wiki templates for project and user-interview planning to give newer project managers clear goals, assumptions, and timelines.

Design and Mentorship

  • Drove High-Volume Execution: Managed 4-5 medium-to-large projects monthly across mobile, desktop, and Glass. I established a highly collaborative workflow using Sketch, InVision, JIRA, and Confluence to keep remote engineering teams unblocked and iterating quickly.

  • Mentored and Scaled the Team: Successfully recruited and mentored a junior researcher and a design intern, guiding them through complex Glass UI explorations. I also held iterative design reviews with our remote visual team in Bangladesh to expand their interaction skills and leadership communication.

  • Instituted Agile Best Practices: Improved JIRA workflows, defined and advanced testing environments, and introduced Blitz testing. I created easy-to-use wiki templates for project and user-interview planning to give newer project managers clear goals, assumptions, and timelines.

Impact

  • Defined the Product Vision: Synthesized all future-focused research into a core narrative of the "scribe journey" and delivered top recommendations to founders and leadership. This successfully fueled the roadmap and inspired immediate service delivery improvements.

  • Increased Team Velocity: Through structured mentorship and process improvements, I increased the remote visual design team's velocity by 2-3x while upskilling their interaction design capabilities.

  • Delivered End-to-End Impact: Successfully shipped continuous design evolutions for the Glass interface and Scribe portal, improving the end-to-end lifecycle for both providers and scribes—from training and onboarding to execution.

"Jerry was a great teacher guiding me... through the development of design tasks. He mentored me by encouraging me to learn and understand not only the interface of design, but more of taking user experience into consideration... With him, coding and designing of a team can become one thing." > — Yao-Chieh Hu, Former Intern & Current CEO @ Turing Chain