User Resarch + Strategic Design + UX

Delivering bad news

Redesiging an involuntary rescheduling flight experience through analogous and strategic design.

To comply with my non-disclosure agreement, I have ommited and altered confidential information of some case studies. All information in this website is my own and does not necessarily reflect the views of the organizations I worked with.

Context

I spent over two years working as a UX Researcher in the Product and UX department of one of LATAM’s biggest technology companies, an online travel agency called Despegar.

My squad worked for the aftersale services of the company, which meant that even though the company positioned UX as an interface-focused team, we had to think like service designers orchestrating multiple channels, teams and layers of complexity.

The Aftersale Product and UX Team.

Challenge

How can you improve an experience that is essentially problematic?
This was the main question surrounding the project. Having a flight reschedule is not an event that can be turned pleasant by design. Therefore, we needed to understand what improving it would look like and then how to do so.

Deriverables

Survey design, findings analysis and report, usability test design, usability test report, digital experience flow map, communications map, project presentation for stakeholders, hi-fi prototype, content design.

Impact

The new digital experience and communications system impacted positive NPS (Net Promoter Score) with a growth of over 5%.*

Additionally, the amount of passengers rejecting their new flight options dropped. The calls to the customer services center fell within the first month.

*The actual values are not disclosed due to my NDA.

Process

—— Part I

Pre-discovery

Problem and context analysis

Research strategy

Discovery

Expert interviews

Qualitative Analysis

Definition

Problem statement

Repro_Ideation+Prototype

Ideation + Prototype

First iteration

Survey design

—— Part II

Discovery

Change of perspective:

Analogous inspiration

Card sort

Break up Letter

Implementation

Final Communications

Digital Experience

Final thoughts

What I Learned

Pre-discovery

Communications System Part I

Problem and content analysis

By the time this project started, an average of 122.000 monthly users were being affected by the experience we set out to redesign. Because of this, before designing an action plan we needed to understand the interactions and situations that were involved in this particular scenario. We gathered with the whole squad and began the mining of information.

First meetings together before the kick-off.

Analysis’ objectives

  • Detect which were the information sources and how they worked.
  • Map out the current flow.
  • Distinguish and map the different actors currently involved in the delivery of the service.
  • Analyze the available data (NPS score and amount of monthly calls related to this experience).

We summarized the current data, analyzed the current flow and talked to friends and family who had a flight rescheduled for preliminary research.

Research Strategy

Current definitions

One of the main findings we got from the analysis of the problem and its context is that the definition of an involutary flight reschedule was technical.

The framing effect

The way we call things highly impacts on how we relate to those things.

How does it work?

The framing effect is when our decisions are influenced by the way information is presented. Decisions based on it are made by focusing on the way the information is presented instead of the information itself.

How did it influence our project?

Product and service decisions were being made from understanding flight schedules as a change of time. This meant that they were focused on technicalities (which flight has changed, what was the time change, when it occurred, etc.) rather than on the effect this experience had on the passenger.

Research plan

Our main goal was to redefine what a flight reschedule entailed from the passenger’s perspective as a means to align the squad behind a human-centered conception of the problem we were working on.

Goals

  • Understand the current model for flight rescheduling: how it is and how it works > Expert interviews.
  • Discover how the detractors (passengers giving a NPS qualification of under 6 points) were analyzed > NPS detractors’ comments analysis.
  • Discover passengers’ current experience with flight rescheduling and whether the current model fits their needs > User calls analysis.

Discovery

Communications System Part I

Problem and content analysis

I sat down with a Customer Service Analyst and Product Functional Analyst to understand more deeply how the current model worked.

Main takeaways

No personalization

Passengers received the same email for a 5 minutes or a 24 hours flight change.

Lack of information

Passengers couldn’t know if other products (hotel, car, etc.) were also being managed.

Reduced POV

No analysis on how the change had impacted the overall plans of the passenger.

Qualitative analysis

As the team’s main researcher, I set out to analyze 200 comments from detractors that had undergone minor flight changes and 200 commentaries from detractors that experience major flight changes. I also analyzed passengers’ calls.

Process

Primary findings

Main pain Point

Modification of the travel experience: layovers, expenses, commitments, etc.

Repro_Primary02

Violation of boundaries

Passengers blamed the company for the change and found it disrespectful.

Secondary findings

Same pain points

No difference between minor and major flight rescheduling when it comes to the distraction reasons.

Why pax called

Bad service: Poor alternative choices and not being sure about their flight’s status.

Reduced POV

The current model doesn’t take into account the passenger’s travel plan.

Insight

An involuntary flight rescheduling is not only
a change of itinerary, it is a change of plans.

Definition

Communications System Part I

Problem Statement

Because the operation could be improved in so many different ways and the organization’s context was so complex, we sat down to define exactly what we were going to work on and why.

Proposed solution

Reframing of the definition of involuntary flight scheduling. to align the team’s efforts involving more than just communications.

Work on providing better alternatives through a model
of prediction and
multivariability.

Redesign the communications system and the digital experience to give better accompaniment and information.

Ideation & Prototype

Communications System Part I

First iteration

We decided to start with the first email of the flow because it impacted the most number of users (36.000/month). We designed it with the conclusions and data we had gathered in the research phase.

Survey design

To validate our first proposal, we decided to send out a survey to passengers who had recently purchased a flight.

Oh well…

Something wasn't working

How could we bring more ease to the passenger?
How could we make them feel reassured?
What were we not seeing?

(Here we go again)

Discovery

Communications System Part II

Change of perspective

Our validation informed us that we were still missing the target: passengers were likely to call. This meant that we weren’t saving the company any money.

In order to explore further, we needed to denature’s the operation by looking at it not from a technical perspective but as a more profound, human experience.

Analogous inspiration

We started seeing the change of plans as bad news because it involved complications, rearrangements and passengers receiving a message they weren’t expecting.

Consequently, we asked ourselves a different question:

What industry has a lot of
experience delivering bad news?

Medicine

After some consideration and thinking about personal experiences we reached a consensus. Medicine is an industry that has to deal with delivering bad news on a daily basis and also provides theoretical content about communication that we can study and adapt.

Standford School of Medicine's definition of Bad News

Bad news is «any news that adversely and seriously affects an individual’s view of his or her future» (Buckman 1984).

SPIKES

We read some articles and papers before finding SPIKES*,
a 6 steps protocol created by Baile & Buckman (2000).

S

Setting up the interaction

  • Make sure you have checked all the available information and decide terminology.
  • Decide where and how to deliver message.
  • Understand who you’re giving the message to.

P

Assessing receptor’s perception

  • How much do they know already?
  • Discover expectations and previous understanding.

S

Obtaining receptor’s invitation

  • How much detail do they want to know?

K

Giving knowledge and info

  • Reinforce parts of understanding that is correct.
  • Give information in small chunks.

E

Adressing emotions with empathy

  • Show that you registered what they told you.
  • Allow space for silence.

S

Strategy and Summary

  • Set an strategy of how to deal with the news.
  • Communicate next steps.
    Identify support and open the space for questions.

Center for Excellence Teaching and Learning Queen Mary University of London

Cardsort

We used SPIKES to create the Information Architecture by adapting the protocol and giving users 5 out of the 6 steps to put in order via a remote card sorting test. The participants were from Mexico, Chile, Argentina, Colombia and Brazil.

Imagine that someone has to deliver bad news to you.
In which order would you like them to conduct the actions enlisted here?

Results.

Main takeaway

The last thing passengers wanted to hear were encouraging words. They wanted to know what had happened first and then they expected to be offered the possibility of knowing details, which the next steps would be and specificities about their situation, in that order.

Break-up letter

In order to explore the emotions underlying receiving bad news we designed and printed a bunch of break-up letters and gave them to anyone around the office who offered to help.

The break-up letter method was firstly used by Smart Design (a company based in NYC) “to understand the emotional connection between people and their products, services, and experiences.”

Main conclusions

After conducting this second discovery process, our new approach led us to the following conclusions.

Contract

The expectations were interpreted as a tacit contract in terms of the arranged plan.

Repro_MainConclusions02

Not many details

When the contract was broken, there wasn’t interest in knowing the details or reasons why.

Think ahead

They expected that their schedule and commitments would’ve been taken into account.

Repro_MainConclusions04

Give me a solution

They were disappointed that there had been no solution in sight.

Implementation

Communications System Part II
& Mobile Digital Experience

Bringing it all together

Digital
Experience

One of the main pain points was the bad quality of alternatives to choose from when their flight was rescheduled. This was combined with a subpar digital experience that hadn’t been iterated or improved upon for over three years.

Quick wins to guide redesign

With this in mind, the team gathered to ideate on the type of “quick wins” that could be done to improve the digital experience of choosing alternatives. A flow was defined and a prototype in medium/hi wireframes were designed by the main UX designer of the team.

Design of usability test

In two weeks, along with Facu, the team’s UX Writer, we designed and conducted the tests. Half of our team had to go to Colombia to conduct field studies so we got together and discussed the flow. They told us which specific interactions and copy they wanted to validate. Our task was to turn these objectives into a usability test that could achieve them.

We mapped out the flow to locate the key moments.

Two flows, ten participants

The biggest addition of this proposed solution was allowing passengers to swipe through their previous (cancelled) flight and their new options. We couldn’t decide whether, after reading what had happened in the first screen, the user should be welcomed with the new flights or the previous flight and swipe from there.

This was important because it set the tone for the experience: do we make you focus on what is gone or on the possibilities?

Mapping out the flows allowed us to be assertive with our testing objectives.

Conducting the tests

We used Lookback as our main research software to be able to record not only the tapping and scrolling that the 10 participants performed on the prototype but also their voices, faces and reactions. It was super useful. I was the tests’ moderator and Facu took notes.

A screenshot from one of the tests and me debriefing the results.

Sharing of findings

We debriefed the findings in a way that made sharing them easy and democratic. We analyzed them with the product managers and IT team and made sure that everyone understood what the necessary improvements were before we created a final report.

Experience

The final deliverables spanned from a communications map that included notifications, emails and nudges to a digital experiences supported across different devices.

The final deliverables spanned from a communications map that included notifications, emails and nudges to a digital experiences supported across different devices. Every decision was the result of understanding the travelers’ current pain points with a rescheduling flight experience, analyzing an analogous industry for creating a communication model and defining which interactions would support an easier, sped up process.

Final communications

Taking into account all the findings we had gathered so far,
we crafted the final version for the first email of the system.

Communications map

Additionally, we mapped out the complete communications system and rethought the choreography between emails, push notifications and the current digital experience (desktop + mobile).

What the map helped us do

  • Validate that the total orchestration of communications respected our defined storytelling and structure.
  • Create consistency throughout the content aside from the format.
  • Use paid push notifications more strategically.
  • Establish the metrics through which we were going to measure succes.

Final flow

Setting up the interaction

We followed everything we learned from designing the communications and introduced a “momento zero” to choosing alternatives. Here passengers are told again what happened and given clear instructions on how to proceed.

Main features

See alternatives

Quick onboarding

Because the swiping capability for browsing and comparing the new alternatives was new, participants in the test took a while to understand how the interface worked. We decided a quick onboarding could assure us that passengers knew how to interact with the screen.

Main features

See alternatives

Fast solution

We knew from our analogous research that informing an effective strategy was key when delivering bad news. From an interaction design perspective, we translated this into making the action of looking at new alternatives, comparing them to their previous flight and choosing them as easy as possible for passengers.

Main features

See alternatives

All this work
deserves a bigger screen

Because of the length of the case studies, I have adapted them for mobile and tablet. If you want to read the complete case study, head over to desktop.

Thank you for reading!