Payments Experience

Empowering Amazon Academy as a key education provider with paid courses
Project Overview
In Q1’21, Amazon Academy had newly added features like live and recorded lectures. This greatly increased our ability to provide holistic exam preparation for students, and hence monetise.

Year
2021-2022

My Role
I led the design of the the entire experience from upsell experience, browse packs to subscription management pages.

Tasks: User Research, Planning and scope definition, User Interface Design, Prototyping, User Testing

The Team
1 designer, 1 researcher, 1 product manager, 10 engineers

Pivotal shift for Amazon Academy as an education provider

This was one of our biggest launches for Amazon Academy, as paid courses gave us the ability to provide higher quality teaching, yet in an affordable manner.

“I wanted an year long course, had read about AA, there were many options, but I found this to be better, trial was very important for me, 7 day policy was very good." – NPS survey testimonial
How we got there
Kickoff with User Research
Our user researcher conducted 2 online pricing researches in Dec 2019 and Mar 2020 respectively. Both interviews with an average of 8 students with their parents, across Tier 1 (Pune, Delhi) and Tier 2 (Vijaywada, Guwahati). These were our key learnings –

Video lectures and doubt resolution are must-haves

Teaching faculty is highly important for a student when enrolling in a course

Different needs for different grades

Class 11 students look for full syllabus solutions, Class 12 students find revision material more relevant

Students most willing to pay for comprehensive solutions

Consisting of test, practice, videos, live lectures. No students were interested in pure test series.

Building trust is important

Affordability and refund ability were a key attractions, students want to try the app without risk

"Need live lectures. Need premium lecture - give us something at nominal cost"
“Refunds is risk free - everybody’s grasping power is different - if somebody’s experience is bad, they will tell others also that don’t try. But with refunds there will be no regret."

Class 12 IIT Aspirants, user interview

Testing purchase intent with sample packs
One of the research methods was testing purchase intent with sample packs, in our Dec 2019 research. Students were inclined to both Comprehensive Pack and Super Pack equally. However, in the Mar 2020 research, more students listed video content as a “must-have” item for conceptual clarity, due to the pandemic closing many coaching centres.

This data is further supported by a market research survey with 10,000 students, teachers and parents – listing teaching faculty (live lectures) and doubt resolution as key category drivers in the market. This shows that our designs have to emphasise on live lectures and doubt resolution as the main selling point.
Design process
Mapping the Customer Journey

Based on these research learnings and the product requirements document, I outlined the full customer journey to imagine the end-to-end journey for a customer. This helped me to identify key opportunities, assumptions and edgecases together with my product manager.

Afterwards, I broke the journey down to key flows in the 3 distinct stages.

Design Principles
To guide my designs, I laid down some core design principles to increase clarity to my decision-making process, and align the team with the same vision.

Easy

Make decision-making process of payments as simple as possible for student

Frugal

Leverage on existing payment systems from Amazon.in, reusing the payment interface and processes. Balance between an ideal simplified CX for the customer and operational feasibility based on A.in's payment processes

Build Trust

Affordability is key factor. Let students know they can trust our content quality and payment processes.

Mobile-optimised

As 99% of our customers are on mobile

Design process
Early explorations of payment flow

I started by designing the full end-to-end payment journey, according to the 3 distinct phases identified. By not emphasising on the visual design in this round, this helped us focus on any glaring issues on the overall flow

Overall feedback: While there were no major callouts on the flow, main concern from the team was to simplify information on the browse pack page while making buy CTA prominent.

Design Explorations – Browse pack page
One of the key challenges was designing a simplified browse pack page, yet showcasing all our study packs along with their benefits. Hence, for this page, I explored 3 different directions of how a student would interact with content.

Main Considerations

1. Emphasise on live lectures, especially teaching faculty: Students expect to be able to choose and enrol into a batch with their preferred teachers and schedule.

2. Different grade, different needs: Target Year selection has to be accessible and visible

We reviewed these designs multiple rounds, first with product managers and engineers, next with internal stakeholders, and eventually bar-raising review with the U.S design director of Kindle. Each reviewer gave me different perspective to evaluate the designs - from a business objective (have we highlighted the right info), technical feasibility (reusability in desktop and mobile) and design standpoint (information presentation).

Overall, options A and B were seen to be cumbersome to compare, and requiring a lot of long scroll. Our reviewers would get lost in the content and forget what information was for which pack.

Option C had the lowest cognitive load to compare, giving focus view to a single pack at any point in time, highlighting live lectures and teaching faculty adequately. Tab format also gives flexibility for content to scale, which was important as our product features continue to grow.  
Validating my designs
We tested our end-to-end clickable prototype through a virtual user testing with 9 students across Chennai, Nagpur and Delhi.

Sample flow in prototype - Upsell based on dashboard
Feedback on Upsell Flow

“View batches” as starting point to explore study packs

As compared to the upgrade CTA on the topbar, which only 2 clicked. This is contrary to our assumption that upsell ingresses will be primary way for students to be compelled to upgrade.

Students do not read FTUE modal

Only 3 out of 9 students read, but soon forgot what offerings was available.


Feedback on Browse and Pay Flow


Students proceed on without checking target year selected

Students was not aware if the pack was for their grade as well, unless prompted. Could potentially lead to mistakes.

Confusion around pack naming, especially on “Starter Study Pack”

Starter Pack was misunderstood to be a revision crash course.

Final Designs
Emphasis on discovery and efficiency in understanding
Here is our launched payments experience, taking into account the learnings from the user test.
1 - Upsell
(left) Upsell prompts in dashboard, (right) Upsell in action where students discover limitations through use of the app

Upsell focused on discovery

As an overall design strategy, prioritise discovery of live courses and tests. Students are more inclined to explore paid offerings by enticing paid content preview (batch card in hero banner) or good free content

2 - Browse and Pay Flow
Entire browse and pay flow

Revised naming to show subscription tier

Packs are named as Standard Pack and Ultimate Pack. Relevant callouts for grade are also placed in subsequent flows, so that students will not lose sight of key pack details at any point in time

Adding friction for first time users

Ensure users have the right target year selected. Since target year is pre-selected in onboarding, more of a confirmation for first-time setting

Simplifying internal complexities

Due to financial compliance requirements, our one-time payment for Ultimate Pack had to be split into 2 instalments. In this flow, I had to –

  • Incorporate this complexity yet keeping the experience simple
  • Highlight business objectives to promote one-time payment via cost-savings callouts
  • Communicate renewal process

Another complexity to simplify was the lack of an immediate payment status, due to financial compliance requirements. Following after best practices from Amazon.in, I added a "payment processing" status, with directions to ensure students that know where to go next.

3 - Subscription Management
Sample of the use-cases in payments experience, from payment statuses to pack renewal

Use-cases, edge-cases and simplification

One of the challenges in designing a payments system is the breadth of use-cases and states. To ensure efficiency in implementation and consistency in user experience, I defined reusable components for the design system.

Since refunds are important to our customers, I made sure the designs would communicate this detail from the purchase flow to subscription management flow.

Example of states to cater for

Subscription management

  • First 7 days - cancel and full refund
  • (Recurring) Post 7 days - cancel from next month onwards
  • (Pre-paid) Post 7 days - contact customer service
  • Upgrade for lower tier packs

Renewal

  • Different places to prompt renewal
  • (Ultimate Pack) During grace period - reserved batch spot
  • (Ultimate Pack) After grace period - no more batch spot
  • (Standard Pack) Opportunity to upgrade
Ensuring a cross-platform payments experience
In every feature that we design, we have to ensure it is scalable to desktop. Components have been strategically designed to work well for both platforms, which greatly helps in maintainability.
I designed the desktop pages concurrently with mobile
Impact

Much to celebrate, much more to do

Once again, this was one of our biggest launches for Amazon Academy, as paid courses gave us the ability to provide higher quality teaching, yet in an affordable manner. Numbers constantly indicate high satisfaction rate amongst our paid customers.

  • Paid users have ~50% higher rate of feature engagement than free users
  • Healthy renewal rates of Ultimate Pack of ~50%

Our surveys amongst paid customers also point to the same.

  • Score of 4/5 in Aug 2021 outreach with 9 customers
  • High NPS score of 53 (scale of -100 to +100) amongst paid users in Jun 2021
“I wanted an year long course, had read about AA, there were many options, but I found this to be better, trial was very important for me, 7 day policy was very good."

Class 12 Aspirant, Paid customer outreach

However, despite high satisfaction rate amongst paid customers, conversion rate was low.

This was a multi-faceted problem beyond the payments experience, as we found out that we had low engagement for free customers, which is an important factor for conversion. According to our paid customer outreach, all 9 students indicated that interacting with a good live lecture in the first 10-15 minutes was what motivated them to purchase.

Upon deep-dive with data, we found that content discovery issues was likely preventing students from engaging with our content. Hence, we predicted that if students have an easier way to discover content, they will likely be more engaged and hence convert. This leads me to my next project –

Improving Product Discovery
Recapturing the simplicity of learning