Homepage Next Project

Rethinking Match The Answer Widget For B2B & B2C Users

The redesigned Match the Answer widget: the editor view and the learner view

Company

Educative

My Team

1 PM, 2 Designers, 2 Devs

My Role

Product Designer II

Timeline

2 months

Responsibilities

Research  I  Build Strategy  I  Revamp Design  I  User Testing  I Deliver Final Results

The Overview

Educative, a platform with over 2 million users, strives to deliver an exceptional learning experience. However, pre-built widgets presented challenges for both learners and editors. Learners faced difficulties navigating the widgets during courses, while editors encountered limitations when creating tests.

To address these issues, a cross-functional team of 1 product manager, 2 product designers, and 2 developers embarked on an initiative to revamp the widgets. This initiative aimed to streamline the user experience for both learners and editors.

Prioritizing High-Impact Widgets (MTA Widget)
Data analysis guided our selection of the most impactful widgets. We targeted three for initial improvement, including the Match the Answer (MTA) widget. In this case study, I will focus only on the MTA widget, which I worked on.

Old MTA Widget Design Audit

I checked the MTA widget design for editors and learners, finding room for design improvements.

Match the answer widget (Editor View)

Editors use this widget while creating content in courses.

The old MTA widget in the editor: statement and answer fields with a markdown editor and preview

No Limit set on input size
Different text lengths make different sizes of the section, disturbing the UI of the widget.

Extra spacing issue
Too much white space just to maintain the sequence of next statement to avoid confusion.

Editor CTA
Under this is hidden a Markdown Editor, which contains pre-defined code to use to apply different states. e.g. bold, italic.

Small preview field
Solutions explanation is provided here, it’s not easy to read as the longer copy gets hidden.

Changing the layout
Option to close the preview section, changes the UI hierarchy and confuses users when scrolling through content.

Markdown Editor view
Any edit made in the markdown editor is shown in the preview section, that’s why it is repeated everywhere.

Manual position adjustment
No easy functionality to change positions of the solution statements to make different matching sequences.

Match the answer widget (Learner View)

Learners use this widget when learning from courses.

The old MTA widget for learners: questions matched to answers with crossing arrows, and the result view

Hover states
No visual hints are provided while hovering over these sections to indicate clickable state and to provide more interactive design.

Correct arrows matching
Very difficult to track which arrow is matching with which answer once it starts getting messy.

Less space for Explanation
Explanation can contain images, code blocks etc, showing this in the current way is a bad UX practice.

Accessibility Issues
Red and green colors can cause accessibility issues while viewing the results.

Different views
Different edits like images, bold, italic and code blocks make the current design cluttered and not easy to use.

Understanding User Needs

To ensure a user-centered design for the MTA widget, I conducted user research to identify pain points. This involved interacting with users and gathering their feedback.

User Personas
Since the MTA widget has two user groups (editors and learners), I created user personas to understand their needs and perspectives. This ensured a well-rounded understanding of potential problems.

Ahmad Saeed, editor persona

Ahmad Saeed

30 / Male

Editor

Ahmad creates content for Educative, including using the match-the-answer widget to design practice questions. He encounters issues that slow him down and cause frustration.

Persona Needs

  • Less cognitive load
  • Easy readability
  • More Efficient
  • Modern
Fatima Amjad, learner persona

Fatima Amjad

24 / Female

Learner

Fatima, aspiring to become a programmer, actively uses Educative courses with match-the-answer widgets, but she encounters difficulties that hinder her learning experience.

Persona Needs

  • Track answers
  • Simple interactions
  • Neat design

User Research
Following user persona development, I conducted user research to identify problems in the MTA widget. This involved recruiting relevant users, scheduling interviews, and analyzing their feedback to understand their pain points.

Photos from user interviews

User Interviews

I interviewed both editors and learners who use the MTA widget. The focus was on gathering feedback about their current experience. We asked them to identify areas for improvement and suggest desired features.

Usability testing sessions

Usability Testing

We conducted usability testing of the existing MTA widget design. This allowed us to observe users interacting with the widget and uncover potential issues we might have missed.

Survey question screenshots

User Surveys

Surveys focused on specific areas of concern with the current MTA widget design were conducted. This approach helped us gather quantitative data and user feedback on these specific scenarios, providing valuable insights.

User journey map

User Journey

By synthesizing the data from user research, we created a user journey map. This map visually represented the steps users have to take when interacting with the widget, highlighting their pain points and opportunities for design.

Finding the Pain-Points

Through user research, I compiled a comprehensive list of user pain points with the MTA widget. This research helped us clearly define the problems users face, ensuring our design efforts address their specific needs.

Pain-points

Question & Answer Section

  • Inefficient Code Editing: There's no built-in code editor, forcing users to switch to the markdown section for code edits and updates.
  • Missing Labels: Questions and answers lack clear labels, creating confusion for users.

Match answer arrows

  • Manual Answer Ordering: Currently, there's no drag-and-drop functionality to arrange answers. Matching questions and answers manually becomes cumbersome with multiple options, especially for creating randomized sequences.

Explanation Field

  • Limited Text Preview: The small preview area makes it difficult to see the full content, leading to potential errors like typos when editing.

Preview Section

  • Redundant Preview: Live preview repeats content, cluttering the interface.
  • Inconsistent Preview Toggling: Toggling preview on/off disrupts UI consistency, potentially causing confusion and errors.

Defining Goals

Following comprehensive user research (interviews, surveys, usability testing), and a design audit, we were able to identify clear design opportunities. This knowledge allowed us to set focused goals for improving the MTA widget user experience.

  • Reduce Editing Time: We aim for a 25% reduction in time spent editing by implementing inline code editing and minimizing the need to randomize content positions.
  • Minimize User Mistakes: We aimed to reduce matching arrows and typos mistakes by 40%. These mostly include matching answers while editing and adding incorrect spellings in explanation.
  • Increase User Satisfaction: Our goal was to improve user satisfaction with the MTA widget to over 50%, by addressing pain points like clear labeling, drag-and-drop functionality, and a streamlined preview experience.

Design Journey Towards Revamping MTA Widget

Now it was time to start turning ideas into designs. My goals were clear and I had a clear picture of the problem I was solving, so I started working on the design phase. This includes different processes like the wireframing, A/B testing, iterating and finalizing the designs.

Competitors Research
To gain insights from existing solutions, I researched competitor applications that utilize match-the-arrow interactions. Here's what I found:

Focus on Simplicity: Competitors primarily use simplified match-the-arrow interactions with smaller text sizes. This suggests a focus on clear information hierarchy and minimizing visual clutter, which aligns with our goal of improved user efficiency.
Content Division: Several competitors divide content within the widget, allowing users to easily scan information and interact more intuitively. This finding supports our goal of enhancing user control and reducing errors.

By analyzing competitor designs, I was able to extract valuable insights that informed my own design decisions for the MTA widget revamp.

AhaSlides: a match-the-pairs question editor A game matching each tree with its scientific name
Competitor editor: a document with an AI writing panel Competitor editor in dark mode: a getting-started guide

Wireframes

Before creating fancy designs, I built simple mockups (wireframes) to test my ideas. This helped me find any problems early on, like how users might interact with the widget in unexpected ways. I tried different layouts to find the best solution.

Hand-drawn wireframe sketches on paper Wireframes reviewed on a laptop Paper wireframes of the widget layout
Low-fidelity wireframes of the MTA widget, set 1 Low-fidelity wireframes of the MTA widget, set 2

User Testing Wireframes

Building on the initial wireframes, I created several design iterations. These were tested with users to gather feedback. I showed them rough ideas, listened to their thoughts, and used that feedback to refine the designs in an iterative process.

Different Iterations Designed and Tested with Users

Design iteration 1 of the MTA widget Design iteration 2 of the MTA widget Design iteration 3 of the MTA widget

Pros and Cons of some variations

Editor View
Editor view variation of the MTA widget
  • Content Readability (pro)
  • Test sequence generation is much easier (pro)
  • Too Much Scroll (con)
  • No space to show explanation fields (con)
Learner View
Learner view variation of the MTA widget
  • Matching is easier (pro)
  • Easy to review answers (pro)
  • More actions are required for linking (con)
  • Does not look like a Match the Answer widget (con)

Final Designs

User feedback was incorporated to refine the MTA widget design. Final usability testing confirmed the design effectively addressed user pain points, resulting in a positive user experience.

Result of the MTA Revamp

We tested the redesigned MTA widget with users through surveys and scenario testing. Their feedback was very positive! The tests showed the improvements made a big difference, like users completing tasks faster and making fewer mistakes.

Users Survey Results

BeforeMeasureAfter
25%Readability65%40%
40%matching Q&A85%45%
30%Usability90%60%

We overall received positive responses from users and they describe it as modern, easy to use and very helpful.

Other key results were as follows:

  • Efficiency increased by 45%

    Users can now interact with the MTA widget much faster. Content is clearly presented and organized into two user-friendly layouts.

  • Mistakes decreased by 60%

    It became much easier for users to add content and create tests without mistakes.

  • User satisfaction increased by 70%

    Feedback and surveys revealed a dramatic increase in user satisfaction with the revamped editor experience.

Key Takeaways

I learned many valuable lessons throughout this whole process of revamping widgets, some of the important ones are as follows:

Empathize with Users

By understanding their perspective, you might discover that what seems like a problem (a feature in your eyes) is actually helpful for users.

Continuous Improvement

Review your process after each project. Identify areas for improvement and adapt your approach for future projects.

Less is More

While additional features can be tempting, they can add complexity. If a simple design is meeting user needs, adding extra features might create confusion.

Focus on Outcomes, Not Outputs

Don't get caught up in creating fancy designs. The goal should always be to create a solution that delivers positive outcomes for users, and can increase efficiency.

Future Prospects

As the bigger goal is to revamp all of Educative’s widgets, we are planning to target important widgets which are often used in the content and improve their designs by user testing and bring positive results and to achieve consistency in overall Educative’s product.


Next Project

Architecting a High-Transparency
Workspace Ecosystem
for Distributed Teams

Team workspace app: mobile screens for locations, check-in and tasks