User Testing

2022/05/08(新增投影片)

User Testing / Evaluative Research

• User Testing: Why & How (Jakob Nielsen) (3:13) NN group

• User Testing with Sensitive Data (3:26) NN group

• How you can use “seeing is believing” to challenge poor requirements : User testing is a powerful tool for challenging arbitrary project constraints

• How to carry out meaningful user testing on a small budget

  • In-page analytics from Google Analytics

  • Pop-up surveys

  • Screen-sharing software

  • Online card sorting

  • Test your copywriting on social media

• How to “Remote User Test”

• Figma makes note-taking in remote usability testing easy

• A Comprehensive Guide To User Testing

  • Usability Testing: Why And When?

  • Preparation Is Key

  • Running The Test

• Traffic light usability report —and how to communicate your test results

  • how hard is a specific task for our users

  • how hard to use is our application for each specific user.

• The ultimate user testing guide

  • Feedback based vs. Outcome based research

  • Find the right users

  • Open and truthful interviews

  • Some easy hacks to make interviews better

• Stop just looking at your Net Promoter Score! A better way to utilize NPS

  • In short, a better way to utilize NPS data is to find out what made someone an extreme detractor (those who gave you 0) or promoter (those who gave you 10), and test those factors against the passives to see if the improving the factors can move the needle (change the NPS they give).

  • A step-by-step guide

    • Map out the entire user journey using 1:1 interviews

    • Synthesize triggers and events into driving factors

    • Run a survey. Gather overall NPS and NPS for each factor

    • Calculate the correlation between the overall NPS and the NPS of each factor

• Is it time we move beyond the NPS to measure user experience?

  • Net Promoter Score = % of Promoter respondents minus % of Detractor respondents

  • What to do instead (or in addition to)

    • Frustration

    • Helpfulness/happiness

    • Loyalty

    • Satisfaction

    • Finally, always leave an open-ended text field asking something along the lines of “how could we improve?”

• Web Vitals from Google to Measure User Experience

  • Core Web Vitals & Web Vitals

    • Core Web Vitals

      • Largest Contentful Paint (Loading Performance)

      • First Input Delay (Interactivity)

      • Cumulative Layout Shift (Visual Stability)

• A thorough review of top User Testing tools

• A designer’s guide to successful user testing

• How to write a user testing report that people will actually read

• Confirmation or falsification in your user research? : Whenever you run a study, are you trying to confirm or falsify your beliefs?

Usability Test

• 請參閱 Usability

Heuristic Evaluation

• How to Conduct Heuristic Evaluation

  • Jakob Nielsen’s 10 Heuristic Evaluation (請參閱 Usability )

    • Visibility of system status

    • Match between system and the real world

    • User control and freedom

    • Consistency and standards

    • Error prevention

    • Recognition rather than recall

    • Flexibility and efficiency of use

    • Aesthetic and minimalist design

    • Help users recognize, diagnose, and recover from errors

    • Help and documentation

• What Is Heuristic Evaluation and Why Do You Need It?

  • What Is Heuristic Evaluation?

  • What Is the Difference Between Heuristic Analysis, Cognitive Walkthrough, and User Testing?

  • Using Heuristic Analysis for Usability Evaluation

  • Why Should You Do It?

  • How to Conduct an Effective Heuristic Evaluation?

    • Step 1: Define the scope of your evaluation.

    • Step 2: Know your end-user.

    • Step 3: Choose your set of heuristics.

    • Step 4: Set up an evaluation system and identify issues.

    • Step 5: Analyze and summarize findings.

  • Should You Pay for a Heuristic Evaluation or Do It Yourself?

• Conducting a heuristic evaluation: case study learnings

A/B Testing

• A/B Testing 101 (1:42) NN group

• What is an A/B Test?

• A/B Testing vs. Multivariate Testing for Design Optimization (2:46) NN group

• What every product manager should know about AB Testing

• The benefits of structured A/B testing

• Effectively Using A/B Testing

  • Yes: Search-like things

  • Maybe: UI

  • Yes: Hypothesis Validation

  • No: Functional Testing

  • Card Sorting

  • Usability Testing

• The problems of over-relying on A/B testing

  • Deprioritising disruptive innovation

  • Deprioritising opportunities that “only” move the needle in the long term

  • Deprioritising opportunities that don’t necessarily impact a major business KPI

• How to set the Minimum Detectable Effect in AB-Tests : Demystifying the most elusive AB-Test Parameter