We may earn an affiliate commission when you visit our partners.

Designing, Running, and Analyzing Experiments

You may never be sure whether you have an effective user experience until you have tested it with users. In this course, you’ll learn how to design user-centered experiments, how to run such experiments, and how to analyze data from these experiments in order to evaluate and validate user experiences. You will work through real-world examples of experiments from the fields of UX, IxD, and HCI, understanding issues in experiment design and analysis. You will analyze multiple data sets using recipes given to you in the R statistical programming language -- no prior programming experience is assumed or required, but you will be required to read, understand, and modify code snippets provided to you. By the end of the course, you will be able to knowledgeably design, run, and analyze your own experiments that give statistical weight to your designs.

Enroll now

Or subscribe to Coursera Plus

And get unlimited access to Coursera

Two deals to help you save

Save money when you learn. Here are two deals and offers that may be relevant to this course.

All coupon codes, vouchers, and discounts are applied automatically unless otherwise noted.

Valid until July 14

Coursera Plus Annual

Work toward what's next for your career with access to 10,000+ programs. Discover emerging skills and save.

Valid until August 30

Google AI App Builder

Learn how to use Gemini API and API Studio with a three-course series from Google DeepMind

What's inside

Syllabus

Basic Experiment Design Concepts

In this module, you will learn basic concepts relevant to the design and analysis of experiments, including mean comparisons, variance, statistical significance, practical significance, sampling, inclusion and exclusion criteria, and informed consent. You’ll also learn to think of an experiment in terms of usability, its participants, apparatus, procedure, and design & analysis. This module covers lecture videos 1-2.

Traffic lights

Read about what's good

what should give you pause

and possible dealbreakers

Presents foundational concepts in experimental design and analysis, providing a strong grounding for beginners

Applies R programming language for statistical analysis, equipping learners with practical skills in data analysis

Covers a wide range of statistical methods, from basic to advanced, deepening learners' understanding of user experience evaluation

Provides real-world examples and case studies, demonstrating the practical application of user experience testing methods

Taught by Scott Klemmer and Jacob O. Wobbrock, renowned researchers and educators in the field of human-computer interaction

Includes interactive exercises and assignments to reinforce learning and provide hands-on experience

Save this course

Create your own learning path. Save this course to your list so you can find it easily later.

Save

Reviews summary

Designing and analyzing ux experiments with r

According to learners, this course provides a solid foundation in designing, running, and analyzing experiments, particularly within the context of UX, IxD, and HCI. Many found the content on statistical concepts and experimental design principles to be clear and well-explained. The course's focus on using the R statistical programming language for analysis was a significant aspect; while some found the R code examples practical and helpful for hands-on learning, a few reviewers mentioned needing additional resources or finding the code sometimes challenging or unclear, especially without prior programming experience. The assignments and labs were frequently highlighted as valuable for applying concepts. Overall, students feel the course equips them with the practical skills needed to conduct statistically sound user experiments.

Course is demanding but rewarding.

"This isn't an easy course; it requires dedication and effort, especially with the R aspects."

"Be prepared to spend significant time on the assignments and really think through the statistical concepts."

"It's a rigorous course that provides a deep dive, but you get out of it what you put in."

"Found the course quite demanding, but ultimately felt I learned a lot by the end."

Concepts applied directly to UX.

"The course uniquely applies statistical methods and experimental design specifically to UX and HCI problems."

"I found the real-world examples from UX research to be very relevant and helpful."

"This course fills a gap by showing how to use statistics effectively in user experience design."

"It's great that the course focuses on experiments designers and researchers actually run in practice."

Assignments reinforce understanding.

"The assignments were challenging but really helped solidify my understanding of the material and R."

"Working through the labs and homework was the best way to practice and internalize the concepts."

"I liked that the assignments required applying the analysis techniques shown in the lectures."

"The hands-on assignments analyzing datasets made the theoretical concepts much more concrete."

Statistical principles explained clearly.

"The instructor does a great job of explaining complex statistical concepts in an understandable way."

"I appreciated how the course broke down topics like ANOVA and GLM; it really helped clarify the principles."

"The lectures provided a very clear overview of the necessary statistical background for experiment design."

"Even without a strong stats background, the explanations made sense and built a solid understanding."

Learn key statistical analysis in R.

"Learning the fundamental analysis skills in R was a valuable takeaway. The examples were practical."

"I found the R code examples and the explanations of how to run the analyses very useful for practical application."

"The focus on using R for analyses like t-tests and ANOVA is very relevant for current industry practices."

"This course introduces R in a very practical, step-by-step way, making it accessible even if you're new to programming."

R code can be difficult for beginners.

"Some of the R code was a bit confusing, and I had to spend extra time troubleshooting or looking up functions."

"While the course says no prior programming is needed, navigating and modifying the R scripts was challenging at times."

"I felt the section on R could have been expanded or offered more basic explanations for complete novices."

"A few errors in the provided code snippets caused some frustration during assignments."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Designing, Running, and Analyzing Experiments with these activities:

Review statistics concepts

Show steps

Refresh your knowledge of statistics concepts such as mean, variance, and hypothesis testing.

Browse courses on Statistics

Show steps

Review your notes from a previous statistics course
Take a practice quiz on statistics concepts
Watch a video tutorial on hypothesis testing

Learn about R programming

Show steps

Complete tutorials on R programming to gain the skills necessary for data analysis.

Browse courses on R Programming

Show steps

Find a beginner-friendly R programming tutorial
Follow the tutorial and complete the exercises
Create a small R program of your own

Discuss user experience design principles with peers

Show steps

Engage in discussions with peers to exchange ideas and reinforce your understanding of user experience design principles.

Browse courses on User Experience Design

Show steps

Find a study group or online forum
Participate in discussions and share your thoughts
Listen to others' perspectives and learn from their experiences

Five other activities

Expand to see all activities and additional details

Show all eight activities

Calculate t-tests

Show steps

Practice calculating t-tests to solidify your understanding of hypothesis testing.

Browse courses on T-Tests

Show steps

Review the formula for a t-test
Find a dataset with two groups
Calculate the t-statistic
Find the p-value
Interpret the results

Design a user experience experiment

Show steps

Create a user experience experiment design to apply the concepts you've learned in the course.

Browse courses on Experiment Design

Show steps

Define your research question
Choose your participants
Design your experiment
Collect your data
Analyze your results

Read 'Designing User Interfaces' by Bill Moggridge

Show steps

Expand your knowledge of user experience design by reading a classic book in the field.

View Melania on Amazon

Show steps

Read the book
Take notes on the key concepts
Apply the concepts to your own work

Develop a user experience prototype

Show steps

Create a user experience prototype to demonstrate your mastery of the design process and showcase your skills.

Browse courses on Design

Show steps

Brainstorm ideas for your prototype
Sketch out your design
Build a functional prototype
Test your prototype with users
Refine your design based on feedback

Contribute to an open-source user experience project

Show steps

Engage in open-source collaboration to contribute to real-world user experience projects.

Browse courses on Open Source

Show steps

Find an open-source user experience project
Review the project's documentation
Identify a way to contribute
Submit a pull request with your changes
Collaborate with other contributors

Career center

Learners who complete Designing, Running, and Analyzing Experiments will develop knowledge and skills that may be useful to these careers:

UX Designer

As a UX Designer, you will be responsible for designing and evaluating user experiences. This course will provide you with the skills you need to create user-friendly and effective user interfaces. You will learn how to conduct user research, design prototypes, and test your designs with users. This course will also help you to develop the analytical skills you need to evaluate user data and make informed design decisions.

See salaries and explore the career path for UX Designer

Product Manager

As a Product Manager, you will be responsible for managing the development and launch of new products. This course will provide you with the skills you need to define product requirements, create product roadmaps, and track product progress. You will also learn how to conduct user research and analyze user data to make informed product decisions.

See salaries and explore the career path for Product Manager

Data Analyst

As a Data Analyst, you will be responsible for collecting, analyzing, and interpreting data. This course will provide you with the skills you need to clean and prepare data, conduct statistical analysis, and create data visualizations. You will also learn how to communicate your findings to stakeholders in a clear and concise way.

See salaries and explore the career path for Data Analyst

Business Analyst

As a Business Analyst, you will be responsible for analyzing business processes and identifying opportunities for improvement. This course will provide you with the skills you need to gather requirements, create process maps, and develop solutions to business problems. You will also learn how to communicate your findings to stakeholders in a clear and concise way.

See salaries and explore the career path for Business Analyst

User Researcher

As a User Researcher, you will be responsible for conducting user research and providing insights to design teams. This course will provide you with the skills you need to design and conduct user studies, analyze user data, and create user personas. You will also learn how to communicate your findings to stakeholders in a clear and concise way.

See salaries and explore the career path for User Researcher

Software Engineer

As a Software Engineer, you will be responsible for designing, developing, and testing software applications. This course will provide you with the skills you need to write clean and efficient code, design user interfaces, and debug software defects. You will also learn how to work in a team environment and use version control systems.

See salaries and explore the career path for Software Engineer

Marketing Manager

As a Marketing Manager, you will be responsible for developing and executing marketing campaigns. This course will provide you with the skills you need to create marketing plans, manage budgets, and track campaign performance. You will also learn how to use social media, email marketing, and other marketing channels to reach your target audience.

See salaries and explore the career path for Marketing Manager

Sales Manager

As a Sales Manager, you will be responsible for managing a sales team and achieving sales goals. This course will provide you with the skills you need to develop sales strategies, motivate your team, and close deals. You will also learn how to use sales tools and techniques to maximize your sales potential.

See salaries and explore the career path for Sales Manager

Project Manager

As a Project Manager, you will be responsible for planning, executing, and closing projects. This course will provide you with the skills you need to develop project plans, manage budgets, and track project progress. You will also learn how to communicate with stakeholders and resolve project issues.

See salaries and explore the career path for Project Manager

Operations Manager

As an Operations Manager, you will be responsible for managing the day-to-day operations of a business. This course will provide you with the skills you need to develop and implement operational plans, manage staff, and ensure that the business runs smoothly. You will also learn how to use data to improve operational efficiency.

See salaries and explore the career path for Operations Manager

Quality Assurance Analyst

As a Quality Assurance Analyst, you will be responsible for testing software applications and ensuring that they meet quality standards. This course will provide you with the skills you need to design and execute test cases, analyze test results, and report defects. You will also learn how to use quality assurance tools and techniques to improve the quality of software applications.

See salaries and explore the career path for Quality Assurance Analyst

Information Architect

As an Information Architect, you will be responsible for designing and organizing the content of websites and other digital products. This course will provide you with the skills you need to understand user needs, create sitemaps, and design navigation systems. You will also learn how to use information architecture tools and techniques to improve the usability of digital products.

See salaries and explore the career path for Information Architect

Interaction Designer

As an Interaction Designer, you will be responsible for designing the user experience of websites and other digital products. This course will provide you with the skills you need to understand user needs, create prototypes, and design user interfaces. You will also learn how to use interaction design tools and techniques to improve the usability of digital products.

See salaries and explore the career path for Interaction Designer

Visual Designer

As a Visual Designer, you will be responsible for creating the visual design of websites and other digital products. This course will provide you with the skills you need to understand visual design principles, create mockups, and design user interfaces. You will also learn how to use visual design tools and techniques to improve the usability of digital products.

See salaries and explore the career path for Visual Designer

Technical Writer

As a Technical Writer, you will be responsible for creating documentation for software products and other technical topics. This course will provide you with the skills you need to understand technical concepts, write clear and concise documentation, and use documentation tools and techniques.

See salaries and explore the career path for Technical Writer

Reading list

We've selected 12 books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Designing, Running, and Analyzing Experiments.

The Elements of Statistical Learning

Save

Provides a comprehensive overview of statistical learning methods. It covers topics such as linear regression, logistic regression, and decision trees. It could provide additional depth and breadth on statistical learning methods beyond what is covered in the course.

The Elements of Statistical Learning: Data Mining,...

Hardcover

$$$

Designing, Running, and Analyzing Experiments

Two deals to help you save

What's inside

Syllabus

Traffic lights

Save this course

Reviews summary

Designing and analyzing ux experiments with r

Activities

Career center

Reading list

Share

Similar courses