We may earn an affiliate commission when you visit our partners.
Sebastian Thrun
and
Josh Bernhard
Register for this course and see more details by visiting:
OpenCourser.com/course/lrgrhl/experimentatio
Here's a deal for you
Save money when you learn with a deal that may be relevant to this course.
All coupon codes, vouchers, and discounts are applied automatically unless otherwise noted.
OPENCOURSER
What's inside
Syllabus
In this lesson, we begin the course by meeting the instructors and giving a quick introduction to experimentation.
In this lesson, you'll learn the mathematics behind moving from a coin flip to a normal distribution.
Read more
Syllabus
In this lesson, we begin the course by meeting the instructors and giving a quick introduction to experimentation.
In this lesson, you'll learn the mathematics behind moving from a coin flip to a normal distribution.
Read more
Traffic lights
Traffic lights
Read about what's good
what should give you pause and
possible dealbreakers
Develops foundational principles and advanced concepts of experimentation in statistics
Emphasizes the practical application of statistical concepts through hands-on Python coding exercises
Provides a comprehensive understanding of confidence intervals and hypothesis testing
Features real-world case studies to demonstrate the relevance of statistical techniques
Taught by experienced instructors with a strong reputation in the field of statistics
Assumes some prior knowledge of statistics, making it suitable for intermediate-level learners
Save this course
Create your own learning path.
Save this course to your list so you can find it easily later.
Save
Save
Reviews summary
Practical experimentation & a/b testing with python
According to students, this course offers a largely positive and highly practical approach to understanding experimentation, particularly A/B testing. Learners consistently praise the instructor's clear explanations that simplify complex statistical concepts, building intuition from basic principles like coin flips to normal distributions. The integration of Python implementations for concepts like sampling distributions, confidence intervals, and hypothesis testing is highlighted as a major strength, making the material directly applicable. The real-world A/B testing case study is frequently cited as a superb and practical capstone. While some learners desired more advanced topics or additional exercises, the course is broadly considered a strong foundation for professionals in data science and product analytics.
Builds a solid understanding of statistical experimentation.
"This course is a solid introduction to experimentation. The initial modules on statistical fundamentals were very thorough."
"It’s a strong foundation, but I don't expect to be an expert solely from this course."
"It solidified my understanding of the statistical backbone of A/B tests."
"This course is foundational for anyone in data science or product analytics."
Recent reviews indicate high satisfaction and sustained quality.
"This course is a gem for anyone wanting to truly understand A/B testing beyond just running code."
"Phenomenal course! The clarity around hypothesis testing and understanding p-values was transformative."
"As a data scientist, I highly recommend this course. It solidified my understanding of the statistical backbone."
"This course is a must-take! It demystifies experimentation, and the instructor makes learning fun."
Excellent real-world example tying all concepts together.
"I especially loved the real-world A/B testing case study; it tied everything together perfectly."
"The case study was good, but I wished there were more of them."
"Loved the case study! It brought everything together and showed how real-world A/B tests are done."
"The A/B testing case study is superb and provides immense practical value."
Real-world application of statistical concepts using Python.
"The Python implementations are practical and directly applicable."
"The hands-on coding exercises helped me apply the theory immediately."
"The practical Python examples made applying the theory straightforward."
"I really appreciated the focus on Python implementation; it was a key takeaway."
Complex statistical concepts are made accessible.
"The instructor's explanations of sampling distributions and hypothesis testing are incredibly clear, simplifying complex topics."
"Absolutely brilliant! As someone from a non-stats background, this course made experimentation concepts accessible."
"The clarity around hypothesis testing and understanding p-values was transformative."
"The clarity of the instructor's explanations, especially on hypothesis testing and confidence intervals, is unparalleled."
Some learners wished for more exercises or quizzes.
"I found myself wishing for more complex examples or additional exercises to solidify my understanding."
"I think the course could benefit from more interactive quizzes or problem sets beyond what was provided."
"I was expecting more advanced topics or challenges, or more extensive practice opportunities."
"My only suggestion would be to perhaps add a module on common pitfalls or advanced experimental designs."
Some desired more advanced topics; others found initial pace slow.
"While the instructor is knowledgeable, I felt the explanations were sometimes too theoretical for my needs."
"It didn't go deep enough for me, as someone with some prior stats exposure."
"I think it's better suited for absolute beginners in statistics, as I found parts repetitive or too slow."
"As an absolute beginner, I found some parts challenging to follow, wishing for more interactive elements."
Activities
Be better prepared
before
your course. Deepen your understanding
during
and
after
it. Supplement your coursework and achieve mastery of the topics covered
in Experimentation with these
activities:
Review Pre-Algebra and Calculus
Show steps
Refresh your understanding of basic algebra and calculus in order to strengthen foundational knowledge.
Show steps
Join a study group to discuss course material and work on problems together
Show steps
Collaborate with peers to discuss course material, ask questions, and solve problems.
Show steps
-
Find or create a study group with other students in the course
-
Meet regularly to discuss the course material and work on problems
-
Help each other understand concepts and prepare for assessments
Create mind maps of statistics concepts
Show steps
Create visual representations of statistics concepts to enhance understanding and retention.
Browse courses on
Descriptive Statistics
Show steps
-
Choose a statistics concept to focus on
-
Brainstorm related ideas and keywords
-
Organize the ideas into a visual map
Five other activities
Expand to see all activities and additional details
Show all eight activities
Practice solving probability and statistics problems
Show steps
Complete practice problems to reinforce your understanding of probability and statistics concepts.
Browse courses on
Probability
Show steps
-
Find practice problems online or in textbooks
-
Solve the problems using the techniques learned in class
-
Check your answers and identify areas where you need more practice
Compile a resource list of statistics websites and software
Show steps
Create a comprehensive list of resources to support learning and provide additional practice.
Show steps
-
Search for websites and software related to statistics
-
Organize the resources into a structured list
-
Share the resource list with classmates or online communities
Complete online tutorials on confidence intervals and hypothesis testing
Show steps
Seek out and follow tutorials to reinforce your understanding of confidence intervals and hypothesis testing.
Browse courses on
Confidence Intervals
Show steps
-
Search for reputable online tutorials
-
Follow the tutorials and complete the practice exercises provided
-
Review the material covered in the tutorials to reinforce your understanding
Participate in a data analysis or statistics competition
Show steps
Test your skills and knowledge in a competitive environment.
Browse courses on
Data Analysis
Show steps
-
Find a relevant competition to participate in
-
Form a team or work individually on the competition
-
Apply the statistical concepts and techniques learned in the course
-
Analyze the results and learn from the experience
Volunteer at a local organization that uses statistics for data analysis
Show steps
Apply your knowledge and skills to real-world projects while making a meaningful contribution.
Browse courses on
Data Analysis
Show steps
-
Identify a local organization that uses statistics in their work
-
Contact the organization and inquire about volunteer opportunities
-
Participate in projects and assist with data collection and analysis
Review Pre-Algebra and Calculus
Show steps
Refresh your understanding of basic algebra and calculus in order to strengthen foundational knowledge.
Show steps
Show steps
Show steps
Join a study group to discuss course material and work on problems together
Show steps
Collaborate with peers to discuss course material, ask questions, and solve problems.
Show steps
Show steps
Show steps
- Find or create a study group with other students in the course
- Meet regularly to discuss the course material and work on problems
- Help each other understand concepts and prepare for assessments
Create mind maps of statistics concepts
Show steps
Create visual representations of statistics concepts to enhance understanding and retention.
Browse courses on
Descriptive Statistics
Show steps
Show steps
Show steps
- Choose a statistics concept to focus on
- Brainstorm related ideas and keywords
- Organize the ideas into a visual map
Five other activities
Expand to see all activities and additional details
Show all eight activities
Practice solving probability and statistics problems
Show steps
Complete practice problems to reinforce your understanding of probability and statistics concepts.
Browse courses on
Probability
Show steps
Show steps
Show steps
- Find practice problems online or in textbooks
- Solve the problems using the techniques learned in class
- Check your answers and identify areas where you need more practice
Compile a resource list of statistics websites and software
Show steps
Create a comprehensive list of resources to support learning and provide additional practice.
Show steps
Show steps
Show steps
- Search for websites and software related to statistics
- Organize the resources into a structured list
- Share the resource list with classmates or online communities
Complete online tutorials on confidence intervals and hypothesis testing
Show steps
Seek out and follow tutorials to reinforce your understanding of confidence intervals and hypothesis testing.
Browse courses on
Confidence Intervals
Show steps
Show steps
Show steps
- Search for reputable online tutorials
- Follow the tutorials and complete the practice exercises provided
- Review the material covered in the tutorials to reinforce your understanding
Participate in a data analysis or statistics competition
Show steps
Test your skills and knowledge in a competitive environment.
Browse courses on
Data Analysis
Show steps
Show steps
Show steps
- Find a relevant competition to participate in
- Form a team or work individually on the competition
- Apply the statistical concepts and techniques learned in the course
- Analyze the results and learn from the experience
Volunteer at a local organization that uses statistics for data analysis
Show steps
Apply your knowledge and skills to real-world projects while making a meaningful contribution.
Browse courses on
Data Analysis
Show steps
Show steps
Show steps
- Identify a local organization that uses statistics in their work
- Contact the organization and inquire about volunteer opportunities
- Participate in projects and assist with data collection and analysis
Career center
Learners who complete Experimentation will develop knowledge and skills
that may be useful to these careers:
Statistician
Statistician
A Statistician designs, conducts, and analyzes statistical surveys and experiments. They use mathematical and statistical techniques to analyze data and draw conclusions.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Statisticians who need to be able to design and analyze experiments and draw valid conclusions from data.
Data Scientist
Data Scientist
Data Scientists use scientific methods, processes, algorithms, and systems to extract knowledge and insights from data in various forms, both structured and unstructured.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Data Scientists who need to be able to analyze data and draw valid conclusions.
Machine Learning Engineer
Machine Learning Engineer
Machine Learning Engineers design and develop machine learning models and algorithms to solve complex problems. They use statistical techniques to analyze data and build models that can make predictions or decisions.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Machine Learning Engineers who need to be able to design and analyze experiments and draw valid conclusions from data.
Quantitative Analyst
Quantitative Analyst
Quantitative Analysts use mathematical and statistical models to analyze financial data and make investment decisions. They use statistical techniques to analyze data and identify trends and patterns.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Quantitative Analysts who need to be able to analyze data and draw valid conclusions.
Operations Research Analyst
Operations Research Analyst
Operations Research Analysts use mathematical and statistical models to solve complex problems in business and industry. They use statistical techniques to analyze data and identify trends and patterns.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Operations Research Analysts who need to be able to analyze data and draw valid conclusions.
Market Research Analyst
Market Research Analyst
Market Research Analysts conduct surveys and experiments to collect data about consumer behavior and preferences. They use statistical techniques to analyze data and identify trends and patterns.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Market Research Analysts who need to be able to analyze data and draw valid conclusions.
Epidemiologist
Epidemiologist
Epidemiologists investigate the causes and patterns of disease and injury in populations. They use statistical techniques to analyze data and identify risk factors and trends.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Epidemiologists who need to be able to analyze data and draw valid conclusions.
Biostatistician
Biostatistician
Biostatisticians apply statistical methods to the design, conduct, and analysis of research studies in the biomedical sciences. They use statistical techniques to analyze data and draw conclusions about the effectiveness and safety of medical treatments.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Biostatisticians who need to be able to analyze data and draw valid conclusions.
Clinical Research Associate
Clinical Research Associate
CRAs monitor clinical trials to ensure that they are conducted according to protocol and that the data is collected and managed according to Good Clinical Practice (GCP) guidelines. They use statistical techniques to analyze data and identify trends and patterns.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for CRAs who need to be able to analyze data and draw valid conclusions.
Business Analyst
Business Analyst
Business Analysts use statistical techniques to analyze data and identify trends and patterns. They use this information to make recommendations to businesses on how to improve their operations and decision-making.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Business Analysts who need to be able to analyze data and draw valid conclusions.
Financial Analyst
Financial Analyst
Financial Analysts use statistical techniques to analyze financial data and make investment recommendations. They use statistical techniques to analyze data and identify trends and patterns.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Financial Analysts who need to be able to analyze data and draw valid conclusions.
Sales Analyst
Sales Analyst
Sales Analysts use statistical techniques to analyze sales data and identify trends and patterns. They use this information to make recommendations to sales teams on how to improve their performance.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Sales Analysts who need to be able to analyze data and draw valid conclusions.
Risk Analyst
Risk Analyst
Risk Analysts use statistical techniques to analyze data and identify risks. They use this information to make recommendations to businesses on how to manage their risks.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Risk Analysts who need to be able to analyze data and draw valid conclusions.
Insurance Actuary
Insurance Actuary
Insurance Actuaries use statistical techniques to analyze data and assess risk. They use this information to set insurance rates and design insurance products.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Insurance Actuaries who need to be able to analyze data and draw valid conclusions.
Data Visualization Specialist
Data Visualization Specialist
Data Visualization Specialists use statistical techniques to create visual representations of data. They use this information to communicate insights about data to businesses and stakeholders.
This course can help you build a strong foundation in statistical concepts, including sampling distributions, confidence intervals, and hypothesis testing. These skills are essential for Data Visualization Specialists who need to be able to analyze data and draw valid conclusions.
For more career information including salaries, visit:
OpenCourser.com/course/lrgrhl/experimentatio
Reading list
We've selected ten books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Experimentation.
Classic text on the design of experiments. It provides a comprehensive overview of the principles and methods used in experimental design.
Comprehensive overview of causal inference. It covers a wide range of topics, from basic concepts to advanced techniques.
Save
Comprehensive overview of deep learning. It covers a wide range of topics, from basic concepts to advanced techniques.
Comprehensive overview of reinforcement learning. It covers a wide range of topics, from basic concepts to advanced techniques.
Save
Comprehensive overview of time series analysis. It covers a wide range of topics, from basic concepts to advanced techniques.
Comprehensive overview of Bayesian data analysis. It covers a wide range of topics, from basic concepts to advanced techniques.
Comprehensive overview of Bayesian statistics. It covers a wide range of topics, from basic concepts to advanced techniques.
Comprehensive overview of econometrics. It covers a wide range of topics, from basic concepts to advanced techniques.
Comprehensive overview of statistical learning methods. It covers a wide range of topics, from basic concepts to advanced techniques.
Provides a comprehensive overview of probability and statistics for engineers and scientists.
For more information about how these books relate to this course, visit:
OpenCourser.com/course/lrgrhl/experimentatio
Share
Similar courses
Similar courses are unavailable at this time. Please try again later.
Our mission
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
Affiliate disclosure
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
© 2016 - 2025 OpenCourser