Origins of the scientific method
Science is all about gaining knowledge, coming up with the best possible explanations of the world around us. So how do we decide which explanation is the best one? How do we make sure our explanations are accurate?
How do we determine we actually know something? In science we try to resolve these questions by using a set of principles and procedures called the scientific method. You need to know its historical and philosophical 'origin story' to really understand the scientific method and to fully appreciate how hard it is to apply the scientific method in the social and behavioral sciences!
The Scientific Method
In the first module we discussed how the scientific method developed, general philosophical approaches and the types of knowledge science aims to find. In this second module we'll make these abstract principles and concepts a little more concrete by discussing the empirical cycle and causality in more detail. We’ll see how, and in what order these concepts are implemented when we conduct a research study. We'll also consider the main criteria for evaluating the methodological quality of a research study: Validity and reliability. The focus will be on internal validity and how internal validity can be threatened.
Research Designs
In the previous module we discussed the empirical cycle, causality and the criteria for methodological quality, focusing on threats to internal validity. In this module we'll consider the most frequently used research designs and we'll see how they address threats to internal validity. We'll look at experimental, quasi-experimental and correlational designs, as well as some other designs you should be familiar with. To understand and appreciate these designs we will discuss some general concepts such as randomization and matching in a little more detail.
Measurement
Choosing a design is only the first step in the deduction phase (remember the empirical cycle?). The second step is deciding on specific ways to measure the variables of interest and disinterest.
This step is extremely important, because even if we are able to perform a true double-blind experiment, if our measurement and manipulation method are of poor quality, then internal validity will still be compromised!
In this module we'll look at what measurement is exactly and what the criteria for evaluating measurement are. We will also look more in-depth at self-report measures, including survey, questionnaires and tests. These methods are among the most frequently used measurement instruments in the social and behavioral sciences.
Sampling
In the previous two modules we discussed research designs and methods to measure and manipulate our variables of interest and disinterest. Before a researcher can move on to the testing phase and can actually collect data, there is just one more procedure that needs to be decided on: Sampling. Researchers need to determine who potential participants are and how they will be selected and recruited.
Practice, Ethics & Integrity
In this last content module we will focus on the part of the research process that follows data collection. The specifics of storing data and using statistics form a course topic in their own right (see the specialization courses on Basic and Inferential Statistics). For now we will focus on more general issues to do with data, interpretation and dissemination of results that relate to ethics and integrity. Some of the concepts that we discuss here will be familiar if you watched the interviews of the past modules. It might be interesting to (re-)watch these if you have the time!
Catch Up
In this module there's no new material to study. The only requirement in this module is that you finish up the final peer review assignment. We also advise you to take some extra time to review the material from the previous modules and to practice for the final exam. We've provided two practice exams that you can take as many times as you like. In the first one, feedback for each answer will be provided right after taking the test. We've also created some screencast videos that explain the right answers to the second practice exam in more detail.
Exam Time!
This is the final module, where you can apply everything you've learned until now in the final exam. The final exam is structured exactly like the practice exam, so you know what to expect. Please note that you can only take the final exam once a month, so make sure you are fully prepared to take the test. Please follow the honor code and do not communicate or confer with others taking this exam. Good luck! Once you've taken the exam why not check out the bonus material - a series of presentations on research integrity in the social sciences, presented at a special symposium at the University of Amsterdam in 2014.