How to Conduct a Meta-Analysis Using Open-Science Software

“Systematic reviews and meta-analyses are essential tools for summarizing evidence accurately and reliably (…)” (Liberati et al., p. 1). Currently, meta-analysis is a widely applied technique. It applies to many of today’s issues surrounding scientific research. It can be used not only to reach conclusions regarding the overall effect of proven correlation, but it is also essential for finding and estimating publication bias. The meta-analysis is also useful when conducting a priori power analysis to design sample size.

Session 2
18 July to 1 August 2020
Course levelAdvanced Bachelor/Master, open to PhD staff and professionals
Co-ordinating lecturers         
Dr. Jacek Buczny
Other lecturersShuxian Jin
Form of tuitionInteractive seminar
Forms of assessmentFour written assignments consulted with the teacher
Credits3 ECTS
Contact hours45 hours
Tuition fee€1150, read more about what's included
Additional
Accommodation and social programme
How to apply
Find our application form here
This course is for Advanced Bachelor’s and Master’s students. However, enthusiastic PhD candidates and professionals interested in the application of quantitative data analysis are also very welcome to register for this summer course. This course takes inspiration from the disciplines of economics and business studies, as well as social and behavioral sciences. If you have doubts about your eligibility for the course, please let us know. Our courses are multi-disciplinary and therefore open to students and professionals with a wide variety of backgrounds.

“Systematic reviews and meta-analyses are essential tools for summarizing evidence accurately and reliably (…)” (Liberati et al., p. 1). Currently, meta-analysis is a widely applied technique. It applies to many of today’s issues surrounding scientific research. It can be used not only to reach conclusions regarding the overall effect of proven correlation, but it is also essential for finding and estimating publication bias. The meta-analysis is also useful when conducting a priori power analysis to design sample size.

During this course, students will learn how to formulate a problem and analyze it conducting a meta-analysis in JASP, an open-science software. Also, students will practice a wide-and-far literature search and will learn how to report their findings following the PRISMA standards. Students will learn the basics of how to prepare and describe a meta-analytical study in a separate article. They will see how to apply this technique to summarise studies found in a manuscript in order to improve the cohesion and “publishability.”

This course is taught in the form of an interactive seminar, in which students will complete four individual assignments, one each day. After submission of each assignment, students will receive feedback.

There will be discussions on the following topics:

  • Two types of systematic reviews
  • Open science and meta-analysis: multisite replications
  • Pros and cons of meta-analysis
  • Publication bias and quality of publications
  • Effect size and how to calculate it
  • Literature search, exclusion, inclusion, and coding
  • Heterogeneity and its consequences
  • Available software, including JASP
  • Fixed- and random-effects model
  • Estimating overall effect size
  • Analysis of moderators

Additionally, students will become familiar with examples of published research to learn more about how to analyse them.

Upon completion of the course, the student should be able to:

  • Formulate a research question to conduct a meta-analysis
  • Carry out a literature search far and wide
  • Systematically review relevant literature
  • Code studies fitting inclusion criteria
  • Meta-analyze the coded effects using JASP software
  • Interpret and report the meta-analytic results

No excursion planned. Guest lecture from the field will come and visit.

Field, A. P., & Gillett, R. (2010). How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology, 63, 665–694. doi:10.1348/000711010×502733
https://jasp-stats.org/2017/11/15/meta-analysis-jasp/
More materials will follow.



Shuxian Jin is a PhD candidate in Daniel Balliet's Amsterdam Cooperations Lab and Department of Experimental and Applied Psychology of Vrije Universiteit Amsterdam. She is going to introduce an open science project: Cooperation Databank. The project aims at creating a large database of studies on human cooperation using social dilemmas. The goal is to create a reliable source of literature to be used for conducting a meta-analysis on cooperation. More information can be found here: https://amsterdamcooperationlab.com/databank/.

Do you want to make the most out of your summer? You can combine this course with the following courses in session 1: