Resources
Here are some useful resources that my lab has used in recent years. These mainly focus on ways that we can try to improve the quality and transparency of scientific workflows.
Things to read
This selection of journal papers and books provides a brief overview to Open Science and meta-science in general. Together, they motivate why the resources below have become an essential component to my lab’s research.
- Journal articles
- Books
Data analysis
My lab has been inspired to adopt a Bayesian estimation approach to statistical analysis. The general workflow follows Richard McElreath’s outstanding textbook and the translation into brms and Tidyverse by Solomon Kurz:
Statistical Rethinking by Richard McElreath
And Solomon Kurz’s ebook version, which is also AMAZING!
Here are a bunch of other links to stats stuff that I’ve found really valuable to read:
Kruschke’s Doing Bayesian Data Analysis
Kruschke & Liddell. A good primer on the differences between frequentist and Bayesian analyses, as well as hypothesis testing and estimation approaches.
Bodo Winter’s book is a great introduction to estimation approaches. It provides great R code for beginners and uses frequentist language, which should be more familiar to most. It is a great place to start and provides a natural platform to thinking about the same estimation approaches in a Bayesian context.
brms is a fabulous tool in R for running Bayesian analyses in STAN
Gigerenzer’s statistical rituals paper
On statistical thinking more generally
And why we need to do much more work before we think about running “tests” of hypotheses - Scheel and co.
Reproducible research and dissemination
version control
Reproducible manuscripts
Write your manuscripts in a computationally reproducible manner using R and the papaja() package.
See the papaja() manual for details.
And a helpful talk on papaja() by James Bartlett.
Dissemination via Quarto
- This book by James Bartlett is absolute solid gold. It walks through some really nice examples of how you can create reproducible talks, websites, books and blogs all using Quarto and Github pages.
Examples of Quarto websites
I followed a whole bunch of posts to start a quarto website. Here are some that I found very helpful indeed.
Drew Dimmery, especially for organising publications.
Open Science Framework
Pre-registration
Validity
A nice overview on four types of validity by Simine Vazire and co.
Why validity matters in experimental work in psychology and the importance of manipulation checks. One and Two
A fabulous empirical demonstration on the lack of relevant validity in a very well-cited social perception task - by Wendy Higgins and co. here and here