Research Methods

Sharing R products

Don’t set R’s working directory from an R script.

Correlated Psychological Variables, Uncertainty, and Bayesian Estimation

Assessing the correlations between psychological variabless, such as abilities and improvements, is one essential goal of psychological science. However, psychological variables are usually only available to the researcher as estimated parameters in mathematical and statistical models. The parameters are often estimated from small samples of observations for each research participant, which results in uncertainty (aka sampling error) about the participant-specific parameters. Ignoring the resulting uncertainty can lead to suboptimal inferences, such as asserting findings with too much confidence. Hierarchical models alleviate this problem by accounting for each parameter’s uncertainty at the person- and average levels. However, common maximum likelihood estimation methods can have difficulties converging and finding appropriate values for parameters that describe the person-level parameters’ spread and correlation. In this post, I discuss how Bayesian hierarchical models solve this problem, and advocate their use in estimating psychological variables and their correlations.

On bayesian data analysis and bayes factors

It appears that there is an imbalance in what many beginning bayesian data analysts think about BDA. From casual observation and discussions, I’ve noticed a tendency for people to equate bayesian methods with computing bayes factors; that is, testing (usually null) hypotheses using bayesian model comparison.

Links to scientific practices workshop materials

We recently ran a Scientific Practices Workshop, and one of us later collected several links for follow-up materials for the interested. I thought the list of links was a fantastic source of materials, so I post it here: Why this is important? (New) A publication reform is needed Would you like to take the recommended Statistical Rethinking course? Statistical Rethinking: The course, the lectures, the textbook. Would you like to learn more about Bayesian statistics?