Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Feb;52(1):376-387.
doi: 10.3758/s13428-019-01236-y.

formr: A study framework allowing for automated feedback generation and complex longitudinal experience-sampling studies using R

Ruben C Arslan  1 , Matthias P Walther  2 , Cyril S Tata  3
Affiliations

formr: A study framework allowing for automated feedback generation and complex longitudinal experience-sampling studies using R

Ruben C Arslan et al. Behav Res Methods. 2020 Feb.

Abstract

Open-source software improves the reproducibility of scientific research. Because existing open-source tools often do not offer dedicated support for longitudinal data collection on phones and computers, we built formr, a study framework that enables researchers to conduct both simple surveys and more intricate studies. With automated email and text message reminders that can be sent according to any schedule, longitudinal and experience-sampling studies become easy to implement. By integrating a web-based application programming interface for the statistical programming language R via OpenCPU, formr allows researchers to use a familiar programming language to enable complex features. These can range from adaptive testing, to graphical and interactive feedback, to integration with non-survey data sources such as self-trackers or online social network data. Here we showcase three studies created in formr: a study of couples with dyadic feedback; a longitudinal study over months, which included social networks and peer and partner ratings; and a diary study with daily invitations sent out by text message and email and extensive feedback on intraindividual patterns.

Keywords: Feedback; Online; R; Study; Survey; Web.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Table 1, as rendered by formr on a mobile device
Fig. 2
Fig. 2
Screenshot of a very simple run for a one-shot survey. The tape deck controls at the bottom allow researchers to add further components, and the publicness settings for the study are in the top right-hand corner. The function of each button is explained on mouseover
Fig. 3
Fig. 3
Feedback graph example from a study on risk preferences, showing a graph generated with ggplot2
Fig. 4
Fig. 4
A (translated) graph of one participant’s psychological changes across the menstrual cycle in the daily diary study
Fig. 5
Fig. 5
Example of a (translated) feedback graph, generated in the daily diary study to show how the participant had spent her time during the week and during the weekend
See this image and copyright information in PMC

References

    1. Allaire, J. J., Xie, Y., McPherson, J., Luraschi, J., Ushey, K., Atkins, A., . . . Chang, W. (2018). rmarkdown: Dynamic documents for R [Software] (Version 1.10). Retrieved from https://CRAN.R-project.org/package=rmarkdown
    1. Arslan, R. C., Jünger, J., Gerlach, T. M., Ostner, J., & Penke, L. (2016). Online diary study of ovulatory cycle shifts on sexual desire, sexual activity, and mating behaviour. Retrieved from https://osf.io/d3avf/
    1. Arslan, R. C., Schilling, K. M., Gerlach, T. M., & Penke, L. (2018). Using 26 thousand diary entries to show ovulatory changes in sexual desire and behaviour. Journal of Personality and Social Psychology. Advance online publication. 10.1037/pspp0000208 - PubMed
    1. Arslan, R. C. (in press). How to automatically document data with the codebook package to facilitate data re-use. Advances in Methods and Practices in Psychological Science.
    1. Bosnjak M, Tuten TL. Classifying response behaviors in Web-based surveys. Journal of Computer-Mediated Communication. 2001;6:JCMC636. doi: 10.1111/j.1083-6101.2001.tb00124.x. - DOI

Publication types

LinkOut - more resources