Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Oct;55(7):3566-3584.
doi: 10.3758/s13428-022-01976-4. Epub 2022 Oct 20.

A comparison of logistic regression methods for Ising model estimation

Michael J Brusco  1 , Douglas Steinley  2 , Ashley L Watts  2
Affiliations

A comparison of logistic regression methods for Ising model estimation

Michael J Brusco et al. Behav Res Methods. 2023 Oct.

Abstract

The Ising model has received significant attention in network psychometrics during the past decade. A popular estimation procedure is IsingFit, which uses nodewise l1-regularized logistic regression along with the extended Bayesian information criterion to establish the edge weights for the network. In this paper, we report the results of a simulation study comparing IsingFit to two alternative approaches: (1) a nonregularized nodewise stepwise logistic regression method, and (2) a recently proposed global l1-regularized logistic regression method that estimates all edge weights in a single stage, thus circumventing the need for nodewise estimation. MATLAB scripts for the methods are provided as supplemental material. The global l1-regularized logistic regression method generally provided greater accuracy and sensitivity than IsingFit, at the expense of lower specificity and much greater computation time. The stepwise approach showed considerable promise. Relative to the l1-regularized approaches, the stepwise method provided better average specificity for all experimental conditions, as well as comparable accuracy and sensitivity at the largest sample size.

Keywords: Ising model; Network psychometrics; Stepwise logistic regression; l 1-regularized logistic regression.

PubMed Disclaimer

References

    1. Aurell, E., & Ekeberg, M. (2012). Inverse Ising inference using all the data. Physical Review Letters, 108, 090201. https://doi.org/10.1103/PhysRevLett.108.090201 - DOI
    1. Barber, R. F., & Drton, M. (2015). High-dimensional Ising model selection with Bayesian information criteria. Electronic Journal of Statistics, 9, 567–607. https://doi.org/10.1214/15-EJS1012 - DOI
    1. Bertsimas, D., & King, A. (2016). OR Forum—An algorithmic approach to linear regression. Operations Research, 64(1), 2–16. https://doi.org/10.1287/opre.2015.1436 - DOI
    1. Bertsimas, D., & King, A. (2017). Logistic regression: from art to science. Statistical Science, 32(3), 367–384. https://doi.org/10.1214/16-STS602 - DOI
    1. Bertsimas, D., & Van Parys, B. (2020). Sparse high-dimensional regression: exact scalable algorithms and phase transitions. The Annals of Statistics, 48(1), 300–323. https://doi.org/10.1214/18-AOS1804 - DOI

LinkOut - more resources