Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Nov 12;13(11):e0207334.
doi: 10.1371/journal.pone.0207334. eCollection 2018.

Determining minimal output sets that ensure structural identifiability

Affiliations

Determining minimal output sets that ensure structural identifiability

D Joubert et al. PLoS One. .

Abstract

The process of inferring parameter values from experimental data can be a cumbersome task. In addition, the collection of experimental data can be time consuming and costly. This paper covers both these issues by addressing the following question: "Which experimental outputs should be measured to ensure that unique model parameters can be calculated?". Stated formally, we examine the topic of minimal output sets that guarantee a model's structural identifiability. To that end, we introduce an algorithm that guides a researcher as to which model outputs to measure. Our algorithm consists of an iterative structural identifiability analysis and can determine multiple minimal output sets of a model. This choice in different output sets offers researchers flexibility during experimental design. Our method can determine minimal output sets of large differential equation models within short computational times.

PubMed Disclaimer

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1
Fig 1. NF- κB model: Singular values of the output sensitivity matrix, Snorm, if we measure all states, {x1, …, x15}, as model output.
Singular values, arranged in descending order, reveal no gap. This suggests that the sensitivity matrix is of full rank and therefore the model is structurally identifiable.
Fig 2
Fig 2. NF- κB model: Singular values of the output sensitivity matrix, Snorm, if we measure all states apart from x4.
Singular values, arranged in descending order, reveal a clear gap with σ43 = 7.8 × 10−16. This indicates that the sensitivity matrix is rank deficient and so the model is structurally unidentifiable.
Fig 3
Fig 3. NF- κB model: Entries in the last right singular vector corresponding to the vanishing singular value, σ43, in Fig 2.
The corresponding non-trivial null-space indicates that parameters θ2, θ3, θ27 and initial condition x4(0) are totally correlated.
Fig 4
Fig 4. Example 1: Structural identifiability results of a chemical reaction system: Singular values of the output sensitivity matrix, Snorm, when measuring the output {x1 …, x11} omitting sensors x4 and x5.
Singular values, arranged in descending order, reveal a clear gap. This gap, in conjunction with the smallest singular value, σ17 = 2.4 × 10−17, indicate that the model is structurally unidentifiable when measuring this output.
Fig 5
Fig 5. Example 1: Structural identifiability results of a chemical reaction system: Non-zero entries in the last 4 columns of matrix V.
These indicate that initial conditions x4(0) and x5(0) and model parameters θ2 and θ3 are unidentifiable. Since x4 and x5 are defined in ymax, both of these sensors are essential.
Fig 6
Fig 6. Example 3: JAK-STAT model: Singular values of the output sensitivity matrix, Snorm, when measuring the model output {x1, …, x31}, omitting sensors x10 and x11.
Singular values reveal a clear gap and this, in conjunction with the smallest singular value of σ82 = 7.3 × 10−16, indicates that Snorm is not of full rank and therefore the model is structurally unidentifiable.
Fig 7
Fig 7. Example 3: JAK-STAT model: Entries in the last right singular vector corresponding to the vanishing singular value, σ82, in Fig 6.
The corresponding non-trivial null-space indicates that model parameters θ14, θ51 and initial conditions x10(0) and x11(0) are totally correlated and so the model is not identifiable when model states x10 and x11 are simultaneously omitted from the model’s output.
Fig 8
Fig 8. Example 4: Ligand binding model: Entries in the last right singular vector, corresponding to the smallest singular value of precisely zero, calculated for the measured output {x1, x2, x3, x4, x6}.
The non-trivial null-space indicates that the initial condition of state x5 is unidentifiable when this state is not measured. Accordingly, x5 should be included into the model’s minimal output set.
Fig 9
Fig 9. Example 5: Simplified glycolytic reaction model: Entries in the right singular vectors corresponding to 2 vanishing singular values.
The non-zero values indicate that the initial condition x10(0) and parameter θ13 are unidentifiable when state x10 is not measured.
Fig 10
Fig 10. Example 6: Goldbeter model: Entries in the last right singular vector corresponding to single vanishing singular value calculated.
The non-zero values indicate that parameters θ1, θ3, θ4, θ5 and initial condition x1(0) are unidentifiable when state x1 is not measured.
Fig 11
Fig 11. Example 7: JAK/STAT model with specific model output: Singular values of the output sensitivity matrix, S, when omitting sensor θ17(x4 + x5) from ymax.
Singular values, arranged in descending order, reveal a clear gap. This gap in conjunction with the smallest singular value of 4 × 10−18, indicate that S is rank deficient.
Fig 12
Fig 12. Example 7: JAK/STAT model with specific model output: Entries in the last right singular vector corresponding to the vanishing singular value in Fig 11.
The non-trivial null-space indicates that model parameter θ17 is not identifiable when sensor θ17(x4 + x5) is not measured.

References

    1. Raue A, Karlsson J, Saccomani MP, Jirstrand M, Timmer J. Comparison of approaches for parameter identifiability analysis of biological systems. Bioinformatics. 2014; 30(10):1440–1448. 10.1093/bioinformatics/btu006 - DOI - PubMed
    1. Cole DJ, Morgan BJT, Titterington DM. Determining the parametric structure of models. Math Biosci. 2010; 228(1):16–30 10.1016/j.mbs.2010.08.004 - DOI - PubMed
    1. Anguelova M, Karlsson J, Jirstrand M. Minimal output sets for identifiability. Math Biosci. 2012; 239(1):139–153. 10.1016/j.mbs.2012.04.005 - DOI - PubMed
    1. August, E. Parameter identifiability and optimal experimental design. Proceedings of the 12th IEEE International Conference on Computational Science and Engineering; 2009 Aug 29-31; Vancouver, Canada. IEEE Computational Society, 2009.
    1. Liu YY, Slotine JJ, Barabási AL. Observability of complex systems. Proc Natl Acad Sci USA. 2013; 110(7):2460–2465. 10.1073/pnas.1215508110 - DOI - PMC - PubMed