Learning Coefficient of Vandermonde Matrix-Type Singularities in Model Selection
- PMID: 33267275
- PMCID: PMC7515050
- DOI: 10.3390/e21060561
Learning Coefficient of Vandermonde Matrix-Type Singularities in Model Selection
Abstract
In recent years, selecting appropriate learning models has become more important with the increased need to analyze learning systems, and many model selection methods have been developed. The learning coefficient in Bayesian estimation, which serves to measure the learning efficiency in singular learning models, has an important role in several information criteria. The learning coefficient in regular models is known as the dimension of the parameter space over two, while that in singular models is smaller and varies in learning models. The learning coefficient is known mathematically as the log canonical threshold. In this paper, we provide a new rational blowing-up method for obtaining these coefficients. In the application to Vandermonde matrix-type singularities, we show the efficiency of such methods.
Keywords: Kullback function; learning coefficient; resolution of singularities; singular learning machine.
Conflict of interest statement
The authors declare no conflict of interest.
Similar articles
-
Learning coefficient of generalization error in Bayesian estimation and vandermonde matrix-type singularity.Neural Comput. 2012 Jun;24(6):1569-610. doi: 10.1162/NECO_a_00271. Epub 2012 Feb 1. Neural Comput. 2012. PMID: 22295979
-
Singularities affect dynamics of learning in neuromanifolds.Neural Comput. 2006 May;18(5):1007-65. doi: 10.1162/089976606776241002. Neural Comput. 2006. PMID: 16595057
-
Singularities in mixture models and upper bounds of stochastic complexity.Neural Netw. 2003 Sep;16(7):1029-38. doi: 10.1016/S0893-6080(03)00005-4. Neural Netw. 2003. PMID: 14692637
-
Data-driven modeling and prediction of blood glucose dynamics: Machine learning applications in type 1 diabetes.Artif Intell Med. 2019 Jul;98:109-134. doi: 10.1016/j.artmed.2019.07.007. Epub 2019 Jul 26. Artif Intell Med. 2019. PMID: 31383477 Review.
-
A review on machine learning principles for multi-view biological data integration.Brief Bioinform. 2018 Mar 1;19(2):325-340. doi: 10.1093/bib/bbw113. Brief Bioinform. 2018. PMID: 28011753 Review.
References
-
- Akaike H. A new look at the statistical model identification. IEEE Trans. Autom. Control. 1974;19:716–723. doi: 10.1109/TAC.1974.1100705. - DOI
-
- Watanabe S. Algebraic geometry of learning machines with singularities and their prior distributions. J. Jpn. Soc. Artif. Intell. 2001;16:308–315.
-
- Watanabe S. Algebraic Geometry and Statistical Learning Theory. Volume 25 Cambridge University Press; New York, NY, USA: 2009.
LinkOut - more resources
Full Text Sources