Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Jun 4;21(6):561.
doi: 10.3390/e21060561.

Learning Coefficient of Vandermonde Matrix-Type Singularities in Model Selection

Affiliations

Learning Coefficient of Vandermonde Matrix-Type Singularities in Model Selection

Miki Aoyagi. Entropy (Basel). .

Abstract

In recent years, selecting appropriate learning models has become more important with the increased need to analyze learning systems, and many model selection methods have been developed. The learning coefficient in Bayesian estimation, which serves to measure the learning efficiency in singular learning models, has an important role in several information criteria. The learning coefficient in regular models is known as the dimension of the parameter space over two, while that in singular models is smaller and varies in learning models. The learning coefficient is known mathematically as the log canonical threshold. In this paper, we provide a new rational blowing-up method for obtaining these coefficients. In the application to Vandermonde matrix-type singularities, we show the efficiency of such methods.

Keywords: Kullback function; learning coefficient; resolution of singularities; singular learning machine.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Similar articles

References

    1. Akaike H. A new look at the statistical model identification. IEEE Trans. Autom. Control. 1974;19:716–723. doi: 10.1109/TAC.1974.1100705. - DOI
    1. Watanabe S. Algebraic analysis for nonidentifiable learning machines. Neural Comput. 2001;13:899–933. doi: 10.1162/089976601300014402. - DOI - PubMed
    1. Watanabe S. Algebraic geometrical methods for hierarchical learning machines. Neural Netw. 2001;14:1049–1060. doi: 10.1016/S0893-6080(01)00069-7. - DOI - PubMed
    1. Watanabe S. Algebraic geometry of learning machines with singularities and their prior distributions. J. Jpn. Soc. Artif. Intell. 2001;16:308–315.
    1. Watanabe S. Algebraic Geometry and Statistical Learning Theory. Volume 25 Cambridge University Press; New York, NY, USA: 2009.

LinkOut - more resources