Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/8183
Title: | Statistical physics of learning from examples - a brief introduction | Authors: | VAN DEN BROECK, Christian | Issue Date: | 1994 | Publisher: | POLISH ACAD SCIENCES INST PHYSICS | Source: | ACTA PHYSICA POLONICA B, 25(6). p. 903-923 | Abstract: | The problem of how one can learn from examples is illustrated on the case of a student perceptron trained by the Hebb rule on examples generated by a teacher perceptron. Two basic quantities are calculated : the training error and the generalization error. The obtained results are found to be typical. Other training rules are discussed. For the case of an Ising student with an Ising teacher, the existence of a first order phase transition is shown. Special effects such as dilution, queries, rejection, etc. are discussed and some results for multilayer networks are reviewed. In particular, the properties of a selfsimilar committee machine are derived. Finally, we discuss the statistics of generalization, with a review of the Hoeffding inequality, the Dvoretzky Kiefer Wolfowitz theorem and the Vapnik Chervonenkis theorem. | Notes: | VANDENBROECK, C, LIMBURGS UNIV CENTRUM,UNIV CAMPUS,B-3590 DIEPENBEEK,BELGIUM. | Document URI: | http://hdl.handle.net/1942/8183 | ISI #: | A1994NR85800001 | Type: | Journal Contribution |
Appears in Collections: | Research publications |
Show full item record
WEB OF SCIENCETM
Citations
7
checked on Jul 13, 2024
Page view(s)
18
checked on Nov 7, 2023
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.