Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/3154
Title: | Learning in the hypercube: A stepping stone to the binary perceptron | Authors: | BOUTEN, Marcus Reimers, L VAN ROMPAEY, Bart |
Issue Date: | 1998 | Publisher: | AMERICAN PHYSICAL SOC | Source: | PHYSICAL REVIEW E, 58(2). p. 2378-2385 | Abstract: | The learning problem for storing random patterns in a perceptron with binary weights can be facilitated by pretraining an appropriate precursor network with continuous weights. Unlike previous studies which compare the performance of different continuous-weight perceptrons on the hypersphere (spherical constraint), we also consider weight vectors constrained to the volume of the hypercube (cubical constraint). We compare the performance of the maximally stable networks on the hypersphere and in the hypercube, and show that the latter is superior for predicting the weights of the maximally stable binary perceptron. We further determine an upper bound for the fraction of binary weights that any precursor is able to predict correctly, and introduce a precursor in the hypercube that closely approaches this upper bound. We finally demonstrate the value of this hypercube precursor by carrying out simulations for a perceptron with up to 100 weights. | Notes: | Limburgs Univ Ctr, B-3590 Diepenbeek, Belgium.Bouten, M, Limburgs Univ Ctr, B-3590 Diepenbeek, Belgium. | Document URI: | http://hdl.handle.net/1942/3154 | DOI: | 10.1103/PhysRevE.58.2378 | ISI #: | 000075381500046 | Type: | Journal Contribution | Validations: | ecoom 1999 |
Appears in Collections: | Research publications |
Show full item record
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.