Weight space structure and the storage capacity of a fully connected committee machine
SCIE
SCOPUS
- Title
- Weight space structure and the storage capacity of a fully connected committee machine
- Authors
- Xiong, YS; Oh, JH; Kwon, C
- Date Issued
- 1997-10
- Publisher
- AMERICAN PHYSICAL SOC
- Abstract
- We study the storage capacity of a fully connected committee machine with a large number K of hidden nodes. The storage capacity is obtained by analyzing the geometrical structure of the weight space related to the internal representation. By examining the asymptotic behavior of order parameters in the limit of large K, the storage capacity alpha(c) is found to be proportional to K root lnK up to the leading order. This result satisfies the mathematical bound given by Mitchison and Durbin [Biol. Cybern. 60, 345 (1989)], whereas the replica-symmetric solution in a conventional Gardner approach [Europhys. Lett. 41, 481 (1987); J. Phys. A 21, 257 (1988)] violates this bound.
- URI
- https://oasis.postech.ac.kr/handle/2014.oak/12339
- DOI
- 10.1103/PhysRevE.56.4540
- ISSN
- 1063-651X
- Article Type
- Article
- Citation
- PHYSICAL REVIEW E, vol. 56, no. 4, page. 4540 - 4544, 1997-10
- Files in This Item:
-
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.