Symmetry breaking and training from incomplete data with Radial Basis Boltzmann Machines

A hybrid neural network system for pattern classification tasks with missing features

A hybrid neural network comprising Fuzzy ARTMAP and Fuzzy C-Means Clustering is proposed for pattern classification with incomplete training and test data. Two benchmark problems and a real medical pattern classification task are employed to evaluate the effectiveness of the hybrid network. The results are analyzed and compared with those from other methods.

Nonmonotonic generalization bias of Gaussian mixture models

Theories of learning and generalization hold that the generalization bias, defined as the difference between the training error and the generalization error, increases on average with the number of adaptive parameters. This article, however, shows that this general tendency is violated for a gaussian mixture model. For temperatures just below the first symmetry breaking point, the effective number of adaptive parameters increases and the generalization bias decreases. We compute the dependence of the neural information criterion on temperature around the symmetry breaking. Our results are confirmed by numerical cross-validation experiments.