© The Author, 2005. Published by Oxford University Press. All rights reserved.
Original Articles |
Neural Network Learning as an Inverse Problem
ra K
rková
Institute of Computer Science, Academy of Sciences of the Czech Republic, Pod Vodárenskou v
í 2, 182 07 Prague 8, Czech Republic. E-mail: vera{at}cs.cas.cz
Capability of generalization in learning of neural networks from examples can be modelled using regularization, which has been developed as a tool for improving stability of solutions of inverse problems. Such problems are typically described by integral operators. It is shown that learning from examples can be reformulated as an inverse problem defined by an evaluation operator. This reformulation leads to an analytical description of an optimal input/output function of a network with kernel units, which can be employed to design a learning algorithm based on a numerical solution of a system of linear equations.
Key Words: learning from data, generalization, empirical error functional, inverse problem, evaluation operator, kernel methods
Received 5 January 2005.