Artificial Neural Networks: Learning Items or Relations in Training Sets

Artificial Neural Networks can learn either the individual training items or the relations between them, depending on the network architecture and activation function. Linear networks tend to learn the relations and generalize, while non-linear networks tend to learn the individual training items.