Figure 3. A typical three-layer feed-forward Multi-Layer Perceptron network architecture with i, j, and o neurons in the input, hidden, and output layers respectively. f_i represents the activation function. w stands for the weights. X_i represents the input variables. Y_i stands for the output variables.