PDF] The Method of Steepest Descent for Feedforward Artificial Neural Networks

This paper implements the method of Steepest Descent in single and multilayer feedforward artificial neural networks and calculates the three new update weight equations for taking different activation function in different processing unit separately. In this paper, we implement the method of Steepest Descent in single and multilayer feedforward artificial neural networks. In all previous works, all the update weight equations for single or multilayer feedforward artificial neural networks has been calculated by choosing a single activation function for various processing unit in the network. We, at first, calculate the total error function separately for single and multilayer feedforward artificial neural networks and then calculate the three new update weight equations for taking different activation function in different processing unit separately single and multilayer feedforward artificial neural networks. An example is given to show usefulness of this implementation.

Fundamentals of Artificial Neural Networks and Deep Learning

Mathematics, Free Full-Text

Steepest descent method

Mathematics, Free Full-Text

PDF) Multilayer perceptron and neural networks

Applied Sciences, Free Full-Text

PDF) A brief review of feed-forward neural networks

The mostly complete chart of Neural Networks, explained

Fundamentals of Artificial Neural Networks and Deep Learning

Types of Optimization Algorithms used in Neural Networks and Ways

Feed forward ,back propagation,gradient descent

Feedforward neural network - Wikipedia

Data-driven emergence of convolutional structure in neural

PDF] A new scheme for training ReLU-based multi-layer feedforward