Forward propagation is a process in which the network’s weights are updated according to the input, output and gradient of...