We've discussed at length the learning slowdown that can occur when output neurons saturate, in networks using the quadratic cost to train. Another factor that may inhibit learning is the presence of the xjxj term in Equation (61). Because of this term, when an input xjxj is near to ...