[23] introduced the forget gate mechanism in LSTM to avoid the network crash problem caused by not resetting the internal state of the network. In 2000, they further added the Peephone to the LSTM internal state unit to enhance the network’s ability to distinguish subtle features in the ...