Using Leaky ReLU makes sense, but empirically it has shown, at best, to have a slight advantage over ReLU. Most of the time, ReLU performs at the same level or even better than its alternative. Why is this the case? 使用泄漏的ReLU是有意义的,但从经验上看,它最多显示出比ReLU略有优势。