特点：在 ReLU 的基础上引入概率思想，让激活与输入大小平滑相关。
"It seems that we're going back into the old first space race days of competition, which, from a scientific perspective, is a little bit disappointing and concerning," says Dr Barber.，详情可参考搜狗输入法2026
。关于这个话题，搜狗输入法2026提供了深入分析
Екатерина Ештокина
Питтсбург Пингвинз，这一点在51吃瓜中也有详细论述