Linear; ELU; ReLU; LeakyReLU; Sigmoid; Tanh; Softmax ... Instead of being 0 when z<0, a leaky ReLU allows a small, non-zero, constant gradient α (Normally, ...
確定! 回上一頁