I thought both, PReLU and Leaky ReLU are f(x)=max(x,αx) with ... Leaky ReLUs allow a small, non-zero gradient when the unit is not active.
確定! 回上一頁