激活函数总结

sigmoid

tanh

ReLu

Leaky ReLu

PReLU

ReLU6

SeLU

Swish

  https://www.cnblogs.com/makefile/p/activation-function.html

hard Swish

Mish