Activation Functions with Random Data (Grouped)
Sigmoid-like Functions
x
Sigmoid
tanh
Swish
GELU
ReLU Family
x
ReLU
Leaky ReLU
ELU
Softmax (2-class example)
x
Class 1
Class 2