Transfer function

Function

Range

Graph

Identity

f = x

[−∞, +∞]

Symmetrical Hard Limit

f = s i g n o ( x )

[−1, +1]

log Sigmoid

f = 1 1 + e x

[0, +1]

Hyperbolic Tangent Sigmoid

f = e x e x e x + e x

[−1, +1]