Download original image
Surrogate gradient functions which limai→0+hi(u) = dg(u)/du where g(u) is an activation function [42].