Math Vector Library 1.1 Machine Learning Extension
Programming Reference Manual Fortran
Version 1.1 DD-00004-111

4 Activation functions

4.1 vmlsigm - Sigmoid activation
4.1.1 Parameters
4.2 vmlsigmd - Sigmoid activation (first derivative)
4.2.1 Parameters
4.3 vmllsigm - Log-Sigmoid activation
4.3.1 Parameters
4.4 vmllsigmd - Log-Sigmoid activation (first derivative)
4.4.1 Parameters
4.5 vmlrelu - ReLU activation
4.5.1 Parameters
4.6 vmlrelud - ReLU activation (first derivative)
4.6.1 Parameters
4.7 vmltanh - Tanh activation
4.7.1 Parameters
4.8 vmltanhd - Tanh activation (first derivative)
4.8.1 Parameters
4.9 vmltanhs - Tanhshrink activation
4.9.1 Parameters
4.10 vmltanhsd - Tanhshrink activation (first derivative)
4.10.1 Parameters
4.11 vmlsplu - Softplus activation
4.11.1 Parameters
4.12 vmlsplud - Softplus activation (first derivative)
4.12.1 Parameters
4.13 vmlgauss - Gaussian activation
4.13.1 Parameters
4.14 vmlgaussd - Gaussian activation (first derivative)
4.14.1 Parameters
4.15 vmlgelu - GELU activation
4.15.1 Parameters
4.16 vmlgelud - GELU activation (first derivative)
4.16.1 Parameters
4.17 vmlsilu - SiLU activation
4.17.1 Parameters
4.18 vmlsilud - SiLU activation (first derivative)
4.18.1 Parameters
4.19 vmlssgn - Softsign activation
4.19.1 Parameters
4.20 vmlssgnd - Softsign activation (first derivative)
4.20.1 Parameters
4.21 vmlmish - MISH activation
4.21.1 Parameters
4.22 vmlmishd - MISH activation (first derivative)
4.22.1 Parameters
4.23 vmlatan - Arctan activation
4.23.1 Parameters
4.24 vmlatand - Arctan activation (first derivative)
4.24.1 Parameters
4.25 vmlprelu - PReLU activation
4.25.1 Parameters
4.26 vmlprelud - PReLU activation (first derivative)
4.26.1 Parameters
4.27 vmlselu - SELU activation
4.27.1 Parameters
4.28 vmlselud - SELU activation (first derivative)
4.28.1 Parameters
4.29 vmlsmht - SMHT activation
4.29.1 Parameters
4.30 vmlsmhtd - SMHT activation (first derivative)
4.30.1 Parameters
4.31 vmlelud - ELU activation
4.31.1 Parameters
4.32 vmlelud - ELU activation (first derivative)
4.32.1 Parameters
4.33 vmlcelu - CELU activation
4.33.1 Parameters
4.34 vmlcelud - CELU activation (first derivative)
4.34.1 Parameters