🚀 Feature Implement truncated normal distribution. Motivation A truncated normal distribution is useful as initializer of weights or when sampling from ReLU potentials. This has been requested before (#2129, https://discuss.pytorch.org/t...
Truncated Normal distribution in PyTorch. The module provides: TruncatedStandardNormalclass - zero mean unit variance of the parent Normal distribution, parameterized by the cut-off range[a, b](similar toscipy.stats.truncnorm); TruncatedNormalclass - a wrapper with extralocandscaleparameters of the ...
Simplified code for truncated normal 4e53818 Merge branch 'master' ofhttps://github.com/pytorch/pytorchinto trun… a9c3962 ezyangrequested a review fromalicanbFebruary 3, 2020 15:51 ezyangadded thetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriat...