fix the issue 3428

[chang111]

As for the request from the @lucianopaz .
I start a new pr to make the pr clean.
This pr is the copy from the previous pr 3250 with a little change that I reset the 'test_truncated_normal_lower' and the 'test_truncated_normal_upper'

[junpenglao]

Hi @chang111, I appreciate your effort to fix issues! However, since in #3250 most work has been done, it would not be fair to the origin author that you just copy his/her changes here. So unless you have a new solution, the recommend practice is:

1. make sure nobody is still working on changed default values for TruncatedNormal lower and upper from None to -np.inf… #3250;
2. if you want to finish changed default values for TruncatedNormal lower and upper from None to -np.inf… #3250, push directly to the branch in changed default values for TruncatedNormal lower and upper from None to -np.inf… #3250
3. after review and merge, both you and the origin author will be credited in the merge message. It is only fair that everybody's contributions are recognized!