[TensorV2] Create a mask of dropout, filter, and zoneout @open sesame 02/26 12:23 #2477
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
djeong20
requested review from
myungjoo,
jijoongmoon,
again4you,
jaeyun-jung,
leemgs,
wooksong,
helloahn,
kparichay,
gichan-jang,
anyj0527,
zhoonit,
lhs8928,
songgot,
jihochu,
DonghakPark,
SeoHyungjun,
baek2sm,
skykongkong8,
EunjuYang and
a team
as code owners
|
📝 TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2477. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/. |
djeong20
force-pushed
the
feat/tensor_v2/mask
branch
from
3590a8f to
6550634
Compare
djeong20
added
PR/OK2GO
This PR adds new functionalities for getting masks of the following techniques: dropout, filter, and zoneout. These functions enable working with masks, making it easier to perform such techniques in regularization. **Changes proposed in this PR:** - Added dropout_mask(), which calculates the dropout mask by multiplying tensor elements by 1.0 / (1.0 - dropout rate), in place. - Added filter_mask(), which takes an input tensor and applies a filter mask based on the given mask length and invert option. - Added zoneout_mask(), which generates two zoneout masks, one for in-place operation and another for opposite operation, based on the specified zoneout rate. **Self-evaluation:** 1. Build test: [X]Passed [ ]Failed [ ]Skipped 2. Run test: [X]Passed [ ]Failed [ ]Skipped Signed-off-by: Donghyeon Jeong <[email protected]>
djeong20
force-pushed
the
feat/tensor_v2/mask
branch
from
6550634 to
9db2efe
Compare
djeong20
changed the title
djeong20
changed the title
djeong20
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds new functionalities for getting masks of the following techniques: dropout, filter, and zoneout. These functions enable working with masks, making it easier to perform such techniques in regularization.
Changes proposed in this PR:
dropout_mask(), which calculates the dropout mask by multiplying tensor elements by 1.0 / (1.0 - dropout rate), in place.filter_mask(), which takes an input tensor and applies a filter mask based on the given mask length and invert option.zoneout_mask(), which generates two zoneout masks, one for in-place operation and another for opposite operation, based on the specified zoneout rate.Self-evaluation: