From c9b00fc47936f7a2dfe7697dc39221874ef2b339 Mon Sep 17 00:00:00 2001 From: Amit Chaudhary Date: Thu, 11 Jul 2019 16:44:46 +0545 Subject: [PATCH] Fix duplicated 'how much' in softmax explanation --- _posts/2018-06-27-illustrated-transformer.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2018-06-27-illustrated-transformer.md b/_posts/2018-06-27-illustrated-transformer.md index d4c36b43bfdc5..46603336e31d9 100644 --- a/_posts/2018-06-27-illustrated-transformer.md +++ b/_posts/2018-06-27-illustrated-transformer.md @@ -181,7 +181,7 @@ The **third and forth steps** are to divide the scores by 8 (the square root of -This softmax score determines how much how much each word will be expressed at this position. Clearly the word at this position will have the highest softmax score, but sometimes it's useful to attend to another word that is relevant to the current word. +This softmax score determines how much each word will be expressed at this position. Clearly the word at this position will have the highest softmax score, but sometimes it's useful to attend to another word that is relevant to the current word.