Code

[WIP] Pseudo self attention#2060

Code

Draft

funboarder13920 wants to merge 5 commits intoOpenNMT:masterOpenNMT/OpenNMT-py:masterfrom funboarder13920:pseudo_self_attentionfunboarder13920/OpenNMT-py:pseudo_self_attentionCopy head branch name to clipboard

+895-66

Commits

Commits on May 3, 2021

• [WIP] pseudo self attention for LM + load LM with PSA

  

  Valentin Berkes

  committed
  e1bde16

  Copy full SHA for e1bde16

Commits on May 4, 2021

• implement tests

  

  Valentin Berkes

  committed
  96cc29b

  Copy full SHA for 96cc29b

• fix pseudo self attention

  

  Valentin Berkes

  committed
  e057130

  Copy full SHA for e057130

Commits on May 10, 2021

• fix PSA + write tests

  

  Valentin Berkes

  committed
  318ed17

  Copy full SHA for 318ed17

• fix lm cache decoding that can receive long input requiring masking at step 0

  

  Valentin Berkes

  committed
  628b472

  Copy full SHA for 628b472