Code

[WIP] Support target features#2227

Code

Closed

anderleich wants to merge 62 commits intoOpenNMT:v3.0OpenNMT/OpenNMT-py:v3.0from anderleich:support_target_featuresanderleich/OpenNMT-py:support_target_featuresCopy head branch name to clipboard

+1,956-8,574

Commits

Commits on Oct 24, 2022

• Added target features support to build_vocab

  anderleich

  committed
  ff6a605

  Copy full SHA for ff6a605

• Merge branch 'v3.0' into support_target_features

  anderleich

  committed
  0e5cc73

  Copy full SHA for 0e5cc73

Commits on Oct 26, 2022

• make prefetch_factor configurable in DataLoader

  l-k-11235

  committed
  e42c209

  Copy full SHA for e42c209

Commits on Nov 3, 2022

• bucket size ramp up

  l-k-11235

  committed
  ddf5ddf

  Copy full SHA for ddf5ddf

• Merge pull request OpenNMT#2239 from vince62s/v3.0

  Show description for 24c0c4f
  vince62s

  authored
  24c0c4f

  Copy full SHA for 24c0c4f

• bucket size ramp up is configurable

  l-k-11235

  committed
  69e09db

  Copy full SHA for 69e09db

• more docs update

  vince62s

  committed
  3f86f7d

  Copy full SHA for 3f86f7d

• changelog

  vince62s

  committed
  2dda423

  Copy full SHA for 2dda423

• readme

  vince62s

  committed
  f4cbb03

  Copy full SHA for f4cbb03

• Merge pull request OpenNMT#2240 from vince62s/docs

  Show description for ffac0bc
  vince62s

  authored
  ffac0bc

  Copy full SHA for ffac0bc

Commits on Nov 4, 2022

• fixed flake error

  l-k-11235

  committed
  9b79dfb

  Copy full SHA for 9b79dfb

• fixed unit test error

  l-k-11235

  committed
  a981b43

  Copy full SHA for a981b43

• Better docs

  vince62s

  committed
  06232c0

  Copy full SHA for 06232c0

• typo

  vince62s

  committed
  7f8d26a

  Copy full SHA for 7f8d26a

• forgot to add moved modules

  vince62s

  committed
  4584bfe

  Copy full SHA for 4584bfe

Commits on Nov 6, 2022

• onmt_server works with ctranslate2

  Ehsan-Jahanbakhsh

  committed
  51b99f0

  Copy full SHA for 51b99f0

Commits on Nov 7, 2022

• Fixed Indet.

  Ehsan-Jahanbakhsh

  committed
  21338bf

  Copy full SHA for 21338bf

• Merge pull request OpenNMT#2245 from Ehsan-Jahanbakhsh/ctranslate2server

  Show description for 8132c8a
  vince62s

  authored
  8132c8a

  Copy full SHA for 8132c8a

• Add CTranslate2 in requirements

  guillaumekln

  committed
  793cba1

  Copy full SHA for 793cba1

• Merge pull request OpenNMT#2247 from guillaumekln/add-ct2-requirement

  Show description for 0937d36
  vince62s

  authored
  0937d36

  Copy full SHA for 0937d36

Commits on Nov 8, 2022

• add comment for LM upgrade

  vince62s

  committed
  bcded17

  Copy full SHA for bcded17

• Merge pull request OpenNMT#2241 from vince62s/betterdoc

  Show description for d30366e
  vince62s

  authored
  d30366e

  Copy full SHA for d30366e

Commits on Nov 10, 2022

• Merge branch 'master' into facilitate-dataloading-optimization

  l-k-11235

  authored
  f8e69a2

  Copy full SHA for f8e69a2

Commits on Nov 11, 2022

• fix LM_scoring with v3

  vince62s

  committed
  168f8df

  Copy full SHA for 168f8df

• Merge pull request OpenNMT#2248 from vince62s/fixlmscoring

  Show description for 13ad153
  vince62s

  authored
  13ad153

  Copy full SHA for 13ad153

Commits on Nov 15, 2022

• LMprior with CT2 to infer LM model

  vince62s

  committed
  33b9110

  Copy full SHA for 33b9110

• simpler fix for special tokens order

  vince62s

  committed
  2c756f8

  Copy full SHA for 2c756f8

• back to list for consistent order

  vince62s

  committed
  27c51fb

  Copy full SHA for 27c51fb

• moved comments in the docstring of build_dynamic_dataset_iter

  l-k-11235

  committed
  77e7ae7

  Copy full SHA for 77e7ae7

• Merge pull request OpenNMT#2246 from l-k-11235/facilitate-dataloading-optimization

  Show description for 7de309a
  vince62s

  authored
  7de309a

  Copy full SHA for 7de309a

Commits on Nov 17, 2022

• better stats

  vince62s

  committed
  0df961f

  Copy full SHA for 0df961f

Commits on Nov 18, 2022

• add onmt LM

  vince62s

  committed
  c02029a

  Copy full SHA for c02029a

Commits on Nov 22, 2022

• LMprior working fine

  vince62s

  committed
  8204f5e

  Copy full SHA for 8204f5e

• Merge pull request OpenNMT#2252 from vince62s/lmpriorv3

  Show description for 9be00db
  vince62s

  authored
  9be00db

  Copy full SHA for 9be00db

• Fix dynamic scoring (OpenNMT#2253)

  Show description for 5686adc
  l-k-11235

  authored
  5686adc

  Copy full SHA for 5686adc

Commits on Nov 23, 2022

• reinstate apex.amp (O1 O2) (OpenNMT#2220) (OpenNMT#2256)

  vince62s

  authored
  0373bd2

  Copy full SHA for 0373bd2

• v3.0.1 (OpenNMT#2257)

  Show description for 3c4f6bc
  vince62s

  authored
  3c4f6bc

  Copy full SHA for 3c4f6bc

Commits on Dec 1, 2022

• Update Translation.md

  vince62s

  authored
  d61f22c

  Copy full SHA for d61f22c

Commits on Dec 2, 2022

• Fix tensorboard logging (OpenNMT#2260)

  Show description for 2eaeed3
  l-k-11235

  authored
  2eaeed3

  Copy full SHA for 2eaeed3

• Fix validation scoring (OpenNMT#2263)

  Show description for dd28db1
  l-k-11235

  authored
  dd28db1

  Copy full SHA for dd28db1

Commits on Dec 3, 2022

• fixes (OpenNMT#2265)

  Show description for 08d2b99
  vince62s

  authored
  08d2b99

  Copy full SHA for 08d2b99

Commits on Dec 6, 2022

• revisit tgt_prefix (OpenNMT#2267)

  Show description for cadd99c
  vince62s

  authored
  cadd99c

  Copy full SHA for cadd99c

Commits on Dec 7, 2022

• Optimize validation scoring (OpenNMT#2266)

  Show description for 70799ae
  l-k-11235

  authored
  70799ae

  Copy full SHA for 70799ae

• Bucket processing (OpenNMT#2261)

  Show description for 874e18a
  l-k-11235

  authored
  874e18a

  Copy full SHA for 874e18a

• pickable Vocab / v3.0.2 (OpenNMT#2268)

  Show description for 9698acd
  vince62s

  authored
  9698acd

  Copy full SHA for 9698acd

Commits on Dec 9, 2022

• Use native CrossEntropyLoss including label_smoothing + more optimisations (OpenNMT#2270)

  Show description for 9d617b8
  vince62s

  authored
  9d617b8

  Copy full SHA for 9d617b8

Commits on Dec 15, 2022

• fixed coverage attention and translator for attn_debug (OpenNMT#2272)

  sanghyuk-choi

  authored
  b430e24

  Copy full SHA for b430e24

• Fix detok in scoring utils (OpenNMT#2271)

  Show description for 7ccfd23
  l-k-11235

  authored
  7ccfd23

  Copy full SHA for 7ccfd23

Commits on Dec 16, 2022

• fix no tgt at inference (OpenNMT#2273)

  vince62s

  authored
  ff9effd

  Copy full SHA for ff9effd

• keep Label Smoothing for Validation (same as Train) (OpenNMT#2274)

  Show description for 386e9be
  vince62s

  authored
  386e9be

  Copy full SHA for 386e9be

• revert approx normalization to accurate per item (OpenNMT#2275)

  vince62s

  authored
  3b7c92b

  Copy full SHA for 3b7c92b

Commits on Dec 19, 2022

• Bump 3.0.3 (OpenNMT#2277)

  Show description for 5f32750
  vince62s

  authored
  5f32750

  Copy full SHA for 5f32750

Commits on Dec 20, 2022

• Wmt17 example (OpenNMT#2278)

  Show description for 0ed5dac
  vince62s

  authored
  0ed5dac

  Copy full SHA for 0ed5dac

• better batching (OpenNMT#2279)

  Show description for 6c70fc4
  vince62s

  authored
  6c70fc4

  Copy full SHA for 6c70fc4

Commits on Dec 23, 2022

• fixes (OpenNMT#2281)

  vince62s

  authored
  f9c7ac8

  Copy full SHA for f9c7ac8

Commits on Dec 31, 2022

• fix LM scoring (OpenNMT#2284)

  Show description for 3ea1b66
  vince62s

  authored
  3ea1b66

  Copy full SHA for 3ea1b66

Commits on Jan 3, 2023

• emb dropout in all cases (OpenNMT#2285)

  vince62s

  authored
  f64ac05

  Copy full SHA for f64ac05

Commits on Jan 5, 2023

• fix bad mistake in lm prior (OpenNMT#2286)

  vince62s

  authored
  edf4140

  Copy full SHA for edf4140

Commits on Jan 6, 2023

• Merge remote-tracking branch 'upstream/master' into support_target_features

  anderleich

  committed
  156f646

  Copy full SHA for 156f646

• Update comment

  anderleich

  committed
  8b5600f

  Copy full SHA for 8b5600f

Commits on Jan 7, 2023

• Add target features support to training part

  anderleich

  committed
  a8e6fe6

  Copy full SHA for a8e6fe6

• Merge branch 'v3.0' into support_target_features

  anderleich

  authored
  471e12c

  Copy full SHA for 471e12c