Code

Support constrained decoding#1038

Code

Open

Taka152 wants to merge 86 commits intomainmicrosoft/onnxruntime-genai:mainfrom yingxiong/constrained_decodingmicrosoft/onnxruntime-genai:yingxiong/constrained_decodingCopy head branch name to clipboard

Commits

Commits on Oct 31, 2024

• add llguidance based logits processor

  Taka152

  committed
  bf38535

  Copy full SHA for bf38535

• add unit test

  Taka152

  committed
  c151d52

  Copy full SHA for c151d52

Commits on Nov 1, 2024

• constrained decoding fixes (#1023)

  Show description for 9d5a8a0
  mmoskal

  authored
  9d5a8a0

  Copy full SHA for 9d5a8a0

• add test grammars

  Taka152

  committed
  48c3e96

  Copy full SHA for 48c3e96

• support cuda

  Taka152

  committed
  d70b849

  Copy full SHA for d70b849

Commits on Nov 4, 2024

• use tokenize.json to generate token_bytes

  Taka152

  committed
  6b90c1c

  Copy full SHA for 6b90c1c

Commits on Nov 5, 2024

• fix win build

  Taka152

  committed
  bdb9ca4

  Copy full SHA for bdb9ca4

Commits on Nov 6, 2024

• async compute mask

  Taka152

  committed
  a25de8e

  Copy full SHA for a25de8e

• add llguidance build in cmake

  Taka152

  committed
  edc0bae

  Copy full SHA for edc0bae

• update windows build

  Taka152

  committed
  09861d7

  Copy full SHA for 09861d7

• clean cmake

  Taka152

  committed
  ee94df8

  Copy full SHA for ee94df8

• add install rust to GHA

  Taka152

  committed
  4d077cf

  Copy full SHA for 4d077cf

• test action

  Taka152

  committed
  15b20b8

  Copy full SHA for 15b20b8

• test win cpu build action

  Taka152

  committed
  6029510

  Copy full SHA for 6029510

• update win build action

  Taka152

  committed
  4d8d8a6

  Copy full SHA for 4d8d8a6

• update win build action

  Taka152

  committed
  346f88c

  Copy full SHA for 346f88c

• update win build action

  Taka152

  committed
  c00d8fa

  Copy full SHA for c00d8fa

• update win build action

  Taka152

  committed
  39fb7ed

  Copy full SHA for 39fb7ed

• update win build action

  Taka152

  committed
  8038723

  Copy full SHA for 8038723

• update win build action

  Taka152

  committed
  324f550

  Copy full SHA for 324f550

• update win build action

  Taka152

  committed
  8722727

  Copy full SHA for 8722727

Commits on Nov 7, 2024

• add rust install to workflows

  Taka152

  committed
  d620422

  Copy full SHA for d620422

• support batch infer

  Taka152

  committed
  c1ede01

  Copy full SHA for c1ede01

Commits on Nov 8, 2024

• add corrosion to deps.txt

  Taka152

  committed
  d2f47e2

  Copy full SHA for d2f47e2

• Merge branch 'main' into yingxiong/constrained_decoding

  Taka152

  committed
  8deba60

  Copy full SHA for 8deba60

• fix merge

  Taka152

  committed
  b256e6d

  Copy full SHA for b256e6d

• fix bugs

  Taka152

  committed
  e5d6dad

  Copy full SHA for e5d6dad

• update linux gpu workflow

  Taka152

  committed
  2fd52d2

  Copy full SHA for 2fd52d2

• update linux gpu workfow

  Taka152

  committed
  a11684b

  Copy full SHA for a11684b

• update linux gpu workflow

  Taka152

  committed
  56663c0

  Copy full SHA for 56663c0

• update workflow

  Taka152

  committed
  8997064

  Copy full SHA for 8997064

• update workflow

  Taka152

  committed
  ddda727

  Copy full SHA for ddda727

• update workflows

  Taka152

  committed
  cb55778

  Copy full SHA for cb55778

Commits on Nov 15, 2024

• add shared lib of llguidance

  Taka152

  committed
  4cf5b5f

  Copy full SHA for 4cf5b5f

• add disable_guidance option

  Taka152

  committed
  18c2f6c

  Copy full SHA for 18c2f6c

• fix format

  Taka152

  committed
  65340f2

  Copy full SHA for 65340f2

• fix win error

  Taka152

  committed
  eca06f5

  Copy full SHA for eca06f5

Commits on Nov 18, 2024

• fix segfault

  Taka152

  committed
  b306428

  Copy full SHA for b306428

• fix segfault and move test

  Taka152

  committed
  df34b1e

  Copy full SHA for df34b1e

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  2a5efe1

  Copy full SHA for 2a5efe1

• minor fixes

  Taka152

  committed
  92251d4

  Copy full SHA for 92251d4

Commits on Nov 20, 2024

• fix bug when is_stop

  Taka152

  committed
  56ab9ee

  Copy full SHA for 56ab9ee

• fixes for reviews

  Taka152

  committed
  03a6bb7

  Copy full SHA for 03a6bb7

• fix

  Taka152

  committed
  29fc868

  Copy full SHA for 29fc868

• fix win error

  Taka152

  committed
  3b046c3

  Copy full SHA for 3b046c3

• add rust env to dockerfile

  Taka152

  committed
  e9c818e

  Copy full SHA for e9c818e

• fix dockerfile env

  Taka152

  committed
  e06fb0a

  Copy full SHA for e06fb0a

• update workflows

  Taka152

  committed
  ef141f2

  Copy full SHA for ef141f2

• Update Rust environment in Dockerfiles

  Taka152

  committed
  13056b6

  Copy full SHA for 13056b6

• Update Rust environment permissions in Dockerfiles

  Taka152

  committed
  22c7c37

  Copy full SHA for 22c7c37

• Update Rust installation in Dockerfiles

  Taka152

  committed
  a1186a5

  Copy full SHA for a1186a5

• revert linux arm workflow

  Taka152

  committed
  2c9b02c

  Copy full SHA for 2c9b02c

Commits on Nov 22, 2024

• Update Rust installation with specific version

  Taka152

  committed
  899edf9

  Copy full SHA for 899edf9

• fix android error

  Taka152

  committed
  2d47c20

  Copy full SHA for 2d47c20

Commits on Nov 25, 2024

• fix for review

  Taka152

  committed
  9a15385

  Copy full SHA for 9a15385

Commits on Nov 27, 2024

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  ec09868

  Copy full SHA for ec09868

Commits on Dec 6, 2024

• fix SetGuidance unit test

  Taka152

  committed
  ff94fe1

  Copy full SHA for ff94fe1

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  88f8ef4

  Copy full SHA for 88f8ef4

• fix format

  Taka152

  committed
  4ca4075

  Copy full SHA for 4ca4075

Commits on Dec 11, 2024

• fix to new continuous decoding api

  Taka152

  committed
  9849f65

  Copy full SHA for 9849f65

Commits on Dec 12, 2024

• remove comments

  Taka152

  committed
  13e5100

  Copy full SHA for 13e5100

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  aea5323

  Copy full SHA for aea5323

• fix

  Taka152

  committed
  9b5a6ce

  Copy full SHA for 9b5a6ce

• fix segfault

  Taka152

  committed
  a9390e3

  Copy full SHA for a9390e3

Commits on Dec 13, 2024

• fix win build

  Taka152

  committed
  fc4b7e9

  Copy full SHA for fc4b7e9

• fix win error

  Taka152

  committed
  a0710d5

  Copy full SHA for a0710d5

Commits on Dec 16, 2024

• fix win error

  Taka152

  committed
  7d4d6bb

  Copy full SHA for 7d4d6bb

• add comments

  Taka152

  committed
  5d175a7

  Copy full SHA for 5d175a7

• fix format

  Taka152

  committed
  52ccc8b

  Copy full SHA for 52ccc8b

Commits on Dec 17, 2024

• fix bug

  Taka152

  committed
  161fcfc

  Copy full SHA for 161fcfc

• Merge branch 'main' into yingxiong/constrained_decoding

  Taka152

  committed
  ca6d86c

  Copy full SHA for ca6d86c

• suuport build in ios GHA

  Taka152

  committed
  8e03735

  Copy full SHA for 8e03735

• update win azure ci

  Taka152

  committed
  db3062b

  Copy full SHA for db3062b

• update linux ci

  Taka152

  committed
  0cdb4ac

  Copy full SHA for 0cdb4ac

• fix win ci

  Taka152

  committed
  991a012

  Copy full SHA for 991a012

• fix win ci

  Taka152

  committed
  4fdbea6

  Copy full SHA for 4fdbea6

• fix macos arm

  Taka152

  committed
  e99ae65

  Copy full SHA for e99ae65

• fix macos azure ci

  Taka152

  committed
  ed96504

  Copy full SHA for ed96504

Commits on Dec 18, 2024

• fix for review

  Taka152

  committed
  4cb9e55

  Copy full SHA for 4cb9e55

• fix

  Taka152

  committed
  e75166a

  Copy full SHA for e75166a

• fix ios ci

  Taka152

  committed
  82d33e5

  Copy full SHA for 82d33e5

• disable on ios ci

  Taka152

  committed
  3498e0e

  Copy full SHA for 3498e0e

Commits on Dec 19, 2024

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  2dbc6ee

  Copy full SHA for 2dbc6ee

• disable by default

  Taka152

  committed
  ce846c9

  Copy full SHA for ce846c9

• remove azure ci code

  Taka152

  committed
  c644b26

  Copy full SHA for c644b26

• build and test with use_guidance

  Taka152

  committed
  422af28

  Copy full SHA for 422af28