Code

Feat: Output Rails Streaming#966

Code

Merged

Pouyanpi merged 22 commits intodevelopNVIDIA/NeMo-Guardrails:developfrom feat/output-rails-streaming-mvpNVIDIA/NeMo-Guardrails:feat/output-rails-streaming-mvpCopy head branch name to clipboardFeb 5, 2025

+905-24

Commits

Commits on Feb 4, 2025

• feat: add streaming support for output rails

  Show description for 5712766
  Pouyanpi

  committed
  5712766

  Copy full SHA for 5712766

• test: add unit tests for BufferStrategy in llmrails

  Show description for b546e7a
  Pouyanpi

  committed
  b546e7a

  Copy full SHA for b546e7a

• feat: add example config

  Pouyanpi

  committed
  404a2ec

  Copy full SHA for 404a2ec

• test: add self-check output streaming tests

  Show description for 5f9fad8
  Pouyanpi

  committed
  5f9fad8

  Copy full SHA for 5f9fad8

• feat: add get_action_name_from_flow_id function

  Show description for bcf429c
  Pouyanpi

  committed
  bcf429c

  Copy full SHA for bcf429c

• feat: update OutputRailsStreamingConfig with new fields

  Pouyanpi

  committed
  0b84ce7

  Copy full SHA for 0b84ce7

• refactor: refactor code and also integrate output_mapping decorator

  Show description for 88a0fde
  Pouyanpi

  committed
  88a0fde

  Copy full SHA for 88a0fde

• refactor(logging): change log level from warning to info

  Pouyanpi

  committed
  0b25a38

  Copy full SHA for 0b25a38

• feat: add context message handling and action params

  Show description for f0e66c2
  Pouyanpi

  committed
  f0e66c2

  Copy full SHA for f0e66c2

• refactor: move buffer module to rails.llm directory

  Pouyanpi

  committed
  987e09d

  Copy full SHA for 987e09d

• refactor: extract output mapping logic to separate module

  Pouyanpi

  committed
  586515f

  Copy full SHA for 586515f

• fix _get_action_details_from_flow

  Pouyanpi

  committed
  96e16fd

  Copy full SHA for 96e16fd

• test: add tests for output mapping functions

  Pouyanpi

  committed
  17a9c8f

  Copy full SHA for 17a9c8f

• feat: yield tokens instead of chunks in streaming output

  Pouyanpi

  committed
  95f5570

  Copy full SHA for 95f5570

• fix: apply review suggestions by mike

  Pouyanpi

  committed
  01805e4

  Copy full SHA for 01805e4

• refactor: update streaming config and handling

  Show description for 6374198
  Pouyanpi

  committed
  6374198

  Copy full SHA for 6374198

• feat: add state parameter to LLMRails stream method

  Pouyanpi

  committed
  edc834d

  Copy full SHA for edc834d

• fix: finalize name changes and defautl values

  Pouyanpi

  committed
  c2fb77f

  Copy full SHA for c2fb77f

Commits on Feb 5, 2025

• fix supported prefixes

  Show description for 06ffbc2
  Pouyanpi

  committed
  06ffbc2

  Copy full SHA for 06ffbc2

• fix: remove debug print stmts

  Pouyanpi

  committed
  4346671

  Copy full SHA for 4346671

• feat: handle ABORT SSE in streaming output

  Pouyanpi

  committed
  9a8ae0d

  Copy full SHA for 9a8ae0d

• chore: delete abc_streaming config

  Pouyanpi

  committed
  56a3560

  Copy full SHA for 56a3560