[Feature]: Auto-Mode for Guardrails

[hxtomer]

The Feature

It would be great if users can set the "mode" of a certain guardrail to "auto" instead of defining it multiple time for each mode.
Taking this configuration as an example:

guardrails:
  - guardrail_name: aim-pre
    litellm_params:
      guardrail: aim
      mode: pre_call
      api_key: os.environ/AIM_API_KEY
  - guardrail_name: aim-during
    litellm_params:
      guardrail: aim
      mode: during_call
      api_key: os.environ/AIM_API_KEY
  - guardrail_name: aim-post
    litellm_params:
      guardrail: aim
      mode: post_call
      api_key: os.environ/AIM_API_KEY

Would be replaced with

  - guardrail_name: aim
    litellm_params:
      guardrail: aim
      mode: auto
      api_key: os.environ/AIM_API_KEY

Motivation, pitch

Aim Security's guardrails can be configured in the Aim Admin Dashboard, allowing security teams to quickly adjust guardrails based on changing company policies and new guardrails abilities. When integrated to LiteLLM, users need to hardly define the guardrail mode at their first use and future policy changes will require LiteLLM configuration adjustment. An "auto" model will allow MLOps teams to pass the responsibility for choosing a phase to run in, to the guardrail itself to happen dynamically.

Are you a ML Ops Team?

No

Twitter / LinkedIn details

https://www.linkedin.com/company/aimsecurity

[krrishdholakia]

Hi @hxtomer

we support mode as a List[str]

this should already solve the multiple guardrail creation problem -

guardrails:
  - guardrail_name: aim-pre
    litellm_params:
      guardrail: aim
      mode: ["pre_call", "during_call", "post_call"] 
      api_key: os.environ/AIM_API_KEY

Does that solve your problem? @hxtomer

[hxtomer]

@krrishdholakia thanks! I haven't knew that's an option :) we'll give it a try 🙂

[krrishdholakia]

Hey @hxtomer where in docs would you have expected to see this?

[hxtomer]

Maybe it would fit in https://docs.litellm.ai/docs/proxy/guardrails/quick_start#supported-values-for-mode-event-hooks
What do you think?