feat(ai): introduce vercel ai sdk support

[gladyshcodes]

Issue #291

What

Integrate Vercel AI SDK

Why

Simplify the introduction of new providers and models in the future, specifically, Amazon Bedrock (#310) and OpenAI when available

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
shortest	⬜️ Ignored (Inspect)	Visit Preview		Feb 13, 2025 10:30pm

[CLAassistant]

All committers have signed the CLA.

[gladyshcodes]

In progress:

1. Nits
2. Testing
3. Feedback iterations

[rmarescu]

Added some initial comments.

[gladyshcodes]

@rmarescu Feedback addressed

[rmarescu]

Submitting a partial review. High-level thoughts:

• No need to map Vercel's models with a local list, it complicates the implementation without too much gain
• Use AI instead of LLM (don't need 2 names that represent almost the same thing within the codebase)
• Config schema seems complicated. Can be simplified?

[rmarescu]

I think even this one can be optional. Ideally, there should be zero config to run Shortest.

No ai prop provided should default to the provider we think is the best, e.g. anthropic, which tries to read the apiKey from ENV (as Vercel AI SDK supports it by default).

[gladyshcodes]

I personally don't see a strong case for simplifying the configuration. Keeping all settings in a single file actually reduces the cognitive load, as it makes it clear where each value comes from and how the final configuration is assembled

Ideally, there should be zero config to run Shortest

Achieving that is unlikely—especially as users increasingly demand more flexibility and control over Shortest (see, for example, issue #313)

What is possible, though, is keeping all non-sensitive data in config and sensitive data (e.g keys) in the env, not to duplicate them in the config

[vercel]

You must have Developer access to commit code to Antiwork on Vercel. If you contact an administrator and receive Developer access, commit again to see your changes.

Learn more: https://vercel.com/docs/accounts/team-members-and-roles/access-roles#team-level-roles

[rmarescu]

Remaining work (will update as needed):

• Simplify config
• Add more logging as needed
• Verify token usage calculation
• Test coverage
• Update shortest.config.ts.example
• Add support for SHORTEST_ANTHROPIC_API_KEY
• Verify functionality/code against the old class