Skip to content

Fix missed gateway migration / add LocalAI env values / add test cert (#39) #42

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

mattfsourcecode
Copy link
Owner

@mattfsourcecode mattfsourcecode commented Feb 12, 2025

Migration from Ingress to Gateway API and TLS Configuration Updates

Overview

This PR finalizes the migration from Kubernetes Ingress to the Gateway API for the LocalAI deployment, a process originally intended to be completed in #2. It also introduces improvements to TLS testing capabilities and updates environment variables for the LocalAI depoyment.

Although concerns have previously been addressed in individual PRs, a DEVELOPMENT PAUSE has been declared in the README, with this PR focusing on resolving several outstanding issues that were in-progress when the pause went into effect. With this merge, #48 now blocks all future pull requests.

Key Changes

Completion of Gateway API Migration

  • Removes legacy Ingress configuration from localai-values.yaml
  • Implements Gateway API support in localai-values.yaml for enhanced traffic management
  • Updates configuration to align with Gateway API best practices

LocalAI Environment Variables

  • CONTEXT_SIZE=0: Disables token context limitations
  • THREADS=4: Configures the number of CPU threads for model processing

TLS Configuration

  • Adds test-certificate.yaml for TLS configuration testing

Testing

  • Verified Gateway API functionality
  • Tested TLS certificate generation
  • Confirmed service connectivity
  • Validated model persistence

Closes #39

@mattfsourcecode mattfsourcecode force-pushed the fix-missed-gateway-migration-and-update-certs-in-values-files branch from 2a98052 to 5585e25 Compare February 13, 2025 00:30
@mattfsourcecode mattfsourcecode force-pushed the fix-missed-gateway-migration-and-update-certs-in-values-files branch 2 times, most recently from 0039b28 to a5d6921 Compare February 13, 2025 01:03
@mattfsourcecode mattfsourcecode changed the title WIP: Fix missed gateway migration and update certs in values files (#39) WIP: Fix missed gateway migration and cert config (#39) Feb 13, 2025
@mattfsourcecode mattfsourcecode force-pushed the fix-missed-gateway-migration-and-update-certs-in-values-files branch 3 times, most recently from 0add13c to 6797e25 Compare February 13, 2025 03:02
@mattfsourcecode mattfsourcecode changed the title WIP: Fix missed gateway migration and cert config (#39) WIP: Fix missed gateway migration / add LocalAI env values / add test cert (#39) Feb 13, 2025
@mattfsourcecode mattfsourcecode force-pushed the fix-missed-gateway-migration-and-update-certs-in-values-files branch from 6797e25 to 16cb59b Compare February 13, 2025 04:34
@mattfsourcecode mattfsourcecode changed the title WIP: Fix missed gateway migration / add LocalAI env values / add test cert (#39) Fix missed gateway migration / add LocalAI env values / add test cert (#39) Feb 13, 2025
@mattfsourcecode mattfsourcecode marked this pull request as ready for review February 13, 2025 04:34
@mattfsourcecode mattfsourcecode merged commit ae52a10 into master Feb 13, 2025
1 check passed
@mattfsourcecode mattfsourcecode deleted the fix-missed-gateway-migration-and-update-certs-in-values-files branch February 13, 2025 04:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix missed gateway migration / add LocalAI env values / add test cert
1 participant