Fix missed gateway migration / add LocalAI env values / add test cert (#39) #42
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Migration from Ingress to Gateway API and TLS Configuration Updates
Overview
This PR finalizes the migration from Kubernetes Ingress to the Gateway API for the LocalAI deployment, a process originally intended to be completed in #2. It also introduces improvements to TLS testing capabilities and updates environment variables for the LocalAI depoyment.
Although concerns have previously been addressed in individual PRs, a DEVELOPMENT PAUSE has been declared in the README, with this PR focusing on resolving several outstanding issues that were in-progress when the pause went into effect. With this merge, #48 now blocks all future pull requests.
Key Changes
Completion of Gateway API Migration
localai-values.yaml
localai-values.yaml
for enhanced traffic managementLocalAI Environment Variables
CONTEXT_SIZE=0
: Disables token context limitationsTHREADS=4
: Configures the number of CPU threads for model processingTLS Configuration
test-certificate.yaml
for TLS configuration testingTesting
Closes #39