Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow response to first prompt or after a while of inactivity #17

Open
sebovzeoueb opened this issue Mar 14, 2024 · 0 comments
Open

Slow response to first prompt or after a while of inactivity #17

sebovzeoueb opened this issue Mar 14, 2024 · 0 comments
Labels
help wanted Extra attention is needed under review We're investigating this!

Comments

@sebovzeoueb
Copy link
Collaborator

I'm posting this here because I'm not sure if other people are experiencing this.

On first launch or after a period of inactivity (maybe around 10 minutes) when using the prompter the document retrieval is fast as usual, but formulating the chat response takes up to 10 minutes (so the ollama part, not the milvus part). Once it's "warmed up" the subsequent responses are very fast.

Please react with 👍 if you're experiencing this issue and 👎 if response times are fine for you. I want to gauge if this is an issue purely on my end or if it's common.

@sebovzeoueb sebovzeoueb added help wanted Extra attention is needed under review We're investigating this! labels Mar 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed under review We're investigating this!
Projects
None yet
Development

No branches or pull requests

1 participant