Feature request: Integration with Oobabooga

[aliasfoxkde]

I think it would be awesome to be able to use this UI in conjunction with local models, not just ChatGPT. The best one that I'm aware of right now is oobabooga/text-generation-webui , which can be used to download and mange AI models (even highly optimized ones like llama.cpp or vicuna 4-bit quantized) on your local machine. I created a feature request through the "text-generation-webui" to implement an API Key feature which would allow it to be extended to more use cases, but even if that feature gets added it doesn't guarantee compatibility. So for that reason, I'm making a similar but very different feature request here.

I searched for similar requests and didn't find anything and if it's a stupid idea, please let me know.

Thank you!