🤗 Space to Quants EXL2?

[Katehuuh]

Example:

• 🤗gguf-my-repo
• 🤗mergekit-gui

[Anthonyg5005]

Currently there's an exllama server with a bot (@BlockBlockBlock on hf), the creators of the bot are also working on a website version. I also have scripts to automate the quanting process in the terminal a bit more but I could also try connecting it to a gradio, not sure it can really be connected to a space though as exl2 quants take hours to process