Smart model selection #2305
DavidSaylor
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I would love to see additional features around selecting models. Let me see the models already installed and view their Models pages easily. Notify me when an installed model has been updated and allow me to configure auto-update, prompt to update, or never update for each model and set the default.
Start with a full list from Huggingface (or all configured supported repositories). Let me filter by commercial-friendly, size < my dedicated VRAM, size < my total VRAM, size < my total RAM, filter by thresholds for reported performance metrics, etc.. Indicate whether each model is known to be compatible, partially compatible (functions but not optimally), probably compatible, probably not compatible or known to be incompatible.
I would love it if models were more self-aware and could answer straightforward questions about themselves. In the mean time, maybe set a context prompt with information from the Model page and maybe the performance results (if available) to enable a similar behavior.
Beta Was this translation helpful? Give feedback.
All reactions