Replies: 1 comment
-
I can't answer your question about if this is planned to be reintroduced but you can still enable the old version using the instructions in this section. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I use llama-server primarily for text completion like so (just an example prompt)
![image](https://private-user-images.githubusercontent.com/65567823/403192935-7e27924f-7e68-4023-adb0-b73a1f3ed7bd.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkyNjE3NzcsIm5iZiI6MTczOTI2MTQ3NywicGF0aCI6Ii82NTU2NzgyMy80MDMxOTI5MzUtN2UyNzkyNGYtN2U2OC00MDIzLWFkYjAtYjczYTFmM2VkN2JkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjExVDA4MTExN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM1OTg5NjkxMGE3NzNkNDY3NjA4ZjAwNGQ1OGNkNzA4ODQ4MTY4YTZjNjlhOTkxMTJjMWJhYzk5MDE2ZDgxMzkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.B4dHOIsokM7y3xJ2wNF0V5wVMKV_wInqA0UtTJzxNgw)
One thing I would often do is find a prompt and settings that work consistently, then open up Chrome devtools and grab the request from the network tab and use it in my application.
Today I downloaded the latest llama.cpp and saw a shiny new UI, but noticed it only has chatting and I couldn't find any option to go back to this old UI or do text completion in general. Is text completion no longer supported in the web UI? It was the most useful feature for me, and is vital for using models that aren't chat-tuned, and useful for understanding language models in general.
Was this removed intentionally or is it just hidden somewhere? I understand that most of the recent research and development in the field has been towards chat models and chat interfaces, but I think that text completion shouldn't be completely forgotten. I'd be interested to hear thoughts on this
Beta Was this translation helpful? Give feedback.
All reactions