Skip to content

Commit 7630b27

Browse files
committed
Extensive documentation
1 parent 60526bd commit 7630b27

8 files changed

+64
-0
lines changed

.github/FUNDING.yml

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
ko_fi: turboderp

LICENSE

+19
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
MIT License
2+
3+
Permission is hereby granted, free of charge, to any person obtaining a copy
4+
of this software and associated documentation files (the "Software"), to deal
5+
in the Software without restriction, including without limitation the rights
6+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
7+
copies of the Software, and to permit persons to whom the Software is
8+
furnished to do so, subject to the following conditions:
9+
10+
The above copyright notice and this permission notice shall be included in all
11+
copies or substantial portions of the Software.
12+
13+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
14+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
15+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
16+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
17+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
18+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
19+
SOFTWARE.

README.md

+44
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
<p align="center">
2+
3+
# ExUI
4+
5+
This is a simple, lightweight web interface for [ExLlamaV2](https://github.com/turboderp/exllamav2).
6+
7+
### Overview of features
8+
9+
- Friendly, responsive and minimalistic UI
10+
- Persistent sessions
11+
- Multiple instruct formats
12+
- Speculative decoding
13+
- Supports EXL2, GPTQ and FP16 models
14+
15+
### Screenshots
16+
17+
[![chat_screenshot](doc/screenshot1_thumb.png)](doc/screenshot1.png)
18+
[![chat_screenshot](doc/screenshot2_thumb.png)](doc/screenshot2.png)
19+
20+
### Running locally
21+
22+
First, clone this repository and install requirements:
23+
24+
```
25+
git clone https://github.com/turboderp/exui
26+
cd exui
27+
pip install -r requirements.txt
28+
```
29+
30+
Then run the web server with the included server.py:
31+
32+
```
33+
python server.py
34+
```
35+
36+
Your browser should automatically open on `localhost:5000`
37+
38+
### More to come
39+
40+
Stay tuned.
41+
42+
![avatar_unicorn.png](static%2Fgfx%2Favatar_unicorn.png)
43+
44+

doc/icon.png

-73.1 KB
Binary file not shown.

doc/screenshot1.png

275 KB
Loading

doc/screenshot1_thumb.png

31.7 KB
Loading

doc/screenshot2.png

104 KB
Loading

doc/screenshot2_thumb.png

12.8 KB
Loading

0 commit comments

Comments
 (0)