This repository was archived by the owner on Feb 6, 2025. It is now read-only.
File tree Expand file tree Collapse file tree 3 files changed +16
-1
lines changed Expand file tree Collapse file tree 3 files changed +16
-1
lines changed Original file line number Diff line number Diff line change 2
2
为llama.cpp编写的UI操作界面,在win上可以快速体验llama.cpp的功能
3
3
4
4
## 更新
5
+ + 20230523: 更新llama.cpp到最新版本,修复了一些bug,新增搜索模式
5
6
+ 20230503: 新增rwkv模型支持
6
7
+ 20230428: 优化cuda版本,使用大prompt时有明显加速
7
8
+ 20230427: 当相同目录下存在app文件夹使,使用app文件夹下的UI进行启动
13
14
### 翻译模式演示
14
15
https://www.bilibili.com/video/BV1Xg4y1j7iJ
15
16
17
+ ### 搜索模式
18
+ 在开始的指令框中填入含{$search}的指令,程序会自动搜索并返回结果
19
+ 例如:
20
+ ```
21
+ You are a helpful AI Assistant.
22
+ We have provided an existing answer:
23
+ {$search}
24
+ We have the opportunity to refine the existing answer(only if needed) with some more context below.
25
+ ```
26
+ 其中{$search}会被搜索结果替换
27
+
16
28
17
29
## 快速开始
18
30
Original file line number Diff line number Diff line change 1
1
go generate -v
2
2
go build -o llama.cpp-ui-cpu.exe -ldflags " -H windowsgui" -v
3
3
go build -o llama.cpp-ui-cpu-cmd.exe -v
4
+ " C:\Program Files\7-Zip\7z.exe" a llama.cpp-ui-cpu.zip llama.cpp-ui-cpu.exe llama.cpp-ui-cpu-cmd.exe
4
5
pause
Original file line number Diff line number Diff line change 1
1
go generate -v
2
2
go build -o llama.cpp-ui-cuda.exe -tags=" cuda" -ldflags " -H windowsgui" -v
3
3
go build -o llama.cpp-ui-cuda-cmd.exe -tags=" cuda" -v
4
- pause
4
+ " C:\Program Files\7-Zip\7z.exe" a llama.cpp-ui-cuda.zip llama.cpp-ui-cuda.exe llama.cpp-ui-cuda-cmd.exe
5
+ pause
6
+
You can’t perform that action at this time.
0 commit comments