Skip to content
This repository was archived by the owner on Feb 6, 2025. It is now read-only.

Commit da259f1

Browse files
committed
功能: 优化性能并为llama.cpp添加搜索模式
- 更新llama.cpp到最新版本并添加搜索模式 - 添加对rwkv模型的支持 - 优化cuda版本以提高性能 - 如果在同一目录中存在app文件夹UI,则使用它作为启动项 - 添加自动搜索和结果返回的搜索模式 - 修复build.bat末尾缺少换行符的问题 - 在build_cuda.bat中添加对cuda版本的构建支持
1 parent 440f638 commit da259f1

File tree

3 files changed

+16
-1
lines changed

3 files changed

+16
-1
lines changed

README.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,7 @@
22
为llama.cpp编写的UI操作界面,在win上可以快速体验llama.cpp的功能
33

44
## 更新
5+
+ 20230523: 更新llama.cpp到最新版本,修复了一些bug,新增搜索模式
56
+ 20230503: 新增rwkv模型支持
67
+ 20230428: 优化cuda版本,使用大prompt时有明显加速
78
+ 20230427: 当相同目录下存在app文件夹使,使用app文件夹下的UI进行启动
@@ -13,6 +14,17 @@
1314
### 翻译模式演示
1415
https://www.bilibili.com/video/BV1Xg4y1j7iJ
1516

17+
### 搜索模式
18+
在开始的指令框中填入含{$search}的指令,程序会自动搜索并返回结果
19+
例如:
20+
```
21+
You are a helpful AI Assistant.
22+
We have provided an existing answer:
23+
{$search}
24+
We have the opportunity to refine the existing answer(only if needed) with some more context below.
25+
```
26+
其中{$search}会被搜索结果替换
27+
1628

1729
## 快速开始
1830

build.bat

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
go generate -v
22
go build -o llama.cpp-ui-cpu.exe -ldflags "-H windowsgui" -v
33
go build -o llama.cpp-ui-cpu-cmd.exe -v
4+
"C:\Program Files\7-Zip\7z.exe" a llama.cpp-ui-cpu.zip llama.cpp-ui-cpu.exe llama.cpp-ui-cpu-cmd.exe
45
pause

build_cuda.bat

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
go generate -v
22
go build -o llama.cpp-ui-cuda.exe -tags="cuda" -ldflags "-H windowsgui" -v
33
go build -o llama.cpp-ui-cuda-cmd.exe -tags="cuda" -v
4-
pause
4+
"C:\Program Files\7-Zip\7z.exe" a llama.cpp-ui-cuda.zip llama.cpp-ui-cuda.exe llama.cpp-ui-cuda-cmd.exe
5+
pause
6+

0 commit comments

Comments
 (0)