Skip to content

Commit 32480cc

Browse files
authored
Update llamacpp_portable_zip_gpu_quickstart (#12940)
1 parent 975cf5f commit 32480cc

File tree

2 files changed

+7
-1
lines changed

2 files changed

+7
-1
lines changed

docs/mddocs/Quickstart/llamacpp_portable_zip_gpu_quickstart.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,9 @@
33
< <b>English</b> | <a href='./llamacpp_portable_zip_gpu_quickstart.zh-CN.md'>中文</a> >
44
</p>
55

6+
>[!Important]
7+
> We can now run **DeepSeek-R1-671B-Q4_K_M** with 1 or 2 Arc A770 on Xeon using the latest [llama.cpp Portable Zip](#flashmoe-for-deepseek-v3r1).
8+
69
This guide demonstrates how to use [llama.cpp portable zip](https://github.com/intel/ipex-llm/releases/tag/v2.2.0-nightly) to directly run llama.cpp on Intel GPU with `ipex-llm` (without the need of manual installations).
710

811
> [!NOTE]
@@ -23,7 +26,7 @@ This guide demonstrates how to use [llama.cpp portable zip](https://github.com/i
2326
- [Step 1: Download and Extract](#step-1-download-and-extract)
2427
- [Step 2: Runtime Configuration](#step-2-runtime-configuration-1)
2528
- [Step 3: Run GGUF models](#step-3-run-gguf-models-1)
26-
- [(New) FlashMoE for MoE Models (e.g., DeepSeek V3/R1) using llama.cpp](#flashmoe-for-deepseek-v3r1)
29+
- [(New) FlashMoE for DeepSeek V3/R1 using llama.cpp](#flashmoe-for-deepseek-v3r1)
2730
- [Tips & Troubleshooting](#tips--troubleshooting)
2831
- [Error: Detected different sycl devices](#error-detected-different-sycl-devices)
2932
- [Multi-GPUs usage](#multi-gpus-usage)

docs/mddocs/Quickstart/llamacpp_portable_zip_gpu_quickstart.zh-CN.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,9 @@
55
66
本指南演示如何使用 [llama.cpp portable zip](https://github.com/intel/ipex-llm/releases/tag/v2.2.0-nightly) 通过 `ipex-llm` 在 Intel GPU 上直接免安装运行。
77

8+
> [!Important]
9+
> 使用最新 [llama.cpp Portable Zip](#flashmoe-运行-deepseek-v3r1), 可以在 Xeon 上通过1到2张 Arc A770 GPU 运行 **DeepSeek-R1-671B-Q4_K_M**
10+
811
> [!NOTE]
912
> llama.cpp portable zip 在如下设备上进行了验证:
1013
> - Intel Core Ultra processors

0 commit comments

Comments
 (0)