Skip to content

Commit 6f22133

Browse files
authored
Update AWQ and GPTQ GPU example (#12300)
1 parent 0763268 commit 6f22133

File tree

2 files changed

+0
-6
lines changed

2 files changed

+0
-6
lines changed

python/llm/example/GPU/HuggingFace/Advanced-Quantizations/AWQ/README.md

-5
Original file line numberDiff line numberDiff line change
@@ -37,15 +37,10 @@ conda create -n llm python=3.11
3737
conda activate llm
3838
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
3939
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
40-
pip install transformers==4.35.0
4140
pip install autoawq==0.1.8 --no-deps
4241
pip install accelerate==0.25.0
4342
pip install einops
4443
```
45-
**Note: For Mixtral model, please use transformers 4.36.0:**
46-
```bash
47-
pip install transformers==4.36.0
48-
```
4944

5045
### 2. Configures OneAPI environment variables
5146

python/llm/example/GPU/HuggingFace/Advanced-Quantizations/GPTQ/README.md

-1
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,6 @@ conda create -n llm python=3.11
1313
conda activate llm
1414
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
1515
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
16-
pip install transformers==4.37.0
1716
pip install auto_gptq==0.7.1
1817
pip install optimum==1.14.0
1918
```

0 commit comments

Comments
 (0)