Skip to content

Commit dbba3d8

Browse files
committed
update config
1 parent f4da1ce commit dbba3d8

File tree

5 files changed

+12
-41
lines changed

5 files changed

+12
-41
lines changed

configs/quantization/methods/Awq/awq_w_only_vlm.yml

+3-3
Original file line numberDiff line numberDiff line change
@@ -18,11 +18,11 @@ calib:
1818
seed: *seed
1919
eval:
2020
eval_pos: [pretrain, fake_quant]
21-
type: img_txt
22-
name: MME
21+
type: vqa
22+
name: mme
2323
download: False
2424
path: MME dataset path
25-
bs: 16
25+
bs: 1
2626
inference_per_block: False
2727
quant:
2828
method: Awq

configs/quantization/methods/GPTQ/gptq_w_only_vlm.yml

+3-3
Original file line numberDiff line numberDiff line change
@@ -18,11 +18,11 @@ calib:
1818
seed: *seed
1919
eval:
2020
eval_pos: [pretrain, fake_quant]
21-
type: img_txt
22-
name: MME
21+
type: vqa
22+
name: mme
2323
download: False
2424
path: MME dataset path
25-
bs: 16
25+
bs: 1
2626
inference_per_block: False
2727
quant:
2828
method: GPTQ

configs/quantization/methods/RTN/rtn_w_a_lmms_eval.yml

-29
This file was deleted.

configs/quantization/methods/RTN/rtn_w_a_vlm.yml

+3-3
Original file line numberDiff line numberDiff line change
@@ -6,11 +6,11 @@ model:
66
torch_dtype: auto
77
eval:
88
eval_pos: [pretrain, fake_quant]
9-
type: img_txt
10-
name: MME
9+
type: vqa
10+
name: mme
1111
download: False
1212
path: MME dataset path
13-
bs: 16
13+
bs: 1
1414
inference_per_block: False
1515
quant:
1616
method: RTN

configs/quantization/methods/SmoothQuant/smoothquant_w_a_vlm.yml

+3-3
Original file line numberDiff line numberDiff line change
@@ -18,11 +18,11 @@ calib:
1818
seed: *seed
1919
eval:
2020
eval_pos: [pretrain, fake_quant]
21-
type: img_txt
22-
name: MME
21+
type: vqa
22+
name: mme
2323
download: False
2424
path: MME dataset path
25-
bs: 16
25+
bs: 1
2626
inference_per_block: False
2727
quant:
2828
method: SmoothQuant

0 commit comments

Comments
 (0)