Skip to content

Commit

Permalink
Update README.md (#729)
Browse files Browse the repository at this point in the history
Remove comment that is rendered atm.
  • Loading branch information
mikekgfb authored and malfet committed Jul 17, 2024
1 parent 706a5a1 commit 4075b1c
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -198,8 +198,6 @@ export TORCHCHAT_ROOT=${PWD}
### Export for mobile
The following example uses the Llama3 8B Instruct model.

[comment default]: echo '{"embedding": {"bitwidth": 4, "groupsize" : 32}, "linear:a8w4dq": {"groupsize" : 32}}' >./config/data/mobile.json

```
# Export
python3 torchchat.py export llama3 --quantize config/data/mobile.json --output-pte-path llama3.pte
Expand Down

0 comments on commit 4075b1c

Please sign in to comment.