Skip to content

Commit f0799fe

Browse files
committed
Change qwen2 to qwen25
1 parent 6f39939 commit f0799fe

2 files changed

Lines changed: 5 additions & 5 deletions

File tree

docs/mm/nemo_2/gen_nemo2_ckpt.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,9 +35,9 @@ This checkpoint is used for in-framework deployment examples.
3535

3636
# Import the model and convert to NeMo 2.0 format
3737
import_ckpt(
38-
model=vlm.Qwen2VLModel(vlm.Qwen2VLConfig3BInstruct()),
38+
model=vlm.Qwen2VLModel(vlm.Qwen25VLConfig3B(), model_version='qwen25-vl')
3939
source=f"hf://{hf_model_id}", # Hugging Face model source
40-
output_path=Path('/opt/checkpoints/qwen2_vl_3b')
40+
output_path=Path('/opt/checkpoints/qwen25_vl_3b')
4141
)
4242
```
4343

docs/mm/nemo_2/in-framework.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ This section explains how to deploy [NeMo 2.0](https://github.com/NVIDIA-NeMo/Ne
66

77
1. Follow the steps on the [Generate A NeMo 2.0 Checkpoint page](gen_nemo2_ckpt.md) to generate a NeMo 2.0 multimodal checkpoint.
88

9-
2. In a terminal, go to the folder where the ``qwen2_vl_3b`` is located. Pull and run the Docker container image using the command shown below. Change the ``:vr`` tag to the version of the container you want to use:
9+
2. In a terminal, go to the folder where the ``qwen25_vl_3b`` is located. Pull and run the Docker container image using the command shown below. Change the ``:vr`` tag to the version of the container you want to use:
1010

1111
```shell
1212
docker pull nvcr.io/nvidia/nemo:vr
@@ -21,7 +21,7 @@ This section explains how to deploy [NeMo 2.0](https://github.com/NVIDIA-NeMo/Ne
2121
3. Using a NeMo 2.0 multimodal model, run the following deployment script to verify that everything is working correctly. The script directly serves the NeMo 2.0 model on the Triton server:
2222

2323
```shell
24-
python /opt/Export-Deploy/scripts/deploy/multimodal/deploy_inframework_triton.py --nemo_checkpoint /opt/checkpoints/qwen2_vl_3b --triton_model_name qwen
24+
python /opt/Export-Deploy/scripts/deploy/multimodal/deploy_inframework_triton.py --nemo_checkpoint /opt/checkpoints/qwen25_vl_3b --triton_model_name qwen
2525
```
2626

2727
4. If the test yields a shared memory-related error, increase the shared memory size using ``--shm-size`` (for example, gradually by 50%).
@@ -55,7 +55,7 @@ Executing the script will directly deploy the NeMo 2.0 multimodal model and star
5555
2. To begin serving the downloaded model, run the following script:
5656

5757
```shell
58-
python /opt/Export-Deploy/scripts/deploy/multimodal/deploy_inframework_triton.py --nemo_checkpoint /opt/checkpoints/qwen2_vl_3b --triton_model_name qwen
58+
python /opt/Export-Deploy/scripts/deploy/multimodal/deploy_inframework_triton.py --nemo_checkpoint /opt/checkpoints/qwen25_vl_3b --triton_model_name qwen
5959
```
6060

6161
The following parameters are defined in the ``deploy_inframework_triton.py`` script:

0 commit comments

Comments
 (0)