Skip to content

AttributeError: 'ModelInfo' object has no attribute 'rope_scaling' #3037

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
xdaiycl opened this issue Feb 8, 2025 · 0 comments
Open

AttributeError: 'ModelInfo' object has no attribute 'rope_scaling' #3037

xdaiycl opened this issue Feb 8, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@xdaiycl
Copy link

xdaiycl commented Feb 8, 2025

AttributeError: 'ModelInfo' object has no attribute 'rope_scaling'
Command:
CUDA_VISIBLE_DEVICES=0,1 MAX_PIXELS=1003520 swift sft --model /data/cache/hub/qwen/Qwen2-VL-7B-Instruct --dataset /data/Datasets/Jsonls/HTMLPrediction/train.jsonl --train_type lora --num_train_epochs 3 --per_device_train_batch_size 1 --per_device_eval_batch_size 1 --learning_rate 1e-4 --lora_rank 8 --lora_alpha 32 --target_modules all-linear --freeze_vit true --gradient_accumulation_steps 16 --eval_steps 50 --save_steps 50 --save_total_limit 5 --logging_steps 5 --output_dir output --warmup_ratio 0.05 --dataloader_num_workers 4 --rope_scaling dynamic --max_length 131072

@Jintao-Huang Jintao-Huang added the bug Something isn't working label Feb 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants