About model parallel

[DiaQusNet]

Hi, in your readme.md document, I found that it provides a model parallel method similar to MiniLLM. However, in the script files you provided (in scripts/), all parameters related to model parallel are either commented out or not provided. So, does your PromptKD method not require model parallel?

[ghost]

Hi, in your readme.md document, I found that it provides a model parallel method similar to MiniLLM. However, in the script files you provided (in scripts/), all parameters related to model parallel are either commented out or not provided. So, does your PromptKD method not require model parallel?

你好，请问你能正常运行数据下载的脚本吗，原作者的脚本文件好像失效了

[DiaQusNet]

Hi, in your readme.md document, I found that it provides a model parallel method similar to MiniLLM. However, in the script files you provided (in scripts/), all parameters related to model parallel are either commented out or not provided. So, does your PromptKD method not require model parallel?

你好，请问你能正常运行数据下载的脚本吗，原作者的脚本文件好像失效了

sorry, I haven't actually run this project