Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

你好，微调后，提问一些别的问题会出现<UNK> #13

Open
SinLT opened this issue Jul 3, 2023 · 3 comments
Open

你好，微调后，提问一些别的问题会出现<UNK> #13

SinLT opened this issue Jul 3, 2023 · 3 comments

Comments

@SinLT
Copy link

SinLT commented Jul 3, 2023

image
@SinLT
Copy link
Author

SinLT commented Jul 3, 2023

image

@shuxueslpi
Copy link
Owner

@SinLT 本来在chatglm-6b时发现了这个问题，chatglm2-6b我微调后用同样的问题测了一下，没出现这样的异常。
但你这么一说，我刚刚查了下，好像我的训练数据里有大量，等我空了，我重新检查下这块的数据，感觉有问题。

@hemengjita
Copy link

数据集的问题 数据集有大量 删掉就行

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@shuxueslpi @SinLT @hemengjita