Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

What should I do if the input text exceeds the context? #34

Open
coolling opened this issue Jan 2, 2025 · 2 comments
Open

What should I do if the input text exceeds the context? #34

coolling opened this issue Jan 2, 2025 · 2 comments

Comments

@coolling
Copy link

coolling commented Jan 2, 2025

No description provided.

@dongxielin
Copy link

i had the same problem.for example, i have tried to compress a text with 1053 tokens,but the error is index out of range.
how can i do to slove the problem?

@dongxielin
Copy link

i had the same problem.for example, i have tried to compress a text with 1053 tokens,but the error is index out of range.
how can i do to slove the problem?

Temporary solution
Add the parameters truncation=True and max_length=1024 at line 108 of the selective_context.py file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dongxielin @coolling