Skip to content

[Feature] Allow using lists of tensors in vllm instead of padded tensors #2861

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 10 commits into from
Mar 20, 2025
Merged

[Feature] Allow using lists of tensors in vllm instead of padded tensors #2861

merged 10 commits into from
Mar 20, 2025

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Mar 19, 2025 •
edited
Loading

@vmoens
Update
7f0db72 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Mar 18, 2025
Merged
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 19, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2861

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Mar 19, 2025
Merged
Merged
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 19, 2025
This was referenced Mar 19, 2025
Merged
Merged
vmoens added a commit that referenced this pull request Mar 19, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
978746b 
ghstack-source-id: 020791a
Pull Request resolved: #2861
vmoens added a commit that referenced this pull request Mar 19, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
5250df6 
ghstack-source-id: 020791a
Pull Request resolved: #2861
@vmoens
Update
26dfdc1 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 19, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
ed7512f 
ghstack-source-id: c037e99
Pull Request resolved: #2861
@vmoens
Update
0a066c9 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
2115ad8 
ghstack-source-id: 7b40f2c
Pull Request resolved: #2861
@vmoens vmoens added the enhancement New feature or request label Mar 20, 2025
@vmoens
Update
224920d 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
0c2d6ef 
ghstack-source-id: da8c23f
Pull Request resolved: #2861
@vmoens
Update
1a5d99c 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
26681e8 
ghstack-source-id: 947fd2b
Pull Request resolved: #2861
@vmoens
Update
8a6473f 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
deed275 
ghstack-source-id: 2b1ed27
Pull Request resolved: #2861
@vmoens
Update
cee3f05 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
6ce4708 
ghstack-source-id: cab5367
Pull Request resolved: #2861
@vmoens
Update
d91a601 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
40dcd2f 
ghstack-source-id: 4b5e8d2
Pull Request resolved: #2861
@vmoens
Update
7c5306c 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
ef8b03b 
ghstack-source-id: dfaf718
Pull Request resolved: #2861
@vmoens
Update
64e3342 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
cb89b3e 
ghstack-source-id: 46615f1
Pull Request resolved: #2861
@vmoens vmoens merged commit 64e3342 into gh/vmoens/122/base Mar 20, 2025
25 of 43 checks passed
vmoens added a commit that referenced this pull request Mar 20, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
62f3e3b 
ghstack-source-id: 46615f1
Pull Request resolved: #2861
@vmoens vmoens deleted the gh/vmoens/122/head branch March 20, 2025 18:27
vmoens added a commit that referenced this pull request Mar 21, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
65de9de 
ghstack-source-id: 46615f1
Pull Request resolved: #2861
vmoens added a commit that referenced this pull request Mar 28, 2025
@vmoens
[Feature] Allow using lists of tensors in vllm instead of padded tensors
4745d5d 
ghstack-source-id: 46615f1
Pull Request resolved: #2861
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot