Skip to content

mx_formats: move inference to the quantize_ API #1971

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vkuzo merged 53 commits into from
Mar 28, 2025
Merged

mx_formats: move inference to the quantize_ API #1971

vkuzo merged 53 commits into from
Mar 28, 2025

Conversation

@vkuzo
Copy link
Contributor

@vkuzo vkuzo commented Mar 26, 2025

Summary:

  1. split the configs into training vs inference
  2. move the inference workflow to quantize_ API and delete the old
    swapping functions

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

vkuzo added 24 commits March 21, 2025 06:59
@vkuzo
Update
af6ae2f 
[ghstack-poisoned]
@vkuzo
Update
45120de 
[ghstack-poisoned]
@vkuzo
Update
5527e72 
[ghstack-poisoned]
@vkuzo
Update
478b9e1 
[ghstack-poisoned]
@vkuzo
Update
571775d 
[ghstack-poisoned]
@vkuzo
Update
fd30558 
[ghstack-poisoned]
@vkuzo
Update
b0cd056 
[ghstack-poisoned]
@vkuzo
Update
26b49fd 
[ghstack-poisoned]
@vkuzo
Update
ba10a02 
[ghstack-poisoned]
@vkuzo
Update
483cdfd 
[ghstack-poisoned]
@vkuzo
Update
32005c9 
[ghstack-poisoned]
@vkuzo
Update
e341c2e 
[ghstack-poisoned]
@vkuzo
Update
7ecd79f 
[ghstack-poisoned]
@vkuzo
Update
ca3c4cf 
[ghstack-poisoned]
@vkuzo
Update
0de11cf 
[ghstack-poisoned]
@vkuzo
Update
912e4dc 
[ghstack-poisoned]
@vkuzo
Update
fb5662a 
[ghstack-poisoned]
@vkuzo
Update
f245d64 
[ghstack-poisoned]
@vkuzo
Update
9e5b8f8 
[ghstack-poisoned]
@vkuzo
Update
e5bdecb 
[ghstack-poisoned]
@vkuzo
Update
4c2ad8c 
[ghstack-poisoned]
@vkuzo
Update
c1ceef1 
[ghstack-poisoned]
@vkuzo
Update
65bfff0 
[ghstack-poisoned]
@vkuzo
Update
0ff3a93 
[ghstack-poisoned]
@vkuzo
Copy link
Contributor Author

vkuzo commented Mar 26, 2025 •
edited
Loading

Stack from ghstack (oldest at bottom):

@pytorch-bot
Copy link

pytorch-bot bot commented Mar 26, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/1971

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Mar 26, 2025
Merged
Merged
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 26, 2025
@vkuzo vkuzo mentioned this pull request Mar 26, 2025
Merged
vkuzo added 3 commits March 27, 2025 07:24
@vkuzo
Update
41b1f9d 
[ghstack-poisoned]
@vkuzo
Update
5cc2755 
[ghstack-poisoned]
@vkuzo
Update
af1f386 
[ghstack-poisoned]
vkuzo added a commit that referenced this pull request Mar 27, 2025
@vkuzo
mx_formats: move inference to the quantize_ API
f94711f 
Summary:

1. split the configs into training vs inference
2. move the inference workflow to `quantize_` API and delete the old
   swapping functions

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 3005d1e
ghstack-comment-id: 2755879503
Pull Request resolved: #1971
vkuzo added 4 commits March 27, 2025 07:25
@vkuzo
Update
8691bd4 
[ghstack-poisoned]
@vkuzo
Update
1a0993d 
[ghstack-poisoned]
@vkuzo
Update
b053f97 
[ghstack-poisoned]
@vkuzo
Update
9e335ce 
[ghstack-poisoned]
vkuzo added a commit that referenced this pull request Mar 27, 2025
@vkuzo
mx_formats: move inference to the quantize_ API
d249bec 
Summary:

1. split the configs into training vs inference
2. move the inference workflow to `quantize_` API and delete the old
   swapping functions

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 3005d1e
ghstack-comment-id: 2755879503
Pull Request resolved: #1971
vkuzo added 4 commits March 28, 2025 07:12
@vkuzo
Update
87756f9 
[ghstack-poisoned]
@vkuzo
Update
d0a0fd1 
[ghstack-poisoned]
@vkuzo
Update
cf9dfe4 
[ghstack-poisoned]
@vkuzo
Update
beafdd9 
[ghstack-poisoned]
vkuzo added a commit that referenced this pull request Mar 28, 2025
@vkuzo
mx_formats: move inference to the quantize_ API
630bf2f 
Summary:

1. split the configs into training vs inference
2. move the inference workflow to `quantize_` API and delete the old
   swapping functions

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 453a4e4
ghstack-comment-id: 2755879503
Pull Request resolved: #1971
vkuzo added 2 commits March 28, 2025 07:14
@vkuzo
Update
45abedf 
[ghstack-poisoned]
@vkuzo
Update
af87eee 
[ghstack-poisoned]
vkuzo added a commit that referenced this pull request Mar 28, 2025
@vkuzo
mx_formats: move inference to the quantize_ API
ad7d0f5 
Summary:

1. split the configs into training vs inference
2. move the inference workflow to `quantize_` API and delete the old
   swapping functions

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 392edef
ghstack-comment-id: 2755879503
Pull Request resolved: #1971
@vkuzo vkuzo added the topic: not user facing Use this tag if you don't want this PR to show up in release notes label Mar 28, 2025
This was referenced Mar 28, 2025
Merged
Merged
Merged
vkuzo added 6 commits March 28, 2025 13:00
@vkuzo
Update
02d5065 
[ghstack-poisoned]
@vkuzo
Update
d1bf83a 
[ghstack-poisoned]
@vkuzo
Update
84c77d7 
[ghstack-poisoned]
@vkuzo
Update
c603f09 
[ghstack-poisoned]
@vkuzo
Update
42fb0e9 
[ghstack-poisoned]
@vkuzo
Update
83e1e2e 
[ghstack-poisoned]
@vkuzo vkuzo changed the base branch from gh/vkuzo/82/head to main March 28, 2025 20:03
@vkuzo vkuzo merged commit 42e1345 into main Mar 28, 2025
3 checks passed
liangel-02 pushed a commit that referenced this pull request Aug 25, 2025
@vkuzo @liangel-02
mx_formats: move inference to the quantize_ API (#1971)
29a7ee9 
* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]

* Update

[ghstack-poisoned]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jerryzh168 jerryzh168 jerryzh168 approved these changes

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: not user facing Use this tag if you don't want this PR to show up in release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@vkuzo @jerryzh168 @facebook-github-bot