Deselect tflite-gated quantizer tests in internal CI#20640
Conversation
Summary: Internal CI flags consistently-skipping tests as broken/disabled, generating a backlog of phantom failure issues for the executorch oncall. The 56 NXP quantizer tests that require tflite always skip in fbcode since tflite isn't provisioned in that target. Following the ARM VGF precedent (D103644035), this adds a pytest collection hook that deselects tflite-gated tests when tflite is unavailable instead of letting them skip. Deselected tests produce no signal, stopping the phantom issues. The hook is a no-op when tflite is importable, so OSS CI is unaffected. Differential Revision: D110212311
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20640
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New Failure, 11 PendingAs of commit c6adce4 with merge base e095c57 ( NEW FAILURE - The following job has failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
@rascani has exported this pull request. If you are a Meta employee, you can view the originating Diff in D110212311. |
This PR needs a
|
Summary:
Internal CI flags consistently-skipping tests as broken/disabled, generating a backlog of phantom failure issues for the executorch oncall. The 56 NXP quantizer tests that require tflite always skip in fbcode since tflite isn't provisioned in that target.
Following the ARM VGF precedent (D103644035), this adds a pytest collection hook that deselects tflite-gated tests when tflite is unavailable instead of letting them skip. Deselected tests produce no signal, stopping the phantom issues. The hook is a no-op when tflite is importable, so OSS CI is unaffected.
Differential Revision: D110212311