Skip to content

[Relax][TensorRT] Fix YOLO BYOC offload and partitioning gaps#19998

Open
tlopex wants to merge 4 commits into
apache:mainfrom
tlopex:fix/relax-merge-composite-cycle-19887
Open

[Relax][TensorRT] Fix YOLO BYOC offload and partitioning gaps#19998
tlopex wants to merge 4 commits into
apache:mainfrom
tlopex:fix/relax-merge-composite-cycle-19887

Conversation

@tlopex

@tlopex tlopex commented Jul 13, 2026

Copy link
Copy Markdown
Member

Fixes #19887.

This PR fixes several gaps in the Relax TensorRT BYOC pipeline exposed by YOLO-style models.

The reported failures occurred at three different stages:

  • relax.permute_dims and relax.image.resize2d were not offloaded consistently because TensorRT composite naming and runtime converter coverage were incomplete.
  • MergeCompositeFunctions could incorrectly merge branches involving split and TupleGetItem, resulting in a cyclic group dependency.
  • ONNX Range conversion could pass a PrimType directly to relax.arange, while its FFI expects a DataType.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces support for silu and image.resize2d operators in the TensorRT BYOC backend, including their respective pattern registrations, runtime converters, and unit tests. It also fixes a dependency tracking issue in MergeCompositeFunctions by explicitly handling TupleNode and TupleGetItemNode to prevent cyclic merges, and updates the arange operator to properly handle raw data types. Additionally, error reporting for unsupported TensorRT operators has been improved. No review comments were provided, so there is no feedback to address.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] [Tensorrt BYOC] permute_dims / image.resize2d fail as unsupported after Relax partitioning

1 participant