Skip to content

[spark] Eliminate the union stage when merging into without notMatche…#5195

Merged
Aitozi merged 1 commit intoapache:masterfrom
Aitozi:spark-merge-2
Mar 10, 2025
Merged

[spark] Eliminate the union stage when merging into without notMatche…#5195
Aitozi merged 1 commit intoapache:masterfrom
Aitozi:spark-merge-2

Conversation

@Aitozi
Copy link
Copy Markdown
Contributor

@Aitozi Aitozi commented Mar 3, 2025

…dActions

Purpose

Linked issue: close #5136

  1. Untouched files should participate in the join process only when the notMatchedActions is present
  2. Only intersectionFilePaths should be part of the untouched files

Tests

API and Format

Documentation

@Aitozi Aitozi merged commit 8255e33 into apache:master Mar 10, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Improve the spark merge into performance for append table

2 participants