Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Userspace Convertor: Manifest Deduplication #257

Merged

Conversation

estebanreyl
Copy link
Member

Adds manifest deduplication, which prevents re-conversion of an already converted image if its result is known and already stored within the registry. This change also includes adjustments to support cross repo mounts for whole images, improvements for the userspace db functionality, usage samples and corresponding unit tests.

What this PR does / why we need it:
This change extends the functionality of the user space convertor's deduplication functionality to avoid reconverting already converted manifests. This is an optimization to avoid converting duplicates.

Which issue(s) this PR fixes:
Fixes #249

Please check the following list:

  • Does the affected code have corresponding tests, e.g. unit test, E2E test?
  • Does this change require a documentation update?
  • Does this introduce breaking changes that would require an announcement or bumping the major version?
  • Do all new files have an appropriate license header?

@estebanreyl estebanreyl force-pushed the esrey/prevent-manifest-reconvert branch 2 times, most recently from 7edd471 to edb2628 Compare January 10, 2024 23:26
@yuchen0cc yuchen0cc added the ok-to-test Pull request is ok to run ci test label Jan 12, 2024
Copy link
Contributor

@yuchen0cc yuchen0cc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Adds manifest deduplication, which prevents re-conversion of an already
converted image if its result is known and already stored within the
registry. This change also includes adjustments to support cross repo
mounts for whole images, improvments for the userspace db functionality,
usage samples and corresponding unit tests.

Signed-off-by: Esteban Rey <[email protected]>
@estebanreyl estebanreyl force-pushed the esrey/prevent-manifest-reconvert branch from edb2628 to c7e6fee Compare February 7, 2024 19:04
@estebanreyl
Copy link
Member Author

I added the mentioned changes, can we revisit this to get it merged in?

@liulanzheng
Copy link
Member

@WaberZhuang ptal

@yuchen0cc
Copy link
Contributor

LGTM

@yuchen0cc yuchen0cc merged commit 6b43e99 into containerd:main Feb 22, 2024
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ok-to-test Pull request is ok to run ci test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Userspace Convertor] Mount or avoid reconverting previously Converted Manifests
4 participants