fix(RELEASE-1277): release controller crashes

[theflockers]

this PR tries to fix/decrease the daily crashes of the release controller by filtering objects to cache and increasing the lease renew time.

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[theflockers]

this PR replaces: #545 and #617

[codecov]

Codecov Report

Attention: Patch coverage is 7.69231% with 36 lines in your changes missing coverage. Please review.

Project coverage is 78.17%. Comparing base (f1cc9bd) to head (1b03d25).
Report is 2 commits behind head on main.

Files with missing lines	Patch %	Lines
main.go	0.00%	36 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #655      +/-   ##
==========================================
- Coverage   79.23%   78.17%   -1.07%     
==========================================
  Files          28       28              
  Lines        2283     2318      +35     
==========================================
+ Hits         1809     1812       +3     
- Misses        389      421      +32     
  Partials       85       85              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[theflockers]

Tests will be added in a separate PR that refactors main: https://github.com/konflux-ci/release-service/pull/660/files

#655 (comment)

[theflockers]

/retest

[theflockers]

/ok-to-test

[theflockers]

/retest

[theflockers]

/retest

[theflockers]

/retest

[theflockers]

/ok-to-test

[johnbieren]

I see E2E passed, so we are good with this now? Can you squash the commits?

[theflockers]

I see E2E passed, so we are good with this now? Can you squash the commits?

I will merge. But lets put it only on stage for now, so I can look for some numbers.