Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restoration task stuck #96

Open
TristisOris opened this issue Feb 12, 2025 · 3 comments
Open

Restoration task stuck #96

TristisOris opened this issue Feb 12, 2025 · 3 comments

Comments

@TristisOris
Copy link

  • Nothing happens, no traffic.
  • Container restart not cancel this tasks.
  • Restoration page loading for a few minutes.

Image

at /tmp folder both dumps exist.

Image

nothing changed after their removal.

i tried to remove task from database, but it cause memory leak at my client.

then i connect to db inside container. no succeess.

Image

Image

i can SELECT * FROM restorations LIMIT 10; but limit 20 already broken

Image

@TristisOris
Copy link
Author

TristisOris commented Feb 12, 2025

Image

no id of running tasks here, so nothing to remove.
nvm id changed after restart or something else. removed them.

Problem was not with running tasks, but with some huge with a lot of error records. I even can't open it detais at UI.

Image

4 times! don't ask me. After this removal everything goes fine.

@TristisOris
Copy link
Author

TristisOris commented Feb 12, 2025

2 db restoratation always failed and UI became slow. reproduced few times.

Image

Image

9min to restore 600mb.

other db succeed to restore into same source.

can't copy log because it too huge.

Image

Image

both db with TImescale. RIght now it fall into restore state, so can't create a TS extention, that a root of problem.

@TristisOris
Copy link
Author

repeat it again. Same DB restoration failed on fresh instance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant