Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding block replay script to contrib/tools folder #5804

Merged
merged 1 commit into from
Feb 6, 2025

Conversation

wileyj
Copy link
Collaborator

@wileyj wileyj commented Feb 5, 2025

Adding the script used to perform block replays.

this is a standalone helper script, designed for debian based systems and should self-install/build everything needed to run.
storage requirements are a bit heavy, and it will cook eggs with how hot the cpus get.

commented and passed shellcheck.

some notes:
Requires ~73GB per slice, plus an extra ~400GB for the chainstate archive and marf DB
as of 02/2025:

  • for 10 slices, total disk used is ~1.1TB
    • 149GB for compressed chainstate
    • 232GB decompressed marf db
    • 73GB per slice dir (1 dir per cpu)
  • for 15 slices, this is about 1.46TB
  • for 20 slices, this is about 1.8TB

for 10 cpus, the entire block replay will take around 14 hours depending on network speed. once the chainstate is downloaded/extracted the runtime is roughly 12 hours.

Recommended to run this in screen/tmux since it is a long running process.

@wileyj wileyj requested a review from a team as a code owner February 5, 2025 00:49
@wileyj wileyj requested a review from a team February 5, 2025 18:49
Copy link
Contributor

@obycode obycode left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great! 🙌

@wileyj wileyj added this pull request to the merge queue Feb 6, 2025
Merged via the queue into develop with commit 3730ca3 Feb 6, 2025
175 checks passed
@wileyj wileyj deleted the feat/contrib_replay-script branch February 6, 2025 21:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants