Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat importer offline e2e #2014

Merged
merged 18 commits into from
Feb 17, 2025
Merged

Feat importer offline e2e #2014

merged 18 commits into from
Feb 17, 2025

Conversation

arthurmm-cloudwalk
Copy link
Contributor

@arthurmm-cloudwalk arthurmm-cloudwalk commented Feb 13, 2025

Add e2e test for importer offline

  • Turn on stratus
  • Runs some transactions
  • Runs rpc downloader (downloads blocks and receipts to a SQL database)
  • Runs importer-offline (generates a new database chain using the SQL database)
  • Turn on stratus on importer-offline new database chain
  • Compares blocks between both stratus

Copy link
Contributor

@gabriel-aranha-cw gabriel-aranha-cw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe the tests failed silently(importer offline and rpc downloader). Seems to be missing something
rpc-downloader

> [2025-02-13 19:53:40] Checking content of postgres
Traceback (most recent call last):
  File "/home/runner/work/stratus/stratus/utils/check_rpc_downloader/main.py", line 4, in <module>
    import psycopg2
ModuleNotFoundError: No module named 'psycopg2'

importer-offline

-> [2025-02-13 19:46:14] Compare blocks of stratus and importer-offline
    Finished `release` profile [optimized] target(s) in 0.33s
     Running `target/release/stratus --leader -a '0.0.0.0:3001' --perm-storage=rocks --rocks-path-prefix=tests/importer-offline-database`
  File "/home/runner/work/stratus/stratus/utils/compare_block/main.py", line 13
    print(f"{'\t'*indent}[bold red]{field}[/bold red]")
                                                      ^
SyntaxError: f-string expression part cannot include a backslash

@arthurmm-cloudwalk arthurmm-cloudwalk enabled auto-merge (squash) February 14, 2025 20:56
@arthurmm-cloudwalk arthurmm-cloudwalk merged commit 69d157e into main Feb 17, 2025
40 checks passed
@arthurmm-cloudwalk arthurmm-cloudwalk deleted the feat-importer-offline-e2e branch February 17, 2025 19:08
@gabriel-aranha-cw
Copy link
Contributor

Final benchmark:
Run ID: bench-1516539664

Git Info:

Configuration:

  • Target Account Strategy: Default

Leader Stats:
RPS Stats: Max: 1801.00, Min: 1227.00, Avg: 1617.64, StdDev: 65.32
TPS Stats: Max: 1782.00, Min: 1422.00, Avg: 1569.61, StdDev: 78.14

Follower Stats:
Imported Blocks/s: Max: 5.00, Min: 1.00, Avg: 1.63, StdDev: 0.54
Imported Transactions/s: Max: 3530.00, Min: 63.00, Avg: 2595.39, StdDev: 802.28

Plots:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants