Add Namespace Range endpoint to streamer #901

Sneh1999 · 2026-01-07T19:05:24Z

Description

This PR adds support for range namespace queries in streamer

Additional things

Commented out hotshot listener because we are not using that code, might use it in future
Also removed multi node client

To see the specific tasks where the Asana app for GitHub is being used, see below:
- https://app.asana.com/0/0/1212678050666353

Copilot

Pull request overview

This PR adds support for range-based namespace queries in the Espresso streamer to improve performance by fetching multiple blocks at once instead of querying block-by-block. The PR also simplifies the client configuration by migrating from multiple HotShot URLs to a single URL.

Key Changes

Implemented FetchNamespaceTransactionsInRange endpoint to query transactions across a range of blocks (up to 100 blocks at a time)
Refactored from HotShotUrls (array) to HotShotUrl (single string) throughout the codebase
Commented out hotshot listener code that is not currently in use

Reviewed changes

Copilot reviewed 13 out of 14 changed files in this pull request and generated 9 comments.

Show a summary per file

File	Description
espressostreamer/espresso_streamer.go	Added range-based fetching logic with HOTSHOT_RANGE_LIMIT constant; modified fetchNextHotshotBlock to process multiple blocks
espressostreamer/espresso_streamer_test.go	Added FetchNamespaceTransactionsInRange mock implementation and new stream methods
arbnode/batch_poster.go	Changed HotShotUrls array to single HotShotUrl string; simplified client initialization
arbnode/espresso_caff_node.go	Changed HotShotUrls to HotShotUrl; replaced NewMultipleNodesClient with NewClient
system_tests/caff_node_test.go	Updated test configurations to use single HotShotUrl
system_tests/espresso_setup_test.go	Updated test to use single HotShotUrl
system_tests/espresso/chain/*.go	Added new interface methods to mock implementations
system_tests/hotshot_listener_test.go	Commented out entire test file
espresso/hotshot-listener/hotshot_listener.go	Commented out entire implementation
system_tests/espresso-e2e/docker-compose.yaml	Updated Espresso Docker image version
go.mod, go.sum	Updated espresso-network SDK dependency from v0.3.0 to v0.3.3

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

espressostreamer/espresso_streamer.go

system_tests/espresso/chain/simulated_latency.go

espressostreamer/espresso_streamer.go

arbnode/batch_poster.go

espressostreamer/espresso_streamer.go

ImJeremyHe

Overall it's good. Just a few comments.

arbnode/batch_poster.go

ImJeremyHe · 2026-01-08T08:01:25Z

espresso/hotshot-listener/hotshot_listener.go

@@ -1,268 +1,268 @@
 package hotshot_listener


Why did we need this? Since it becomes useless, can we just remove it?

I am commenting this out because we will need this code for Decentralized sequencing, dont want to delete it

ImJeremyHe · 2026-01-08T08:02:27Z

espressostreamer/espresso_streamer.go

We should also rename this function

espressostreamer/espresso_streamer.go

jjeangal · 2026-01-08T09:26:10Z

arbnode/batch_poster.go

-			}
+		// If the hotshot URL is non-empty, create the Espresso client.
+		if hotShotUrl != "" {
+			hotShotClient := hotshotClient.NewClient(hotShotUrl)


Can't this function potentially throw an error?

no error is returned here!

lukeiannucci · 2026-01-09T04:06:10Z

espressostreamer/espresso_streamer.go

+	}
+
+	fromBlock := nextHotshotBlockNum
+	toBlock := latestBlockHeight


i might need to switch onto the branch to take a closer look, but lets say latest is block 150, and next was 100. will that mean for every nitro block in the 50 hotshot block range will all be set to hot shot block 150?

no thats not how it works, it basically to fetches hotshot block is range 100 to 150. Then we can extract nitro blocks for all the hotshot blocks between hotshot block 100 and 150

github-actions · 2026-01-09T19:52:04Z

Backport failed for celestia-integration, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin celestia-integration
git worktree add -d .worktree/backport-901-to-celestia-integration origin/celestia-integration
cd .worktree/backport-901-to-celestia-integration
git switch --create backport-901-to-celestia-integration
git cherry-pick -x 20e1206faad7056cb19d8a2626c780cafb8721bc

github-actions · 2026-01-09T19:52:06Z

Backport failed for integration-v3.5.6, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin integration-v3.5.6
git worktree add -d .worktree/backport-901-to-integration-v3.5.6 origin/integration-v3.5.6
cd .worktree/backport-901-to-integration-v3.5.6
git switch --create backport-901-to-integration-v3.5.6
git cherry-pick -x 20e1206faad7056cb19d8a2626c780cafb8721bc

github-actions · 2026-01-09T19:52:07Z

Backport failed for celestia-v3.5.6, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin celestia-v3.5.6
git worktree add -d .worktree/backport-901-to-celestia-v3.5.6 origin/celestia-v3.5.6
cd .worktree/backport-901-to-celestia-v3.5.6
git switch --create backport-901-to-celestia-v3.5.6
git cherry-pick -x 20e1206faad7056cb19d8a2626c780cafb8721bc

github-actions · 2026-01-09T19:52:09Z

Backport failed for integration-v3.8.0, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin integration-v3.8.0
git worktree add -d .worktree/backport-901-to-integration-v3.8.0 origin/integration-v3.8.0
cd .worktree/backport-901-to-integration-v3.8.0
git switch --create backport-901-to-integration-v3.8.0
git cherry-pick -x 20e1206faad7056cb19d8a2626c780cafb8721bc

github-actions · 2026-01-09T19:52:11Z

Backport failed for integration-v3.9.2, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin integration-v3.9.2
git worktree add -d .worktree/backport-901-to-integration-v3.9.2 origin/integration-v3.9.2
cd .worktree/backport-901-to-integration-v3.9.2
git switch --create backport-901-to-integration-v3.9.2
git cherry-pick -x 20e1206faad7056cb19d8a2626c780cafb8721bc

github-actions · 2026-01-09T19:52:12Z

Backport failed for celestia-v3.9.2, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin celestia-v3.9.2
git worktree add -d .worktree/backport-901-to-celestia-v3.9.2 origin/celestia-v3.9.2
cd .worktree/backport-901-to-celestia-v3.9.2
git switch --create backport-901-to-celestia-v3.9.2
git cherry-pick -x 20e1206faad7056cb19d8a2626c780cafb8721bc

* Add Namespace Range enpoint to streamer * fix tests * fix lint * fix comment * address bot comments * fix lint (cherry picked from commit 20e1206)

Sneh1999 added 2 commits January 7, 2026 14:03

Add Namespace Range enpoint to streamer

a07e82c

fix tests

626eec7

Sneh1999 changed the title ~~Add Namespace Range enpoint to streamer~~ Add Namespace Range endpoint to streamer Jan 7, 2026

Sneh1999 marked this pull request as ready for review January 7, 2026 20:04

Sneh1999 requested review from ImJeremyHe, alysiahuggins, jbearer, jjeangal, sveitser and zacshowa as code owners January 7, 2026 20:04

Sneh1999 requested review from lukeiannucci and varun-doshi January 7, 2026 20:04

Sneh1999 added 2 commits January 7, 2026 15:25

fix lint

1c26774

fix comment

d993e91

Sneh1999 requested a review from Copilot January 7, 2026 20:35

Copilot started reviewing on behalf of Sneh1999 January 7, 2026 20:36 View session

Copilot AI reviewed Jan 7, 2026

View reviewed changes

address bot comments

bb0c330

Sneh1999 added backport celestia-integration backport integration-v3.5.6 backport celestia-v3.5.6 backport integration-v3.8.0 backport integration-v3.9.2 backport celestia-v3.9.2 labels Jan 7, 2026

ImJeremyHe reviewed Jan 8, 2026

View reviewed changes

jjeangal reviewed Jan 8, 2026

View reviewed changes

Sneh1999 added 2 commits January 8, 2026 10:52

merge

4a93452

fix lint

8b04593

ImJeremyHe approved these changes Jan 9, 2026

View reviewed changes

lukeiannucci reviewed Jan 9, 2026

View reviewed changes

Sneh1999 merged commit 20e1206 into integration Jan 9, 2026
10 checks passed

Sneh1999 deleted the range-endpoint-for-streamer branch January 9, 2026 19:51

Sneh1999 added a commit that referenced this pull request Jan 9, 2026

Add Namespace Range endpoint to streamer (#901)

a6085e7

* Add Namespace Range enpoint to streamer * fix tests * fix lint * fix comment * address bot comments * fix lint (cherry picked from commit 20e1206)

Sneh1999 added a commit that referenced this pull request Jan 9, 2026

Add Namespace Range endpoint to streamer (#901)

fe2dd19

* Add Namespace Range enpoint to streamer * fix tests * fix lint * fix comment * address bot comments * fix lint (cherry picked from commit 20e1206)

Sneh1999 added a commit that referenced this pull request Jan 9, 2026

Add Namespace Range endpoint to streamer (#901)

cab0937

* Add Namespace Range enpoint to streamer * fix tests * fix lint * fix comment * address bot comments * fix lint (cherry picked from commit 20e1206)

Add Namespace Range endpoint to streamer #901

Add Namespace Range endpoint to streamer #901

Uh oh!

Conversation

Sneh1999 commented Jan 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Additional things

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Key Changes

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

ImJeremyHe left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

ImJeremyHe Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

Sneh1999 Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

ImJeremyHe Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

jjeangal Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

Sneh1999 Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

lukeiannucci Jan 9, 2026

Choose a reason for hiding this comment

Uh oh!

Sneh1999 Jan 9, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot commented Jan 9, 2026

Uh oh!

github-actions bot commented Jan 9, 2026

Uh oh!

github-actions bot commented Jan 9, 2026

Uh oh!

github-actions bot commented Jan 9, 2026

Uh oh!

github-actions bot commented Jan 9, 2026

Uh oh!

github-actions bot commented Jan 9, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Sneh1999 commented Jan 7, 2026 •

edited

Loading