ipv6 and memberlist issue #4441
Description
Describe the bug
A clear and concise description of what the bug is.
We installed pyroscope on EKS 1.31 but pyroscope components are getting CrashLoopBackOff and in our cluster supporting only ipv6 .
Logs from the pod:
compactor:
failed to create memberlist: Failed to get final advertise address: no private IP address found, and explicit IP not provided"
caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::1f]:7946: dial tcp [2602:fb10:90:3:ab24::1f]:7946: connect: connection refused"
distributor:
failed running pyroscope: error initialising module: distributor: failed to build distributors' lifecycler config: no useable address found for interfaces [eth0 en0]
To Reproduce
Steps to reproduce the behavior:
Install pyroscope on EKS cluster using helm chart or deploy using value.yaml file:
Expected behavior
The chart is installed successfully, and all pods are runninh
A clear and concise description of what you expected to happen.
Environment
EKS 1.31
pyroscope 1.4.1
Chart version: latest
using helm chart
Additional Context
we are using memberlist and cluster support is only for ipv6.
And using s3 bucket for storage not minio
Tried below charts value both didnt work
- repoURL: https://grafana.github.io/pyroscope
chart: operations/pyroscope/helm/pyroscope
targetRevision: 1.14.1
- repoURL: https://grafana.github.io/helm-charts
chart: pyroscope
targetRevision: 1.14.1
compactor:
1758100890227 2025/09/17 09:21:30 maxprocs: Updating GOMAXPROCS=1: using minimum allowed GOMAXPROCS
1758100890499
1758100890499 / _|
1758100890499 __ _ _ __ __ | | __ _ _ __ __ _ _ __ _ _ _ __ ___ ___ ___ ___ _ __ ___
1758100890499 / _' | '/ _' | _/ ' | ' \ / ' | | ' | | | | '/ _ / __|/ _/ _ | ' \ / _ \
1758100890499 | (| | | | (| | || (| | | | | (| | | |) | || | | | () _ \ (| () | |_) | __/
1758100890499 _, || _,|| _,|| ||_,| | .__/ _, || _/|/__/| ./ _|
1758100890499 __/ | | | __/ | | |
1758100890499 |/ || |/ ||
1758100890499
1758100890688 ts=2025-09-17T09:21:30.500974053Z caller=server.go:353 level=info msg="server listening on addresses" http=[::]:4040 grpc=[::]:9095
1758100890688 ts=2025-09-17T09:21:30.504074301Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/admin auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.507513265Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/api/swagger.json auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.507572636Z caller=api.go:110 level=debug msg="api: registering route" methods=GET,POST,PUT,DELETE,HEAD,OPTIONS prefix=/api auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.507595756Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.507638387Z caller=api.go:110 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.58784609Z caller=api.go:110 level=debug msg="api: registering route" methods=GET prefix=/ui auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.587896681Z caller=api.go:110 level=debug msg="api: registering route" methods=GET prefix=/assets/ auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.588030393Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.588075274Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/api/v1/tenant_limits auth=true gzip=true
1758100890688 ts=2025-09-17T09:21:30.588681493Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.589569847Z caller=api.go:104 level=debug msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.58979682Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/ready auth=false gzip=false
1758100890688 ts=2025-09-17T09:21:30.589987013Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.590005193Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/explore auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.590029444Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/comparison auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.590053554Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/comparison-diff auth=false gzip=true
1758100890688 ts=2025-09-17T09:21:30.590127945Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=compactor waiting_for=memberlist-kv
1758100890688 ts=2025-09-17T09:21:30.590329648Z caller=module_service.go:82 level=info msg=starting module=server
1758100890688 ts=2025-09-17T09:21:30.590487231Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=runtime-config waiting_for=server
1758100890688 ts=2025-09-17T09:21:30.590509571Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=memberlist-kv waiting_for=server
1758100890688 ts=2025-09-17T09:21:30.590527952Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=usage-stats waiting_for=memberlist-kv
1758100890688 ts=2025-09-17T09:21:30.591187342Z caller=module_service.go:82 level=info msg=starting module=memberlist-kv
1758100890688 ts=2025-09-17T09:21:30.591575948Z caller=module_service.go:82 level=info msg=starting module=runtime-config
1758100890688 ts=2025-09-17T09:21:30.592325959Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=usage-stats waiting_for=server
1758100890688 ts=2025-09-17T09:21:30.5923719Z caller=module_service.go:82 level=info msg=starting module=usage-stats
1758100890688 ts=2025-09-17T09:21:30.593510398Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=compactor waiting_for=runtime-config
1758100890688 ts=2025-09-17T09:21:30.593535068Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=compactor waiting_for=server
1758100890688 ts=2025-09-17T09:21:30.593546048Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=compactor waiting_for=usage-stats
1758100890688 ts=2025-09-17T09:21:30.593994125Z caller=module_service.go:82 level=info msg=starting module=compactor
1758100890688 ts=2025-09-17T09:21:30.595005851Z caller=netutil.go:85 level=debug component=compactor component=compactor msg="looking for addresses" inf="[eth0 en0]" inet6enabled=false
1758100890688 ts=2025-09-17T09:21:30.595254355Z caller=netutil.go:102 level=debug component=compactor component=compactor msg="detected highest quality address" ipAddr="invalid IP" inf=eth0
1758100890688 ts=2025-09-17T09:21:30.595269895Z caller=netutil.go:104 level=debug component=compactor component=compactor msg="ignoring address" ipAddr="invalid IP" inf=eth0
1758100890688 ts=2025-09-17T09:21:30.595390247Z caller=netutil.go:90 level=warn component=compactor component=compactor msg="error getting addresses for interface" inf=en0 err="route ip+net: no such network interface"
1758100890688 ts=2025-09-17T09:21:30.595409307Z caller=netutil.go:118 level=debug component=compactor component=compactor msg="detected IP address after looking up all configured interface names" ipAddr="invalid IP"
1758100890688 ts=2025-09-17T09:21:30.595482018Z caller=phlare.go:630 level=error msg="module failed" module=compactor error="starting module compactor: invalid service state: Failed, expected: Running, failure: failed to build compactors' lifecycler config: no useable address found for interfaces [eth0 en0]"
1758100890688 ts=2025-09-17T09:21:30.595503298Z caller=module_service.go:133 level=debug msg="module waiting for" module=usage-stats waiting_for=compactor
1758100890688 ts=2025-09-17T09:21:30.595514009Z caller=module_service.go:110 level=debug msg=stopping module=usage-stats
1758100890688 ts=2025-09-17T09:21:30.595693071Z caller=memberlist_client.go:435 level=info msg="Using memberlist cluster label and node name" cluster_label=grafana-pyroscope-pyroscope-dev node=pyroscope-dev-compactor-0-1667b010
1758100890688 ts=2025-09-17T09:21:30.595724952Z caller=log.go:245 level=debug msg="configured Transport is not a NodeAwareTransport and some features may not work as desired"
1758100890688 ts=2025-09-17T09:21:30.595861814Z caller=netutil.go:85 level=debug component="memberlist TCPTransport" msg="looking for addresses" inf="[lo eth0 v4if0]" inet6enabled=true
1758100890688 ts=2025-09-17T09:21:30.596123398Z caller=netutil.go:102 level=debug component="memberlist TCPTransport" msg="detected highest quality address" ipAddr="invalid IP" inf=lo
1758100890688 ts=2025-09-17T09:21:30.596137588Z caller=netutil.go:104 level=debug component="memberlist TCPTransport" msg="ignoring address" ipAddr="invalid IP" inf=lo
1758100890688 ts=2025-09-17T09:21:30.596326121Z caller=netutil.go:102 level=debug component="memberlist TCPTransport" msg="detected highest quality address" ipAddr=2602:fb10:90:4:a84f::b inf=eth0
1758100890688 ts=2025-09-17T09:21:30.596341611Z caller=tcp_transport.go:405 level=debug component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=2602:fb10:90:4:a84f::b advertisePort=7946
1758100890688 ts=2025-09-17T09:21:30.596529354Z caller=netutil.go:85 level=debug component="memberlist TCPTransport" msg="looking for addresses" inf="[lo eth0 v4if0]" inet6enabled=true
1758100890688 ts=2025-09-17T09:21:30.596774988Z caller=netutil.go:102 level=debug component="memberlist TCPTransport" msg="detected highest quality address" ipAddr="invalid IP" inf=lo
1758100890688 ts=2025-09-17T09:21:30.596789958Z caller=netutil.go:104 level=debug component="memberlist TCPTransport" msg="ignoring address" ipAddr="invalid IP" inf=lo
1758100890688 ts=2025-09-17T09:21:30.596967781Z caller=netutil.go:102 level=debug component="memberlist TCPTransport" msg="detected highest quality address" ipAddr=2602:fb10:90:4:a84f::b inf=eth0
1758100890688 ts=2025-09-17T09:21:30.596985051Z caller=tcp_transport.go:405 level=debug component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=2602:fb10:90:4:a84f::b advertisePort=7946
1758100890688 ts=2025-09-17T09:21:30.597276406Z caller=log.go:245 level=warn msg="Binding to public address without encryption!"
1758100890688 ts=2025-09-17T09:21:30.598652147Z caller=module_service.go:133 level=debug msg="module waiting for" module=server waiting_for=usage-stats
1758100890688 ts=2025-09-17T09:21:30.598721828Z caller=module_service.go:133 level=debug msg="module waiting for" module=runtime-config waiting_for=compactor
1758100890688 ts=2025-09-17T09:21:30.598744549Z caller=module_service.go:110 level=debug msg=stopping module=runtime-config
1758100890688 ts=2025-09-17T09:21:30.598770869Z caller=module_service.go:120 level=info msg="module stopped" module=runtime-config
1758100890688 ts=2025-09-17T09:21:30.59880802Z caller=module_service.go:133 level=debug msg="module waiting for" module=memberlist-kv waiting_for=usage-stats
1758100890688 ts=2025-09-17T09:21:30.604075942Z caller=memberlist_client.go:541 level=info msg="memberlist fast-join starting" nodes_found=13 to_join=8
1758100890688 ts=2025-09-17T09:21:30.605228749Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::b]:7946: dial tcp [2602:fb10:90:3:ab24::b]:7946: connect: connection refused"
1758100890688 ts=2025-09-17T09:21:30.60524933Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::b]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::b]:7946: dial tcp [2602:fb10:90:3:ab24::b]:7946: connect: connection refused\n\n"
1758100890688 ts=2025-09-17T09:21:30.606289586Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::1a]:7946: dial tcp [2602:fb10:90:3:ab24::1a]:7946: connect: connection refused"
1758100890688 ts=2025-09-17T09:21:30.606303386Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::1a]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::1a]:7946: dial tcp [2602:fb10:90:3:ab24::1a]:7946: connect: connection refused\n\n"
1758100890688 ts=2025-09-17T09:21:30.607308722Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::8]:7946: dial tcp [2602:fb10:90:3:ab24::8]:7946: connect: connection refused"
1758100890688 ts=2025-09-17T09:21:30.607320902Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::8]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::8]:7946: dial tcp [2602:fb10:90:3:ab24::8]:7946: connect: connection refused\n\n"
1758100890688 ts=2025-09-17T09:21:30.608316237Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::f]:7946: dial tcp [2602:fb10:90:3:ab24::f]:7946: connect: connection refused"
1758100890688 ts=2025-09-17T09:21:30.608327708Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::f]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::f]:7946: dial tcp [2602:fb10:90:3:ab24::f]:7946: connect: connection refused\n\n"
1758100890688 ts=2025-09-17T09:21:30.609339633Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::11]:7946: dial tcp [2602:fb10:90:3:ab24::11]:7946: connect: connection refused"
1758100890688 ts=2025-09-17T09:21:30.609350863Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::11]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::11]:7946: dial tcp [2602:fb10:90:3:ab24::11]:7946: connect: connection refused\n\n"
1758100890688 ts=2025-09-17T09:21:30.609530446Z caller=log.go:245 level=debug msg="Initiating push/pull sync with: [2602:fb10:90:4:a84f::b]:7946"
1758100890688 ts=2025-09-17T09:21:30.609824651Z caller=log.go:245 level=debug msg="Stream connection from=[2602:fb10:90:4:a84f::b]:49148"
1758100890788 ts=2025-09-17T09:21:30.688117763Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::d]:7946: dial tcp [2602:fb10:90:3:ab24::d]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.688147174Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::d]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::d]:7946: dial tcp [2602:fb10:90:3:ab24::d]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.688717113Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:4:a84f::15]:7946: dial tcp [2602:fb10:90:4:a84f::15]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.688730233Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:4:a84f::15]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:4:a84f::15]:7946: dial tcp [2602:fb10:90:4:a84f::15]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.689866781Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::18]:7946: dial tcp [2602:fb10:90:3:ab24::18]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.689880491Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::18]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::18]:7946: dial tcp [2602:fb10:90:3:ab24::18]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.690071894Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:4:a84f::1b]:7946: dial tcp [2602:fb10:90:4:a84f::1b]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.690096494Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:4:a84f::1b]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:4:a84f::1b]:7946: dial tcp [2602:fb10:90:4:a84f::1b]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.691170871Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::16]:7946: dial tcp [2602:fb10:90:3:ab24::16]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.691185361Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::16]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::16]:7946: dial tcp [2602:fb10:90:3:ab24::16]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.692212467Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::1f]:7946: dial tcp [2602:fb10:90:3:ab24::1f]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.692227007Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::1f]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::1f]:7946: dial tcp [2602:fb10:90:3:ab24::1f]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.693243613Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::10]:7946: dial tcp [2602:fb10:90:3:ab24::10]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.693260473Z caller=memberlist_client.go:547 level=debug msg="fast-joining node failed" node=[2602:fb10:90:3:ab24::10]:7946 err="1 error occurred:\n\t* Failed to join [2602:fb10:90:3:ab24::10]:7946: dial tcp [2602:fb10:90:3:ab24::10]:7946: connect: connection refused\n\n"
1758100890788 ts=2025-09-17T09:21:30.693275154Z caller=memberlist_client.go:561 level=info msg="memberlist fast-join finished" joined_nodes=1 elapsed_time=95.868226ms
1758100890788 ts=2025-09-17T09:21:30.693297694Z caller=memberlist_client.go:573 level=info phase=startup msg="joining memberlist cluster" join_members=dns+pyroscope-dev-memberlist.grafana-pyroscope.svc.cluster.local.:7946
1758100890788 ts=2025-09-17T09:21:30.69561545Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:4:a84f::1b]:7946: dial tcp [2602:fb10:90:4:a84f::1b]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.69624905Z caller=log.go:245 level=debug msg="Initiating push/pull sync with: [2602:fb10:90:4:a84f::b]:7946"
1758100890788 ts=2025-09-17T09:21:30.696470173Z caller=log.go:245 level=debug msg="Stream connection from=[2602:fb10:90:4:a84f::b]:49164"
1758100890788 ts=2025-09-17T09:21:30.696928381Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:4:a84f::15]:7946: dial tcp [2602:fb10:90:4:a84f::15]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.698042548Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::1a]:7946: dial tcp [2602:fb10:90:3:ab24::1a]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.699044103Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::f]:7946: dial tcp [2602:fb10:90:3:ab24::f]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.700039699Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::b]:7946: dial tcp [2602:fb10:90:3:ab24::b]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.701082735Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::d]:7946: dial tcp [2602:fb10:90:3:ab24::d]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.70209352Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::16]:7946: dial tcp [2602:fb10:90:3:ab24::16]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.712750576Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::11]:7946: dial tcp [2602:fb10:90:3:ab24::11]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.713811352Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::8]:7946: dial tcp [2602:fb10:90:3:ab24::8]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.714801748Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::18]:7946: dial tcp [2602:fb10:90:3:ab24::18]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.715832404Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::1f]:7946: dial tcp [2602:fb10:90:3:ab24::1f]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.71686053Z caller=log.go:245 level=debug msg="Failed to join [2602:fb10:90:3:ab24::10]:7946: dial tcp [2602:fb10:90:3:ab24::10]:7946: connect: connection refused"
1758100890788 ts=2025-09-17T09:21:30.71687693Z caller=memberlist_client.go:580 level=info phase=startup msg="joining memberlist cluster succeeded" reached_nodes=1 elapsed_time=23.570166ms
1758100890789 ts=2025-09-17T09:21:30.788555891Z caller=reporter.go:201 level=debug msg="failed to read cluster seed file" err="Get "https://us-east-1-infra-dev-pyroscope.s3.dualstack.us-east-1.amazonaws.com/pyroscope_cluster_seed.json\": context canceled"
1758100890789 ts=2025-09-17T09:21:30.788603351Z caller=module_service.go:120 level=info msg="module stopped" module=usage-stats
1758100890789 ts=2025-09-17T09:21:30.788628312Z caller=module_service.go:133 level=debug msg="module waiting for" module=memberlist-kv waiting_for=compactor
1758100890789 ts=2025-09-17T09:21:30.788643902Z caller=module_service.go:110 level=debug msg=stopping module=memberlist-kv
1758100890789 ts=2025-09-17T09:21:30.788671102Z caller=memberlist_client.go:720 level=info msg="leaving memberlist cluster"
1758100890789 ts=2025-09-17T09:21:30.788804814Z caller=module_service.go:120 level=info msg="module stopped" module=memberlist-kv
1758100890789 ts=2025-09-17T09:21:30.788822135Z caller=module_service.go:133 level=debug msg="module waiting for" module=server waiting_for=compactor
1758100890789 ts=2025-09-17T09:21:30.788835975Z caller=module_service.go:133 level=debug msg="module waiting for" module=server waiting_for=memberlist-kv
1758100890789 ts=2025-09-17T09:21:30.788843635Z caller=module_service.go:133 level=debug msg="module waiting for" module=server waiting_for=runtime-config
1758100890789 ts=2025-09-17T09:21:30.788860635Z caller=module_service.go:110 level=debug msg=stopping module=server
1758100890789 ts=2025-09-17T09:21:30.789089989Z caller=modules.go:816 level=info msg="server stopped"
1758100890789 ts=2025-09-17T09:21:30.789105489Z caller=module_service.go:120 level=info msg="module stopped" module=server
1758100890789 ts=2025-09-17T09:21:30.789120289Z caller=phlare.go:738 level=info msg="Pyroscope stopped"
1758100890789 failed running pyroscope: failed services
distributor:
| | 2025-09-17 14:35:45.993 | |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:45.995605035Z caller=server.go:353 level=info msg="server listening on addresses" http=[::]:4040 grpc=[::]:9095 |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.000031233Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/admin auth=false gzip=true |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.089516514Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/api/swagger.json auth=false gzip=true |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.089596436Z caller=api.go:110 level=debug msg="api: registering route" methods=GET,POST,PUT,DELETE,HEAD,OPTIONS prefix=/api auth=false gzip=true |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.089619596Z caller=api.go:104 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.089645156Z caller=api.go:110 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.089663317Z caller=api.go:110 level=debug msg="api: registering route" methods=GET prefix=/ui auth=false gzip=true |
| | 2025-09-17 14:35:46.089 | ts=2025-09-17T09:05:46.089676147Z caller=api.go:110 level=debug msg="api: registering route" methods=GET prefix=/assets/ auth=false gzip=true |
| | 2025-09-17 14:35:46.092 | failed running pyroscope: error initialising module: distributor: failed to build distributors' lifecycler config: no useable address found for interfaces [eth0 en0] |
| | 2025-09-17 14:38:59.878 | 2025/09/17 09:08:59 maxprocs: Updating GOMAXPROCS=1: using minimum allowed GOMAXPROCS |
pls look into this