Could not send spans over gRPC #3784
andreacoccodi
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi all,
I'm running the jaeger-operator helm chart (tried 1.29.0 and 1.32.2) in azure aks with k8s v1.22.6 with istio v1.13.2 and started seeing that error a few months ago after my colleagues raised an issue related to missing spans in elasticsearch.
The jaeger-agents send spans to the jaeger-collector-headless service on port 14250, which in the k8s service is called grpc-http. What seems to be happening is that istio is interpreting that traffic as http instead of http2, which causes the error "Could not send spans over gRPC".
If I manually change the port name to http2-grpc that error goes away, I'm assuming because istio will use the "http2" bit of "http2-grpc" as protocol, as mentioned here https://istio.io/latest/docs/ops/configuration/traffic-management/protocol-selection/.
It's basically what's mentioned here jaegertracing/jaeger-operator#1360, except that all ports but the grpc one are following the protocol-suffix pattern.
Is anyone else seeing this problem?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions