### Search before asking - [x] I had searched in the [issues](https://github.com/ray-project/kuberay/issues) and found no similar feature requirement. ### Description Add latency metrics (p95, p99) to `RayDashboardClient` and `RayHttpProxyClient` for improved observability, as proposed by @andrewsykim in this [thread](https://github.com/ray-project/kuberay/pull/4680#pullrequestreview-4091293710). ### Use case Make it easier to debug timeout issues in both Kubernetes proxy mode and direct (non-proxy) mode. ### Related issues Add default timeout for Kubernetes proxy mode: https://github.com/ray-project/kuberay/issues/4679. ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR!
Search before asking
Description
Add latency metrics (p95, p99) to
RayDashboardClientandRayHttpProxyClientfor improved observability, as proposed by @andrewsykim in this thread.Use case
Make it easier to debug timeout issues in both Kubernetes proxy mode and direct (non-proxy) mode.
Related issues
Add default timeout for Kubernetes proxy mode: #4679.
Are you willing to submit a PR?