-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix for select query failure in presto-bigquery #23957
Conversation
|
1ba3170
to
1341202
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For context, can you please share the dependency tree before and after this change?
Also, to confirm, the only class that was causing the issue was CallCredentials2?
@imjalpreet Please see the dependency tree before and after the fix Presto <grpc.version>1.64.0</grpc.version> was updated. The issue was java.lang.NoClassDefFoundError: io/grpc/CallCredentials2 as CallCredentials2.java was removed from the grpc-api:1.64.0 version. In presto-bigquery below grpc dependencies are of an older version.So we tried updating them as well to 1.64.0 |
Suggest revising the release note entry as follows:
|
@steveburnett Updated the release note entry as suggested. |
Yes, it was removed after ~ 1.41.x.
Yes thanks, just wanted to confirm the same from the dependency tree. |
presto-bigquery/pom.xml
Outdated
@@ -358,6 +376,9 @@ | |||
<exclude>com.fasterxml.jackson.core:jackson-core</exclude> | |||
<exclude>javax.annotation:javax.annotation-api</exclude> | |||
<exclude>com.fasterxml.jackson.core:jackson-databind</exclude> | |||
<exclude>com.google.auth:google-auth-library-oauth2-http</exclude> | |||
<exclude>com.google.auth:google-auth-library-credentials</exclude> | |||
<exclude>org.conscrypt:conscrypt-openjdk-uber</exclude> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this a new transitive dependency due to the version upgrade? Is it also included in Presto as part of any other dependency?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@imjalpreet Added those exclusion to resolve Require upper bound dependencies error in bigquery pom.xml . Those were included in Presto as part of other dependency.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you please share the error we saw when we didn't exclude it? I am curious since I can see the same dependency in both the dependency trees.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@imjalpreet Please see the above log file.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@nishithakbhaskaran Thank you for sharing the logs. Can we assess how complex it would be to fix these errors instead of simply excluding them from the check?
Let's try upgrading all three components to their latest required versions based on the error log and see if any new issues arise.
Upgrade com.google.auth:google-auth-library-oauth2-http
to 1.22.0
Add com.google.auth:google-auth-library-credentials
to dependencyManagement with version 1.22.0
Add org.conscrypt:conscrypt-openjdk-uber
to dependencyManagement with version 2.5.2
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@imjalpreet I have updated the same as suggested, but after that it shows lot more dependency with Require upper bound dependencies error in the bigquery pom.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @imjalpreet @tdcmeehan Addressed the comments. Along with that I need to handle some other upperbound dependency failures in the dependencymanagement tag.
1341202
to
c044eba
Compare
3f48dea
to
b91cd5b
Compare
fd45aac
to
a73cbd9
Compare
a73cbd9
to
d51027a
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@nishithakbhaskaran Thanks for the changes! LGTM now.
I just want to confirm if we tested the SELECT query with BigQuery after making these final changes.
@imjalpreet Sure, I have verified the select query after the changes and it is working as expected.
|
d51027a
to
dca4893
Compare
Description
Fix for select query failure in presto-bigquery
Motivation and Context
#23951
Impact
Test Plan
Tested the fix and the select query works fine.

Contributor checklist
Release Notes
Please follow release notes guidelines and fill in the release notes below.