Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable TNU to use Azure auth for DRS operations #399 #401

Merged
merged 11 commits into from
Jan 25, 2023

Conversation

mbaumann-broad
Copy link
Collaborator

@mbaumann-broad mbaumann-broad commented Jan 17, 2023

For a description of the change, see: #399

Status

  • All intended functionality implemented and working as expected
  • Automated tests updated and passing
  • README updated
  • Completed final review
  • Ready to merge and release!

@mbaumann-broad mbaumann-broad linked an issue Jan 17, 2023 that may be closed by this pull request
@mbaumann-broad mbaumann-broad force-pushed the mbaumann-issue-399-add-drs-azure-auth branch from 963a76c to 621e3b6 Compare January 17, 2023 08:15
Copy link

@rtitle rtitle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. I like the tagging of execution_platform and execution_context.

Were you able to test in a real Azure workspace notebook against an Azure DRS URL? It looks like there is still some GCP-specific logic in drs.py (such as checking requester-pays, and trying to resolve the file a GCS object if the signed url doesn't work). But hopefully the auth piece is enough to simply make it work for Azure signed URLs.

Copy link

@nmalfroy nmalfroy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple of thoughts but overall looks good!

terra_notebook_utils/azure_auth.py Show resolved Hide resolved
terra_notebook_utils/drs.py Outdated Show resolved Hide resolved
terra_notebook_utils/terra_auth.py Show resolved Hide resolved
terra_notebook_utils/utils.py Outdated Show resolved Hide resolved
Michael Baumann added 4 commits January 19, 2023 05:02
Add support for using Microsoft Azure default credentials
when running in a Terra Azure Interactive Analysis Cloud Environment.
These credentials are used to auth with Terra backend services,
including Martha/terra-drs-hub and Rawls.

When running in a Terra Google IA Cloud Environment,
the behavior is as before, with no changes.

This initial implementation is thought to be functionally complete,
yet tests and documentation remain to be added.
Currently, there is not enough reliable information available
to accurately determine the execution environment and
execution platform. Until that is available, change
get_execution_context to provide better values for
the most common cases.
@mbaumann-broad mbaumann-broad force-pushed the mbaumann-issue-399-add-drs-azure-auth branch from 11756a3 to 37e4018 Compare January 19, 2023 13:07
Copy link

@nmalfroy nmalfroy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me!

@mbaumann-broad mbaumann-broad changed the title Enable TNU to use Azure auth for DRS operations #399 - DRAFT Enable TNU to use Azure auth for DRS operations #399 Jan 24, 2023
Copy link
Member

@DailyDreaming DailyDreaming left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, this looks good and I'd be fine merging it as is. I included some comments (only nits though).

terra_notebook_utils/azure_auth.py Outdated Show resolved Hide resolved
terra_notebook_utils/terra_auth.py Outdated Show resolved Hide resolved
terra_notebook_utils/__init__.py Outdated Show resolved Hide resolved
Copy link

@nmalfroy nmalfroy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making all of the extra changes!

@mbaumann-broad mbaumann-broad merged commit 68b7888 into master Jan 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enable TNU to use Azure auth for DRS operations
4 participants