Skip to content

Issue with Great Expectations Store Configuration on Databricks Serverless Compute #11503

@Mutharasu84

Description

@Mutharasu84

Hi Team,
I’m currently exploring the integration of the Great Expectations library with Databricks Serverless Compute. While setting up the DataContext, I configured the stores as follows:
python
return {
"class_name": "ExpectationsStore",
"store_backend": { "class_name": "TupleS3StoreBackend", "bucket": bucket_name, },
}

This configuration works as expected on Databricks Classic Compute. However, when executing the same code on Serverless Compute, I encounter an error stating: "Unable to locate credentials."
Could you please confirm if Great Expectations supports Databricks service credentials by default when running on Serverless Compute? If not, are there any recommended approaches or workarounds to enable this?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions