Hi Team,
I’m currently exploring the integration of the Great Expectations library with Databricks Serverless Compute. While setting up the DataContext, I configured the stores as follows:
python
return {
"class_name": "ExpectationsStore",
"store_backend": { "class_name": "TupleS3StoreBackend", "bucket": bucket_name, },
}
This configuration works as expected on Databricks Classic Compute. However, when executing the same code on Serverless Compute, I encounter an error stating: "Unable to locate credentials."
Could you please confirm if Great Expectations supports Databricks service credentials by default when running on Serverless Compute? If not, are there any recommended approaches or workarounds to enable this?