Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spline server multitenancy #1399

Closed
wajda opened this issue Feb 3, 2025 · 1 comment
Closed

Spline server multitenancy #1399

wajda opened this issue Feb 3, 2025 · 1 comment

Comments

@wajda
Copy link
Contributor

wajda commented Feb 3, 2025

About the name of arangoDB- What i want is the on the spark config
to put for each customer different url
for example:

Customer 1:

spark.jars=hdfs:///tmp/spark-2.4-spline-agent-bundle_2.11-2.2.1.jar 
spark.sql.queryExecutionListeners=za.co.absa.spline.harvester.listener.SplineQueryExecutionListener
spark.spline.lineageDispatcher.http.producer.url=https://customer1.spline.octopai.com/producer

this will report lineage to DB Customer1

Customer2:

spark.jars=hdfs:///tmp/spark-2.4-spline-agent-bundle_2.11-2.2.1.jar 
spark.sql.queryExecutionListeners=za.co.absa.spline.harvester.listener.SplineQueryExecutionListener
spark.spline.lineageDispatcher.http.producer.url=https://customer2.spline.octopai.com/producer

this will report lineage to DB Customer2

But the 2 DBs will be on same server not diffrerent container/server

Is this something that can be done programiclly or by configuration?

Originally posted by @zacaydcloudera in #857

@wajda wajda transferred this issue from AbsaOSS/spline-spark-agent Feb 3, 2025
@wajda
Copy link
Contributor Author

wajda commented Feb 3, 2025

Not possible.
Spline server is single-tenant. You have to have a separate Spline server per customer to achieve your use-case.

@AbsaOSS AbsaOSS locked and limited conversation to collaborators Feb 3, 2025
@wajda wajda converted this issue into discussion #1400 Feb 3, 2025
@github-project-automation github-project-automation bot moved this from New to Done in Spline Feb 3, 2025

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
None yet
Projects
Status: Done
Development

No branches or pull requests

1 participant