Dynamic Catalog Loading Forward Fit

[infvg]

Description

Added endpoints to dynamically load catalogs without an engine restart

Motivation and Context

Previously, catalogs would only be loaded while the engine is starting.

Impact

New APIs added:

curl -X POST http://localhost:8001/v1/catalog/tpch_1 \
     -H "X-Presto-Prefix-Url: PREFIX" \
     -H "X-Presto-User: PRESTO_USER" \
     -H "User-Agent: StatementClient/0.55-SNAPSHOT" \
     -H "Content-Type: application/json" \
     -d '{
           "connector.name": "tpch",
           "tpch.splits-per-node": "4"
         }'

curl -v -X GET http://localhost:8001/v1/catalog \
     -H "X-Presto-Prefix-Url: PREFIX" \
     -H "X-Presto-User: PRESTO_USER" \
     -H "User-Agent: StatementClient/0.55-SNAPSHOT" \
     -H "Content-Type: application/json" 

curl -v -X GET http://localhost:8080/v1/catalog/system/status \
     -H "X-Presto-Prefix-Url: PREFIX" \
     -H "X-Presto-User: PRESTO_USER" \
     -H "User-Agent: StatementClient/0.55-SNAPSHOT" \
     -H "Content-Type: application/json"

curl -v -X DELETE http://localhost:8080/v1/catalog/tpch_1 \
     -H "X-Presto-Prefix-Url: PREFIX" \
     -H "X-Presto-User: PRESTO_USER" \
     -H "User-Agent: StatementClient/0.55-SNAPSHOT" \
     -H "Content-Type: application/json"

curl -X PUT http://localhost:8080/v1/catalog/tpch_1 \
     -H "X-Presto-Prefix-Url: PREFIX" \
     -H "X-Presto-User: PRESTO_USER" \
     -H "User-Agent: StatementClient/0.55-SNAPSHOT" \
     -H "Content-Type: application/json" \
     -d '{
           "connector.name": "tpch",
           "tpch.splits-per-node": "4"
         }'

Test Plan

Added test cases

Contributor checklist

• Please make sure your submission complies with our contributing guide, in particular code style and commit standards.
• PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
• Documented new properties (with its default value), SQL syntax, functions, or other functionality.
• If release notes are required, they follow the release notes guidelines.
• Adequate tests were added if applicable.
• CI passed.

Release Notes

Please follow release notes guidelines and fill in the release notes below.

== RELEASE NOTES ==

General Changes
* Add endpoints that can dynamically load catalogs

Hive Connector Changes
* Fix for configurations leaks using class loader isolation for Hive connector instances

[steveburnett]

Thanks for the doc! Looks good. Some nits of punctuation and phrasing suggestions for consistency.

[steveburnett]

LGTM! (docs)

Pull updated branch, new local doc build, looks good. Thanks!

[ethanyzhang]

@aaneja This may have some similar issues like the internal open lineage changes, can you help take a first pass?