From 6b11480b27e4a344cb61f79bbb2b1689371deb1e Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Wed, 8 Jan 2025 17:34:51 +0530 Subject: [PATCH 01/26] Create watsonx-presto-config.md --- .../resource-configs/watsonx-presto-config.md | 113 ++++++++++++++++++ 1 file changed, 113 insertions(+) create mode 100644 website/docs/reference/resource-configs/watsonx-presto-config.md diff --git a/website/docs/reference/resource-configs/watsonx-presto-config.md b/website/docs/reference/resource-configs/watsonx-presto-config.md new file mode 100644 index 00000000000..42111a2fb47 --- /dev/null +++ b/website/docs/reference/resource-configs/watsonx-presto-config.md @@ -0,0 +1,113 @@ +--- +title: "IBM watsonx.data Presto configurations" +id: "watsonx-presto-configs" +--- + +## Instance requirements + +To use IBM watsonx.data Presto(java) with dbt, ensure the instance has an attached catalog that allows creating, renaming, altering, and dropping objects such as tables and views. The user connecting to the instance with dbt must have equivalent permissions for the target catalog. + +## Session properties + +With IBM watsonx.data SaaS/Software, or Presto instance, you can [set session properties](https://prestodb.io/docs/current/sql/set-session.html) to modify the current configuration for your user session. + +To temporarily adjust session properties for a specific dbt model or a group of models, use a [dbt hook](/reference/resource-configs/pre-hook-post-hook). For example: + +```sql +{{ + config( + pre_hook="set session query_max_run_time='10m'" + ) +}} +``` + +## Connector properties + +IBM watsonx.data SaaS/Software and Presto support various connector properties to manage how your data is represented. These properties are particularly useful for file-based connectors like Hive. + +For information on what is supported for each data source, refer to one of the following resources: +- [Presto Connectors](https://prestodb.io/docs/current/connector.html) +- [watsonx.data SaaS Catalog](https://cloud.ibm.com/docs/watsonxdata?topic=watsonxdata-reg_database) +- [watsonx.data Software Catalog](https://www.ibm.com/docs/en/watsonx/watsonxdata/1.1.x?topic=components-adding-database-catalog-pair) + + +### Hive catalogs + +When using the Hive connector, ensure the following settings are configured. These settings are crucial for enabling frequently executed operations like `DROP` and `RENAME` in dbt: + +```java +hive.metastore-cache-ttl=0s +hive.metastore-refresh-interval=5s +hive.allow-drop-table=true +hive.allow-rename-table=true + +``` + +## File format configuration + +For file-based connectors, such as Hive, you can customize table materialization and data formats. For example, to create a partitioned [Parquet](https://spark.apache.org/docs/latest/sql-data-sources-parquet.html) table: + +```sql +{{ + config( + materialized='table', + properties={ + "format": "'PARQUET'", + "partitioning": "ARRAY['bucket(id, 2)']", + } + ) +}} +``` + +## Seeds and prepared statements +The `dbt-watsonx-presto` adapter offers comprehensive support for all [Presto datatypes](https://prestodb.io/docs/current/language/types.html) and [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. However, to utilize this feature, you need to explicitly define the data types for each column in the `dbt_project.yml` file. + +To configure column data types, update your `/dbt_project.yml` file as follows: + +```sh +seeds: + : + : + +column_types: + : + : +``` +This ensures that dbt correctly interprets and applies the specified data types when loading seed data into your watsonx.data Presto instances. + + +## Materializations +### Table + +The `dbt-watsonx-presto` adapter helps you create and update tables through table materialization, making it easier to work with data in watsonx.data Presto. + +#### Recommendations +- **Check Permissions:** Ensure that the necessary permissions for table creation are enabled in the catalog or schema. +- **Check Connector Documentation:** Review Presto [connector’s documentation](https://prestodb.io/docs/current/connector.html) or watsonx.data Presto [sql statement support](https://www.ibm.com/support/pages/node/7157339) to ensure it supports table creation and modification. + +#### Limitations with Some Connectors +Certain watsonx.data Presto connectors, particularly read-only ones or those with restricted permissions, do not allow creating or modifying tables. If you attempt to use table materialization with these connectors, you may encounter an error like: + +```sh +PrestoUserError(type=USER_ERROR, name=NOT_SUPPORTED, message="This connector does not support creating tables with data", query_id=20241206_071536_00026_am48r) +``` + +### View + +The `dbt-watsonx-presto` adapter supports creating views using the `materialized='view'` configuration in your dbt model. By default, when you set the materialization to view, it creates a view in watsonx.data Presto. + +```sql +{{ + config( + materialized='view', + ) +}} +``` + +For more details, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339) or Presto [connector documentation](https://prestodb.io/docs/current/connector.html) to verify whether your connector supports view creation. + + +### Unsupported Features +The following features are not supported by the `dbt-watsonx-presto` adapter +- Incremental Materialization +- Materialized Views +- Snapshots From f0a76761fdae341c7ad6ee0e796ed241f8d86432 Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Wed, 8 Jan 2025 17:47:46 +0530 Subject: [PATCH 02/26] Create watsonx-presto-setup.md --- .../watsonx-presto-setup.md | 105 ++++++++++++++++++ 1 file changed, 105 insertions(+) create mode 100644 website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md new file mode 100644 index 00000000000..6bf4ca61a2b --- /dev/null +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -0,0 +1,105 @@ +--- +title: "IBM watsonx.data Presto setup" +description: "Read this guide to learn about the IBM watsonx.data Presto setup in dbt." +id: "watsonx-presto setup" +meta: + maintained_by: IBM + authors: Karnati Naga Vivek, Hariharan Ashokan, Biju Palliyath, Gopikrishnan Varadarajulu, Rohan Pednekar + github_repo: 'IBM/dbt-watsonx-presto' + pypi_package: 'dbt-watsonx-presto' + min_core_version: v1.8.0 + cloud_support: 'Not Supported' + min_supported_version: 'n/a' + slack_channel_name: + slack_channel_link: + platform_name: IBM watsonx.data + config_page: /reference/resource-configs/watsonx-presto-config +--- + +The dbt-watsonx-presto adapter allows you to use dbt to transform and manage data on IBM watsonx.data Presto(Java), leveraging its distributed SQL query engine capabilities. The configuration and connection setup described here are also applicable to open-source Presto. Before proceeding, ensure you have the following: +
    +
  • An active IBM watsonx.data Presto(Java) Engine with connection details (host, port, catalog, schema) in SaaS/Software.
  • +
  • Authentication Credentials: Username and password/apikey.
  • +
  • For watsonx.data instances, SSL verification is required for secure connections. If the instance host uses HTTPS, there is no need to specify the SSL certificate parameter. However, if the instance host uses an unsecured HTTP connection, ensure you provide the path to the SSL certificate file.
  • +
+Refer to the Configuring dbt-watsonx-presto section for guidance on obtaining and organizing these details. + + + + +import SetUpPages from '/snippets/_setup-pages-intro.md'; + + + + +## Connecting to IBM watsonx.data Presto + +To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and Software instances: + + + +```yaml +my_project: + outputs: + software: + type: presto + method: BasicAuth + user: [user] + password: [password] + host: [hostname] + database: [database name] + schema: [your dbt schema] + port: [port number] + threads: [1 or more] + ssl_verify: path/to/certificate + + saas: + type: presto + method: BasicAuth + user: [user] + password: [api_key] + host: [hostname] + database: [database name] + schema: [your dbt schema] + port: [port number] + threads: [1 or more] + + target: software + +``` + + + +## Host parameters + +The following profile fields are required for configuring watsonx.data Presto(java) connections. Currently, it supports only the `BasicAuth` authentication method. For IBM watsonx.data SaaS or Software instances, You can get the hostname and port details by clicking View connect details inside the Presto(java) engine details page. + +| Option | Required/Optional | Description | Example | +| --------- | ------- | ------- | ----------- | +| `method` | Required (default value is none) | Authentication method for Presto | `None` or `BasicAuth` | +| `user` | Required | Username or email for authentication. | `user` | +| `password`| Required (if `method` is `BasicAuth`) | Password or API key for authentication | `password` | +| `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | +| `database`| Required | The catalog name in your presto instance. | `Analytics` | +| `schema` | Required | The schema name within your presto instance catalog. | `my_schema` | +| `port` | Required | Port for connecting to Presto. | `443` | +| ssl_verify | Optional (default: **true**) | Specifies the path to the SSL certificate or a boolean value. The SSL certificate path is required if the watsonx.data instance is not secure (HTTP).| `path/to/certificate` or `true` | + + +### Schemas and databases +When selecting the catalog and the schema, make sure the user has read and write access to both. This selection does not limit your ability to query the catalog. Instead, they serve as the default location for where tables and views are materialized. In addition, the Presto connector used in the catalog must support creating tables. This default can be changed later from within your dbt project. + +### SSL Verification +- If the Presto instance uses an unsecured HTTP connection, you must set `ssl_verify` to the path of the SSL certificate file. +- If the instance uses `HTTPS`, this parameter is not required and can be omitted. + +## Additional parameters + +The following profile fields are optional to set up. They let you configure your instance session and dbt for your connection. + + +| Profile field | Description | Example | +| ----------------------------- | ----------------------------------------------------------------------------------------------------------- | ------------------------------------ | +| `threads` | How many threads dbt should use (default is `1`) | `8` | +| `http_headers` | HTTP headers to send alongside requests to Presto, specified as a yaml dictionary of (header, value) pairs. | `X-Presto-Routing-Group: my-instance` | +| `http_scheme` | The HTTP scheme to use for requests to (default: `http`, or `https` if `BasicAuth`) | `https` or `http` | From cbc72cbd89ef36bc8595c834b24c3aa26f2525b3 Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Thu, 9 Jan 2025 09:41:50 +0530 Subject: [PATCH 03/26] Update sidebars --- website/sidebars.js | 2 ++ 1 file changed, 2 insertions(+) diff --git a/website/sidebars.js b/website/sidebars.js index 3a8f560c297..00850689b31 100644 --- a/website/sidebars.js +++ b/website/sidebars.js @@ -252,6 +252,7 @@ const sidebarSettings = { "docs/core/connect-data-platform/tidb-setup", "docs/core/connect-data-platform/upsolver-setup", "docs/core/connect-data-platform/vertica-setup", + "docs/core/connect-data-platform/watsonx-presto-setup", "docs/core/connect-data-platform/yellowbrick-setup", ], }, @@ -897,6 +898,7 @@ const sidebarSettings = { "reference/resource-configs/teradata-configs", "reference/resource-configs/upsolver-configs", "reference/resource-configs/vertica-configs", + "reference/resource-configs/watsonx-presto-config", "reference/resource-configs/yellowbrick-configs", ], }, From e50f831c69c22f8dbb772f5908b3ae76d8d0c6a5 Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Sat, 11 Jan 2025 09:52:04 +0530 Subject: [PATCH 04/26] Update watsonx-presto-setup --- .../core/connect-data-platform/watsonx-presto-setup.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 6bf4ca61a2b..957a22509ad 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -72,11 +72,15 @@ my_project: ## Host parameters -The following profile fields are required for configuring watsonx.data Presto(java) connections. Currently, it supports only the `BasicAuth` authentication method. For IBM watsonx.data SaaS or Software instances, You can get the hostname and port details by clicking View connect details inside the Presto(java) engine details page. +The following profile fields are required to configure watsonx.data Presto(java) connections. The `method` field determines the authentication type used for the connection: +1. **`none`** : If not specified, the `method` field defaults to `none`, which is used for unauthenticated connections (e.g., for local development of OSS Presto instances). +2. **`BasicAuth`** : For secure connections (e.g., to IBM watsonx.data SaaS or Software instances), you must explicitly set `method: BasicAuth` and provide the corresponding `user` and `password` fields. + +For IBM watsonx.data SaaS or Software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. | Option | Required/Optional | Description | Example | | --------- | ------- | ------- | ----------- | -| `method` | Required (default value is none) | Authentication method for Presto | `None` or `BasicAuth` | +| `method` | Required (default value is none) | Specifies the authentication method for Presto. Use `none` for unauthenticated connections or `BasicAuth` for secure connections. | `None` or `BasicAuth` | | `user` | Required | Username or email for authentication. | `user` | | `password`| Required (if `method` is `BasicAuth`) | Password or API key for authentication | `password` | | `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | From f4ad42fbbc64df9aef4562c8c1eb88b0b21efed7 Mon Sep 17 00:00:00 2001 From: KNagaVivek Date: Wed, 15 Jan 2025 09:25:32 +0530 Subject: [PATCH 05/26] Update watsonx-presto-config --- .../resource-configs/watsonx-presto-config.md | 71 ++++++++++++------- 1 file changed, 44 insertions(+), 27 deletions(-) diff --git a/website/docs/reference/resource-configs/watsonx-presto-config.md b/website/docs/reference/resource-configs/watsonx-presto-config.md index 42111a2fb47..6415a2b6058 100644 --- a/website/docs/reference/resource-configs/watsonx-presto-config.md +++ b/website/docs/reference/resource-configs/watsonx-presto-config.md @@ -5,7 +5,13 @@ id: "watsonx-presto-configs" ## Instance requirements -To use IBM watsonx.data Presto(java) with dbt, ensure the instance has an attached catalog that allows creating, renaming, altering, and dropping objects such as tables and views. The user connecting to the instance with dbt must have equivalent permissions for the target catalog. +To use IBM watsonx.data Presto(java) with `dbt-watsonx-presto` adapter, ensure the instance has an attached catalog that supports creating, renaming, altering, and dropping objects such as tables and views. The user connecting to the instance via the `dbt-watsonx-presto` adapter must have the necessary permissions for the target catalog. + +For detailed setup instructions, including setting up watsonx.data, adding the Presto(Java) engine, configuring storages, registering data sources, and managing permissions, refer to the official IBM documentation: +- watsonx.data Software Documentation: [IBM watsonx.data Software Guide](https://www.ibm.com/docs/en/watsonx/watsonxdata/2.1.x) +- watsonx.data SaaS Documentation: [IBM watsonx.data SaaS Guide](https://cloud.ibm.com/docs/watsonxdata?topic=watsonxdata-getting-started) + + ## Session properties @@ -45,40 +51,59 @@ hive.allow-rename-table=true ## File format configuration -For file-based connectors, such as Hive, you can customize table materialization and data formats. For example, to create a partitioned [Parquet](https://spark.apache.org/docs/latest/sql-data-sources-parquet.html) table: +File-based connectors, such as Hive and Iceberg, allow customization of table materialization, data formats, and partitioning strategies in dbt models. The following examples demonstrate how to configure these options for each connector. + + +### Hive Configuration + +Hive supports specifying file formats and partitioning strategies using the properties parameter in dbt models. The example below demonstrates how to create a partitioned table stored in Parquet format: ```sql {{ config( materialized='table', properties={ - "format": "'PARQUET'", - "partitioning": "ARRAY['bucket(id, 2)']", + "format": "'PARQUET'", -- Specifies the file format + "partitioned_by": "ARRAY['id']", -- Defines the partitioning column(s) } ) }} ``` -## Seeds and prepared statements -The `dbt-watsonx-presto` adapter offers comprehensive support for all [Presto datatypes](https://prestodb.io/docs/current/language/types.html) and [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. However, to utilize this feature, you need to explicitly define the data types for each column in the `dbt_project.yml` file. +For more details about Hive table creation and supported properties, refer to the [Hive connector documentation](https://prestodb.io/docs/current/connector/hive.html#create-a-managed-table). -To configure column data types, update your `/dbt_project.yml` file as follows: +### Iceberg Configuration -```sh -seeds: - : - : - +column_types: - : - : +Iceberg supports defining file formats and advanced partitioning strategies to optimize query performance. The following example demonstrates how to create a ORC table partitioned using a bucketing strategy: + +```sql +{{ + config( + materialized='table', + properties={ + "format": "'ORC'", -- Specifies the file format + "partitioning": "ARRAY['bucket(id, 2)']", -- Defines the partitioning strategy + } + ) +}} ``` -This ensures that dbt correctly interprets and applies the specified data types when loading seed data into your watsonx.data Presto instances. +For more information about Iceberg table creation and supported configurations, refer to the [Iceberg connector documentation](https://prestodb.io/docs/current/connector/iceberg.html#create-table). + + +## Seeds and prepared statements +The `dbt-watsonx-presto` adapter offers comprehensive support for all [Presto datatypes](https://prestodb.io/docs/current/language/types.html) and [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. To leverage this functionality, you must explicitly define the data types for each column. + +You can configure column data types either in the dbt_project.yml file or in property files, as supported by dbt. For more details on seed configuration and best practices, refer to the [dbt seed configuration documentation](https://docs.getdbt.com/reference/seed-configs). ## Materializations +The `dbt-watsonx-presto` adapter supports both table and view materializations, allowing you to manage how your data is stored and queried in watsonx.data Presto(java). + +For further information on configuring materializations, refer to the [dbt materializations documentation](https://docs.getdbt.com/reference/resource-configs/materialized). + ### Table -The `dbt-watsonx-presto` adapter helps you create and update tables through table materialization, making it easier to work with data in watsonx.data Presto. +The `dbt-watsonx-presto` adapter enables you to create and update tables through table materialization, making it easier to work with data in watsonx.data Presto. #### Recommendations - **Check Permissions:** Ensure that the necessary permissions for table creation are enabled in the catalog or schema. @@ -93,20 +118,12 @@ PrestoUserError(type=USER_ERROR, name=NOT_SUPPORTED, message="This connector doe ### View -The `dbt-watsonx-presto` adapter supports creating views using the `materialized='view'` configuration in your dbt model. By default, when you set the materialization to view, it creates a view in watsonx.data Presto. - -```sql -{{ - config( - materialized='view', - ) -}} -``` +The `dbt-watsonx-presto` adapter automatically creates views by default, as views are the standard materialization in dbt. If no materialization is explicitly specified, dbt will create a view in watsonx.data Presto. -For more details, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339) or Presto [connector documentation](https://prestodb.io/docs/current/connector.html) to verify whether your connector supports view creation. +To confirm whether your connector supports view creation, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339) or Presto [connector documentation](https://prestodb.io/docs/current/connector.html). -### Unsupported Features +## Unsupported Features The following features are not supported by the `dbt-watsonx-presto` adapter - Incremental Materialization - Materialized Views From 206ced66162688cb82d6586254e2b93ff3a968b8 Mon Sep 17 00:00:00 2001 From: KNagaVivek Date: Tue, 21 Jan 2025 20:35:07 +0530 Subject: [PATCH 06/26] Remove OSS Presto content --- .../watsonx-presto-setup.md | 20 +++++-------- .../resource-configs/watsonx-presto-config.md | 30 +++++-------------- 2 files changed, 16 insertions(+), 34 deletions(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 957a22509ad..be41909a58b 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -16,7 +16,7 @@ meta: config_page: /reference/resource-configs/watsonx-presto-config --- -The dbt-watsonx-presto adapter allows you to use dbt to transform and manage data on IBM watsonx.data Presto(Java), leveraging its distributed SQL query engine capabilities. The configuration and connection setup described here are also applicable to open-source Presto. Before proceeding, ensure you have the following: +The dbt-watsonx-presto adapter allows you to use dbt to transform and manage data on IBM watsonx.data Presto(Java), leveraging its distributed SQL query engine capabilities. Before proceeding, ensure you have the following:
  • An active IBM watsonx.data Presto(Java) Engine with connection details (host, port, catalog, schema) in SaaS/Software.
  • Authentication Credentials: Username and password/apikey.
  • @@ -47,7 +47,7 @@ my_project: user: [user] password: [password] host: [hostname] - database: [database name] + database: [catalog name] schema: [your dbt schema] port: [port number] threads: [1 or more] @@ -59,7 +59,7 @@ my_project: user: [user] password: [api_key] host: [hostname] - database: [database name] + database: [catalog name] schema: [your dbt schema] port: [port number] threads: [1 or more] @@ -72,21 +72,17 @@ my_project: ## Host parameters -The following profile fields are required to configure watsonx.data Presto(java) connections. The `method` field determines the authentication type used for the connection: -1. **`none`** : If not specified, the `method` field defaults to `none`, which is used for unauthenticated connections (e.g., for local development of OSS Presto instances). -2. **`BasicAuth`** : For secure connections (e.g., to IBM watsonx.data SaaS or Software instances), you must explicitly set `method: BasicAuth` and provide the corresponding `user` and `password` fields. - -For IBM watsonx.data SaaS or Software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. +The following profile fields are required to configure watsonx.data Presto(java) connections. For IBM watsonx.data SaaS or Software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. | Option | Required/Optional | Description | Example | | --------- | ------- | ------- | ----------- | -| `method` | Required (default value is none) | Specifies the authentication method for Presto. Use `none` for unauthenticated connections or `BasicAuth` for secure connections. | `None` or `BasicAuth` | -| `user` | Required | Username or email for authentication. | `user` | -| `password`| Required (if `method` is `BasicAuth`) | Password or API key for authentication | `password` | +| `method` | Required | Specifies the authentication method for secure connections. Use `BasicAuth` when connecting to IBM watsonx.data SaaS or Software instances. | `BasicAuth` | +| `user` | Required | Username or email address for authentication. | `user` | +| `password`| Required | Password or API key for authentication | `password` | | `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | | `database`| Required | The catalog name in your presto instance. | `Analytics` | | `schema` | Required | The schema name within your presto instance catalog. | `my_schema` | -| `port` | Required | Port for connecting to Presto. | `443` | +| `port` | Required | The port for connecting to Presto. | `443` | | ssl_verify | Optional (default: **true**) | Specifies the path to the SSL certificate or a boolean value. The SSL certificate path is required if the watsonx.data instance is not secure (HTTP).| `path/to/certificate` or `true` | diff --git a/website/docs/reference/resource-configs/watsonx-presto-config.md b/website/docs/reference/resource-configs/watsonx-presto-config.md index 6415a2b6058..13d8ff5d07c 100644 --- a/website/docs/reference/resource-configs/watsonx-presto-config.md +++ b/website/docs/reference/resource-configs/watsonx-presto-config.md @@ -15,9 +15,9 @@ For detailed setup instructions, including setting up watsonx.data, adding the P ## Session properties -With IBM watsonx.data SaaS/Software, or Presto instance, you can [set session properties](https://prestodb.io/docs/current/sql/set-session.html) to modify the current configuration for your user session. +With IBM watsonx.data SaaS/Software instance, you can [set session properties](https://prestodb.io/docs/current/sql/set-session.html) to modify the current configuration for your user session. -To temporarily adjust session properties for a specific dbt model or a group of models, use a [dbt hook](/reference/resource-configs/pre-hook-post-hook). For example: +To temporarily adjust session properties for a specific dbt model or a group of models, use a [dbt hook](../../reference/resource-configs/pre-hook-post-hook). For example: ```sql {{ @@ -29,31 +29,17 @@ To temporarily adjust session properties for a specific dbt model or a group of ## Connector properties -IBM watsonx.data SaaS/Software and Presto support various connector properties to manage how your data is represented. These properties are particularly useful for file-based connectors like Hive. +IBM watsonx.data SaaS/Software support various connector properties to manage how your data is represented. These properties are particularly useful for file-based connectors like Hive. -For information on what is supported for each data source, refer to one of the following resources: -- [Presto Connectors](https://prestodb.io/docs/current/connector.html) +For information on what is supported for each data source, refer to the following resources: - [watsonx.data SaaS Catalog](https://cloud.ibm.com/docs/watsonxdata?topic=watsonxdata-reg_database) -- [watsonx.data Software Catalog](https://www.ibm.com/docs/en/watsonx/watsonxdata/1.1.x?topic=components-adding-database-catalog-pair) +- [watsonx.data Software Catalog](https://www.ibm.com/docs/en/watsonx/watsonxdata/2.1.x?topic=components-adding-data-source) -### Hive catalogs - -When using the Hive connector, ensure the following settings are configured. These settings are crucial for enabling frequently executed operations like `DROP` and `RENAME` in dbt: - -```java -hive.metastore-cache-ttl=0s -hive.metastore-refresh-interval=5s -hive.allow-drop-table=true -hive.allow-rename-table=true - -``` - ## File format configuration File-based connectors, such as Hive and Iceberg, allow customization of table materialization, data formats, and partitioning strategies in dbt models. The following examples demonstrate how to configure these options for each connector. - ### Hive Configuration Hive supports specifying file formats and partitioning strategies using the properties parameter in dbt models. The example below demonstrates how to create a partitioned table stored in Parquet format: @@ -91,7 +77,7 @@ For more information about Iceberg table creation and supported configurations, ## Seeds and prepared statements -The `dbt-watsonx-presto` adapter offers comprehensive support for all [Presto datatypes](https://prestodb.io/docs/current/language/types.html) and [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. To leverage this functionality, you must explicitly define the data types for each column. +The `dbt-watsonx-presto` adapter offers comprehensive support for all [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. To leverage this functionality, you must explicitly define the data types for each column. You can configure column data types either in the dbt_project.yml file or in property files, as supported by dbt. For more details on seed configuration and best practices, refer to the [dbt seed configuration documentation](https://docs.getdbt.com/reference/seed-configs). @@ -107,7 +93,7 @@ The `dbt-watsonx-presto` adapter enables you to create and update tables through #### Recommendations - **Check Permissions:** Ensure that the necessary permissions for table creation are enabled in the catalog or schema. -- **Check Connector Documentation:** Review Presto [connector’s documentation](https://prestodb.io/docs/current/connector.html) or watsonx.data Presto [sql statement support](https://www.ibm.com/support/pages/node/7157339) to ensure it supports table creation and modification. +- **Check Connector Documentation:** Review watsonx.data Presto [sql statement support](https://www.ibm.com/support/pages/node/7157339) to ensure it supports table creation and modification. #### Limitations with Some Connectors Certain watsonx.data Presto connectors, particularly read-only ones or those with restricted permissions, do not allow creating or modifying tables. If you attempt to use table materialization with these connectors, you may encounter an error like: @@ -120,7 +106,7 @@ PrestoUserError(type=USER_ERROR, name=NOT_SUPPORTED, message="This connector doe The `dbt-watsonx-presto` adapter automatically creates views by default, as views are the standard materialization in dbt. If no materialization is explicitly specified, dbt will create a view in watsonx.data Presto. -To confirm whether your connector supports view creation, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339) or Presto [connector documentation](https://prestodb.io/docs/current/connector.html). +To confirm whether your connector supports view creation, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339). ## Unsupported Features From 6446ed5ff1bee10886932be370cdb9b9d9987350 Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Wed, 22 Jan 2025 21:25:33 +0530 Subject: [PATCH 07/26] Update community-adapters --- website/docs/docs/community-adapters.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/website/docs/docs/community-adapters.md b/website/docs/docs/community-adapters.md index 895e47a8fa3..f43879f89f2 100644 --- a/website/docs/docs/community-adapters.md +++ b/website/docs/docs/community-adapters.md @@ -15,4 +15,5 @@ Community adapters are adapter plugins contributed and maintained by members of | [MySQL](/docs/core/connect-data-platform/mysql-setup) | [RisingWave](/docs/core/connect-data-platform/risingwave-setup) | [Rockset](/docs/core/connect-data-platform/rockset-setup) | | [SingleStore](/docs/core/connect-data-platform/singlestore-setup)| [SQL Server & Azure SQL](/docs/core/connect-data-platform/mssql-setup) | [SQLite](/docs/core/connect-data-platform/sqlite-setup) | | [Starrocks](/docs/core/connect-data-platform/starrocks-setup) | [TiDB](/docs/core/connect-data-platform/tidb-setup)| [TimescaleDB](https://dbt-timescaledb.debruyn.dev/) | -| [Upsolver](/docs/core/connect-data-platform/upsolver-setup) | [Vertica](/docs/core/connect-data-platform/vertica-setup) | [Yellowbrick](/docs/core/connect-data-platform/yellowbrick-setup) | +| [Upsolver](/docs/core/connect-data-platform/upsolver-setup) | [Vertica](/docs/core/connect-data-platform/vertica-setup) | [Watsonx-Presto](/docs/core/connect-data-platform/watsonx-presto-setup) | +| [Yellowbrick](/docs/core/connect-data-platform/yellowbrick-setup) | From 76b13a979db9c03956d8c51d68e7964be109cc72 Mon Sep 17 00:00:00 2001 From: KNagaVivek Date: Thu, 23 Jan 2025 10:57:10 +0530 Subject: [PATCH 08/26] Fix sentence-style issues --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 6 +++--- .../reference/resource-configs/watsonx-presto-config.md | 4 ++-- 2 files changed, 5 insertions(+), 5 deletions(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index be41909a58b..044e617a92f 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -32,7 +32,7 @@ import SetUpPages from '/snippets/_setup-pages-intro.md'; -## Connecting to IBM watsonx.data Presto +## Connecting to IBM watsonx.data P\presto To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and Software instances: @@ -83,13 +83,13 @@ The following profile fields are required to configure watsonx.data Presto(java) | `database`| Required | The catalog name in your presto instance. | `Analytics` | | `schema` | Required | The schema name within your presto instance catalog. | `my_schema` | | `port` | Required | The port for connecting to Presto. | `443` | -| ssl_verify | Optional (default: **true**) | Specifies the path to the SSL certificate or a boolean value. The SSL certificate path is required if the watsonx.data instance is not secure (HTTP).| `path/to/certificate` or `true` | +| `ssl_verify` | Optional (default: **true**) | Specifies the path to the SSL certificate or a boolean value. The SSL certificate path is required if the watsonx.data instance is not secure (HTTP).| `path/to/certificate` or `true` | ### Schemas and databases When selecting the catalog and the schema, make sure the user has read and write access to both. This selection does not limit your ability to query the catalog. Instead, they serve as the default location for where tables and views are materialized. In addition, the Presto connector used in the catalog must support creating tables. This default can be changed later from within your dbt project. -### SSL Verification +### SSL verification - If the Presto instance uses an unsecured HTTP connection, you must set `ssl_verify` to the path of the SSL certificate file. - If the instance uses `HTTPS`, this parameter is not required and can be omitted. diff --git a/website/docs/reference/resource-configs/watsonx-presto-config.md b/website/docs/reference/resource-configs/watsonx-presto-config.md index 13d8ff5d07c..3dda08547fe 100644 --- a/website/docs/reference/resource-configs/watsonx-presto-config.md +++ b/website/docs/reference/resource-configs/watsonx-presto-config.md @@ -95,7 +95,7 @@ The `dbt-watsonx-presto` adapter enables you to create and update tables through - **Check Permissions:** Ensure that the necessary permissions for table creation are enabled in the catalog or schema. - **Check Connector Documentation:** Review watsonx.data Presto [sql statement support](https://www.ibm.com/support/pages/node/7157339) to ensure it supports table creation and modification. -#### Limitations with Some Connectors +#### Limitations with some connectors Certain watsonx.data Presto connectors, particularly read-only ones or those with restricted permissions, do not allow creating or modifying tables. If you attempt to use table materialization with these connectors, you may encounter an error like: ```sh @@ -109,7 +109,7 @@ The `dbt-watsonx-presto` adapter automatically creates views by default, as view To confirm whether your connector supports view creation, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339). -## Unsupported Features +## Unsupported features The following features are not supported by the `dbt-watsonx-presto` adapter - Incremental Materialization - Materialized Views From c18fa63e021847e2c2aa22ffb31c27a1a49d7471 Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Thu, 23 Jan 2025 09:43:24 +0000 Subject: [PATCH 09/26] Update website/sidebars.js --- website/sidebars.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/sidebars.js b/website/sidebars.js index f120b6859ba..e5742a8bcca 100644 --- a/website/sidebars.js +++ b/website/sidebars.js @@ -900,7 +900,7 @@ const sidebarSettings = { "reference/resource-configs/teradata-configs", "reference/resource-configs/upsolver-configs", "reference/resource-configs/vertica-configs", - "reference/resource-configs/watsonx-presto-config", + "reference/resource-configs/watsonx-presto-configs", "reference/resource-configs/yellowbrick-configs", ], }, From 1d20f087b5d830436e202783aaf17b788d04e3a5 Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Thu, 23 Jan 2025 15:19:20 +0530 Subject: [PATCH 10/26] Update watsonx-presto-setup.md --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 044e617a92f..5524f8f6923 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -32,7 +32,7 @@ import SetUpPages from '/snippets/_setup-pages-intro.md'; -## Connecting to IBM watsonx.data P\presto +## Connecting to IBM watsonx.data presto To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and Software instances: From 0bb933056be2d348b1d3b6fb8cfb000a882bb5db Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 10:26:04 +0000 Subject: [PATCH 11/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 5524f8f6923..5b6828c12fe 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -1,7 +1,7 @@ --- title: "IBM watsonx.data Presto setup" description: "Read this guide to learn about the IBM watsonx.data Presto setup in dbt." -id: "watsonx-presto setup" +id: "watsonx-presto-setup" meta: maintained_by: IBM authors: Karnati Naga Vivek, Hariharan Ashokan, Biju Palliyath, Gopikrishnan Varadarajulu, Rohan Pednekar From 33e039d2f0cab2e0bd3fd9bed7e7a8a5cdec977f Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 10:47:29 +0000 Subject: [PATCH 12/26] Update website/sidebars.js --- website/sidebars.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/sidebars.js b/website/sidebars.js index e5742a8bcca..f120b6859ba 100644 --- a/website/sidebars.js +++ b/website/sidebars.js @@ -900,7 +900,7 @@ const sidebarSettings = { "reference/resource-configs/teradata-configs", "reference/resource-configs/upsolver-configs", "reference/resource-configs/vertica-configs", - "reference/resource-configs/watsonx-presto-configs", + "reference/resource-configs/watsonx-presto-config", "reference/resource-configs/yellowbrick-configs", ], }, From 21749842d99c9973955936b0254d26ed3704b66f Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 10:48:26 +0000 Subject: [PATCH 13/26] Update website/docs/reference/resource-configs/watsonx-presto-config.md --- .../docs/reference/resource-configs/watsonx-presto-config.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/reference/resource-configs/watsonx-presto-config.md b/website/docs/reference/resource-configs/watsonx-presto-config.md index 3dda08547fe..9c493db72be 100644 --- a/website/docs/reference/resource-configs/watsonx-presto-config.md +++ b/website/docs/reference/resource-configs/watsonx-presto-config.md @@ -1,6 +1,6 @@ --- title: "IBM watsonx.data Presto configurations" -id: "watsonx-presto-configs" +id: "watsonx-presto-config" --- ## Instance requirements From d03fed1e7c1e7609fa75d930ce7f6f91b9e9dd5a Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:46:38 -0500 Subject: [PATCH 14/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 5b6828c12fe..a04c749a81c 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -18,7 +18,7 @@ meta: The dbt-watsonx-presto adapter allows you to use dbt to transform and manage data on IBM watsonx.data Presto(Java), leveraging its distributed SQL query engine capabilities. Before proceeding, ensure you have the following:
      -
    • An active IBM watsonx.data Presto(Java) Engine with connection details (host, port, catalog, schema) in SaaS/Software.
    • +
    • An active IBM watsonx.data Presto(Java) engine with connection details (host, port, catalog, schema) in SaaS/software.
    • Authentication Credentials: Username and password/apikey.
    • For watsonx.data instances, SSL verification is required for secure connections. If the instance host uses HTTPS, there is no need to specify the SSL certificate parameter. However, if the instance host uses an unsecured HTTP connection, ensure you provide the path to the SSL certificate file.
    From c55ec934bca259b843970ee460f143e5b8b00c9c Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:46:43 -0500 Subject: [PATCH 15/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index a04c749a81c..85026a68381 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -19,7 +19,7 @@ meta: The dbt-watsonx-presto adapter allows you to use dbt to transform and manage data on IBM watsonx.data Presto(Java), leveraging its distributed SQL query engine capabilities. Before proceeding, ensure you have the following:
    • An active IBM watsonx.data Presto(Java) engine with connection details (host, port, catalog, schema) in SaaS/software.
    • -
    • Authentication Credentials: Username and password/apikey.
    • +
    • Authentication credentials: Username and password/apikey.
    • For watsonx.data instances, SSL verification is required for secure connections. If the instance host uses HTTPS, there is no need to specify the SSL certificate parameter. However, if the instance host uses an unsecured HTTP connection, ensure you provide the path to the SSL certificate file.
    Refer to the Configuring dbt-watsonx-presto section for guidance on obtaining and organizing these details. From bab0cff267b841addc972b4e947ce5078a7dfd7d Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:46:52 -0500 Subject: [PATCH 16/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 85026a68381..cd81cfb63cf 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -22,7 +22,7 @@ The dbt-watsonx-presto adapter allows you to use dbt to transform and manage dat
  • Authentication credentials: Username and password/apikey.
  • For watsonx.data instances, SSL verification is required for secure connections. If the instance host uses HTTPS, there is no need to specify the SSL certificate parameter. However, if the instance host uses an unsecured HTTP connection, ensure you provide the path to the SSL certificate file.
-Refer to the Configuring dbt-watsonx-presto section for guidance on obtaining and organizing these details. +Refer to [Configuring dbt-watsonx-presto](https://www.ibm.com/docs/en/watsonx/watsonxdata/2.1.x?topic=presto-configuration-setting-up-your-profile) for guidance on obtaining and organizing these details. From a3eeec2c4aaeb1a378226503ea718292b7874371 Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:46:59 -0500 Subject: [PATCH 17/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index cd81cfb63cf..83e4cee2323 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -34,7 +34,7 @@ import SetUpPages from '/snippets/_setup-pages-intro.md'; ## Connecting to IBM watsonx.data presto -To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and Software instances: +To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and software instances: From 00ef1b06c29ee04d4760e0f9b83246a1f495e5fd Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:47:06 -0500 Subject: [PATCH 18/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 83e4cee2323..2c30707fa3b 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -72,7 +72,7 @@ my_project: ## Host parameters -The following profile fields are required to configure watsonx.data Presto(java) connections. For IBM watsonx.data SaaS or Software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. +The following profile fields are required to configure watsonx.data Presto(java) connections. For IBM watsonx.data SaaS or software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. | Option | Required/Optional | Description | Example | | --------- | ------- | ------- | ----------- | From acfd48ea081315c00872e4468b6cd915e77273c1 Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:47:13 -0500 Subject: [PATCH 19/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 2c30707fa3b..09abb051835 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -80,7 +80,7 @@ The following profile fields are required to configure watsonx.data Presto(java) | `user` | Required | Username or email address for authentication. | `user` | | `password`| Required | Password or API key for authentication | `password` | | `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | -| `database`| Required | The catalog name in your presto instance. | `Analytics` | +| `database`| Required | The catalog name in your Presto instance. | `Analytics` | | `schema` | Required | The schema name within your presto instance catalog. | `my_schema` | | `port` | Required | The port for connecting to Presto. | `443` | | `ssl_verify` | Optional (default: **true**) | Specifies the path to the SSL certificate or a boolean value. The SSL certificate path is required if the watsonx.data instance is not secure (HTTP).| `path/to/certificate` or `true` | From 7b74d0ea39181fc5c1fc1d511397d55a112060d8 Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:47:20 -0500 Subject: [PATCH 20/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 09abb051835..d5a60498a6c 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -81,7 +81,7 @@ The following profile fields are required to configure watsonx.data Presto(java) | `password`| Required | Password or API key for authentication | `password` | | `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | | `database`| Required | The catalog name in your Presto instance. | `Analytics` | -| `schema` | Required | The schema name within your presto instance catalog. | `my_schema` | +| `schema` | Required | The schema name within your Presto instance catalog. | `my_schema` | | `port` | Required | The port for connecting to Presto. | `443` | | `ssl_verify` | Optional (default: **true**) | Specifies the path to the SSL certificate or a boolean value. The SSL certificate path is required if the watsonx.data instance is not secure (HTTP).| `path/to/certificate` or `true` | From f0c17e922f496f83f629173668e9b967a610a4a5 Mon Sep 17 00:00:00 2001 From: Amy Chen <46451573+amychen1776@users.noreply.github.com> Date: Thu, 23 Jan 2025 08:47:30 -0500 Subject: [PATCH 21/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md Co-authored-by: nataliefiann <120089939+nataliefiann@users.noreply.github.com> --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index d5a60498a6c..8eb479b039e 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -76,7 +76,7 @@ The following profile fields are required to configure watsonx.data Presto(java) | Option | Required/Optional | Description | Example | | --------- | ------- | ------- | ----------- | -| `method` | Required | Specifies the authentication method for secure connections. Use `BasicAuth` when connecting to IBM watsonx.data SaaS or Software instances. | `BasicAuth` | +| `method` | Required | Specifies the authentication method for secure connections. Use `BasicAuth` when connecting to IBM watsonx.data SaaS or software instances. | `BasicAuth` | | `user` | Required | Username or email address for authentication. | `user` | | `password`| Required | Password or API key for authentication | `password` | | `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | From ddad7be54c30d2d1110b5ea92b94a73faee31a5e Mon Sep 17 00:00:00 2001 From: KNagaVivek <79193329+KNagaVivek@users.noreply.github.com> Date: Thu, 23 Jan 2025 19:22:56 +0530 Subject: [PATCH 22/26] Update watsonx-presto-setup.md --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 8eb479b039e..7b1f7aa88de 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -25,8 +25,6 @@ The dbt-watsonx-presto adapter allows you to use dbt to transform and manage dat Refer to [Configuring dbt-watsonx-presto](https://www.ibm.com/docs/en/watsonx/watsonxdata/2.1.x?topic=presto-configuration-setting-up-your-profile) for guidance on obtaining and organizing these details. - - import SetUpPages from '/snippets/_setup-pages-intro.md'; From 0ed1a5e5bdd75dad7545a6f16065328d006c3772 Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 14:17:51 +0000 Subject: [PATCH 23/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 7b1f7aa88de..cf2899f6b8e 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -32,7 +32,7 @@ import SetUpPages from '/snippets/_setup-pages-intro.md'; ## Connecting to IBM watsonx.data presto -To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and software instances: +To connect dbt with watsonx.data Presto(java), you need to configure a profile in your `profiles.yml` file located in the `.dbt/` directory of your home folder. The following is an example configuration for connecting to IBM watsonx.data SaaS and Software instances: From 271b05f64a4892f8f28657ecfef2b539319ea56f Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 14:18:38 +0000 Subject: [PATCH 24/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index cf2899f6b8e..9da288aa338 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -74,7 +74,7 @@ The following profile fields are required to configure watsonx.data Presto(java) | Option | Required/Optional | Description | Example | | --------- | ------- | ------- | ----------- | -| `method` | Required | Specifies the authentication method for secure connections. Use `BasicAuth` when connecting to IBM watsonx.data SaaS or software instances. | `BasicAuth` | +| `method` | Required | Specifies the authentication method for secure connections. Use `BasicAuth` when connecting to IBM watsonx.data SaaS or Software instances. | `BasicAuth` | | `user` | Required | Username or email address for authentication. | `user` | | `password`| Required | Password or API key for authentication | `password` | | `host` | Required | Hostname for connecting to Presto. | `127.0.0.1` | From 9ca4aa7ff7f85eca349f9c1735587d7e0c503061 Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 14:19:29 +0000 Subject: [PATCH 25/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 9da288aa338..3db54d82bc9 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -18,7 +18,7 @@ meta: The dbt-watsonx-presto adapter allows you to use dbt to transform and manage data on IBM watsonx.data Presto(Java), leveraging its distributed SQL query engine capabilities. Before proceeding, ensure you have the following:
    -
  • An active IBM watsonx.data Presto(Java) engine with connection details (host, port, catalog, schema) in SaaS/software.
  • +
  • An active IBM watsonx.data Presto(Java) engine with connection details (host, port, catalog, schema) in SaaS/Software.
  • Authentication credentials: Username and password/apikey.
  • For watsonx.data instances, SSL verification is required for secure connections. If the instance host uses HTTPS, there is no need to specify the SSL certificate parameter. However, if the instance host uses an unsecured HTTP connection, ensure you provide the path to the SSL certificate file.
From 219720afe81a9510fdb1f4fedee8bca1a393b14c Mon Sep 17 00:00:00 2001 From: nataliefiann <120089939+nataliefiann@users.noreply.github.com> Date: Thu, 23 Jan 2025 14:19:55 +0000 Subject: [PATCH 26/26] Update website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md --- .../docs/core/connect-data-platform/watsonx-presto-setup.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md index 3db54d82bc9..880328929f6 100644 --- a/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md +++ b/website/docs/docs/core/connect-data-platform/watsonx-presto-setup.md @@ -70,7 +70,7 @@ my_project: ## Host parameters -The following profile fields are required to configure watsonx.data Presto(java) connections. For IBM watsonx.data SaaS or software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. +The following profile fields are required to configure watsonx.data Presto(java) connections. For IBM watsonx.data SaaS or Software instances, you can get the `hostname` and `port` details by clicking **View connect details** on the Presto(java) engine details page. | Option | Required/Optional | Description | Example | | --------- | ------- | ------- | ----------- |