You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: website/docs/reference/resource-configs/watsonx-presto-config.md
+16-41Lines changed: 16 additions & 41 deletions
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,13 @@ id: "watsonx-presto-configs"
5
5
6
6
## Instance requirements
7
7
8
-
To use IBM watsonx.data Presto(java) with dbt, ensure the instance has an attached catalog that allows creating, renaming, altering, and dropping objects such as tables and views. The user connecting to the instance with dbt must have equivalent permissions for the target catalog.
8
+
To use IBM watsonx.data Presto(java) with `dbt-watsonx-presto` adapter, ensure the instance has an attached catalog that supports creating, renaming, altering, and dropping objects such as tables and views. The user connecting to the instance via the `dbt-watsonx-presto` adapter must have the necessary permissions for the target catalog.
9
+
10
+
For detailed setup instructions, including setting up watsonx.data, adding the Presto(Java) engine, configuring storages, registering data sources, and managing permissions, refer to the official IBM documentation:
For file-based connectors, such as Hive, you can customize table materialization and data formats. For example, to create a partitioned [Parquet](https://spark.apache.org/docs/latest/sql-data-sources-parquet.html) table:
49
-
50
-
```sql
51
-
{{
52
-
config(
53
-
materialized='table',
54
-
properties={
55
-
"format": "'PARQUET'",
56
-
"partitioning": "ARRAY['bucket(id, 2)']",
57
-
}
58
-
)
59
-
}}
60
-
```
61
-
62
52
## Seeds and prepared statements
63
-
The `dbt-watsonx-presto` adapter offers comprehensive support for all [Presto datatypes](https://prestodb.io/docs/current/language/types.html) and [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. However, to utilize this feature, you need to explicitly define the data types for each column in the `dbt_project.yml` file.
53
+
The `dbt-watsonx-presto` adapter offers comprehensive support for all [Presto datatypes](https://prestodb.io/docs/current/language/types.html) and [watsonx.data Presto datatypes](https://www.ibm.com/support/pages/node/7157339) in seed files. To leverage this functionality, you must explicitly define the data types for each column.
64
54
65
-
To configure column data types, update your `<project_name>/dbt_project.yml` file as follows:
55
+
You can configure column data types either in the dbt_project.yml file or in property files, as supported by dbt. For more details on seed configuration and best practices, refer to the [dbt seed configuration documentation](https://docs.getdbt.com/reference/seed-configs).
66
56
67
-
```sh
68
-
seeds:
69
-
<project_name>:
70
-
<seed_file_name>:
71
-
+column_types:
72
-
<col_1>: <datatype>
73
-
<col_2>: <datatype>
74
-
```
75
-
This ensures that dbt correctly interprets and applies the specified data types when loading seed data into your watsonx.data Presto instances.
57
+
## Materializations
58
+
The `dbt-watsonx-presto` adapter supports both table and view materializations, allowing you to manage how your data is stored and queried in watsonx.data Presto(java).
76
59
60
+
For further information on configuring materializations, refer to the [dbt materializations documentation](https://docs.getdbt.com/reference/resource-configs/materialized).
77
61
78
-
## Materializations
79
62
### Table
80
63
81
-
The `dbt-watsonx-presto` adapter helps you create and update tables through table materialization, making it easier to work with data in watsonx.data Presto.
64
+
The `dbt-watsonx-presto` adapter enables you to create and update tables through table materialization, making it easier to work with data in watsonx.data Presto.
82
65
83
66
#### Recommendations
84
67
-**Check Permissions:** Ensure that the necessary permissions for table creation are enabled in the catalog or schema.
@@ -93,20 +76,12 @@ PrestoUserError(type=USER_ERROR, name=NOT_SUPPORTED, message="This connector doe
93
76
94
77
### View
95
78
96
-
The `dbt-watsonx-presto` adapter supports creating views using the `materialized='view'` configuration in your dbt model. By default, when you set the materialization to view, it creates a view in watsonx.data Presto.
97
-
98
-
```sql
99
-
{{
100
-
config(
101
-
materialized='view',
102
-
)
103
-
}}
104
-
```
79
+
The `dbt-watsonx-presto` adapter automatically creates views by default, as views are the standard materialization in dbt. If no materialization is explicitly specified, dbt will create a view in watsonx.data Presto.
105
80
106
-
For more details, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339) or Presto [connector documentation](https://prestodb.io/docs/current/connector.html) to verify whether your connector supports view creation.
81
+
To confirm whether your connector supports view creation, refer to the watsonx.data [sql statement support](https://www.ibm.com/support/pages/node/7157339) or Presto [connector documentation](https://prestodb.io/docs/current/connector.html).
107
82
108
83
109
-
###Unsupported Features
84
+
## Unsupported Features
110
85
The following features are not supported by the `dbt-watsonx-presto` adapter
0 commit comments