Skip to content

Commit 1cb8331

Browse files
maxim-lixakovmaxim-lixakov
authored
Update mapping table (#9)
1 parent 22e74eb commit 1cb8331

File tree

1 file changed

+21
-46
lines changed

1 file changed

+21
-46
lines changed

‎docs/data_type_mappings.md‎

Lines changed: 21 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -4,26 +4,26 @@ This documentation outlines the customized mappings that the Spark Dialect Exten
44

55
#### Customized Type Mappings with Spark Dialect Extension
66

7-
| ClickHouse Type (Read) | Spark Type | ClickHouse Type (Write) | ClickHouse Type (Create) |
8-
|------------------------|----------------------|-------------------------|--------------------------|
9-
| `Bool` | `BooleanType` | `Bool` | `Bool` |
10-
| `Int8` | `ByteType` | `Int8` | `Int8` |
11-
| `Int16` | `ShortType` | `Int16` | `Int16` |
12-
| `Int32` | `IntegerType` | `Int32` | `Int32` |
13-
| `Int64` | `LongType` | `Int64` | `Int64` |
14-
| `UInt8` | `ShortType` | `UInt8` | `UInt8` |
15-
| `UInt16` | `IntegerType` | `UInt16` | `UInt16` |
16-
| `UInt32` | `LongType` | `Int64` | `Int64` |
17-
| `UInt64` | `DecimalType(20, 0)` | `Decimal(20, 0)` | `Decimal(20, 0)` |
18-
| `Float32` | `FloatType` | `Float32` | `Float32` |
19-
| `Float64` | `DoubleType` | `Float64` | `Float64` |
20-
| `Decimal(M, N)` | `DecimalType(M, N)` | `Decimal(M, N)` | `Decimal(M, N)` |
21-
| `Decimal32(N)` | `DecimalType(M, N)` | `Decimal32(M, N)` | `Decimal32(M, N)` |
22-
| `Decimal64(N)` | `DecimalType(M, N)` | `Decimal64(M, N)` | `Decimal64(M, N)` |
23-
| `Decimal128(N)` | `DecimalType(M, N)` | `Decimal128(M, N)` | `Decimal128(M, N)` |
24-
| `Decimal256(N)` | unsupported | unsupported | unsupported |
25-
| `DateTime` | `TimestampType` | `DateTime` | `DateTime` |
26-
| `Datetime64(6)` | `TimestampType` | `Datetime64(6)` | `Datetime64(6)` |
7+
| ClickHouse Type (Read) | Spark Type | ClickHouse Type (Write) | ClickHouse Type (Create) |
8+
|------------------------|----------------------|-------------------------|-------------------------------------------------|
9+
| `Bool` | `BooleanType` | `Bool` | `Bool (Spark's default is UInt64)` |
10+
| `Int8` | `ByteType` | `Int8` | `Int8 (Spark's default is Int32)` |
11+
| `Int16` | `ShortType` | `Int16` | `Int16 (Spark's default is Int32)` |
12+
| `Int32` | `IntegerType` | `Int32` | `Int32` |
13+
| `Int64` | `LongType` | `Int64` | `Int64` |
14+
| `UInt8` | `ShortType` | `UInt8` | `UInt8` |
15+
| `UInt16` | `IntegerType` | `UInt16` | `UInt16` |
16+
| `UInt32` | `LongType` | `Int64` | `Int64 (Spark's default is Decimal(20, 0))` |
17+
| `UInt64` | `DecimalType(20, 0)` | `Decimal(20, 0)` | `Decimal(20, 0)` |
18+
| `Float32` | `FloatType` | `Float32` | `Float32` |
19+
| `Float64` | `DoubleType` | `Float64` | `Float64` |
20+
| `Decimal(M, N)` | `DecimalType(M, N)` | `Decimal(M, N)` | `Decimal(M, N)` |
21+
| `Decimal32(N)` | `DecimalType(M, N)` | `Decimal32(M, N)` | `Decimal32(M, N)` |
22+
| `Decimal64(N)` | `DecimalType(M, N)` | `Decimal64(M, N)` | `Decimal64(M, N)` |
23+
| `Decimal128(N)` | `DecimalType(M, N)` | `Decimal128(M, N)` | `Decimal128(M, N)` |
24+
| `Decimal256(N)` | unsupported | unsupported | unsupported |
25+
| `DateTime` | `TimestampType` | `DateTime` | `DateTime` |
26+
| `DateTime64(6)` | `TimestampType` | `DateTime64(6)` | `DateTime64(6) (Spark's default is DateTime32)` |
2727

2828

2929
``Array(T)`` `->` ``ArrayType(T)``:
@@ -41,29 +41,4 @@ This documentation outlines the customized mappings that the Spark Dialect Exten
4141
| unsupported | `ArrayType(DoubleType)` | unsupported | unsupported |
4242

4343

44-
#### Default Type Mappings without Spark Dialect Extension
45-
46-
| ClickHouse Type (Read) | Spark Type | ClickHouse Type (Write) | ClickHouse Type (Create) |
47-
|------------------------|----------------------|-------------------------|--------------------------|
48-
| `Bool` | `BooleanType` | `Bool` | `UInt64` |
49-
| `Int8` | `IntegerType` | `Int32` | `Int32` |
50-
| `Int16` | `IntegerType` | `Int32` | `Int32` |
51-
| `Int32` | `IntegerType` | `Int32` | `Int32` |
52-
| `Int64` | `LongType` | `Int64` | `Int64` |
53-
| `UInt8` | `IntegerType` | `UInt8` | `UInt8` |
54-
| `UInt16` | `IntegerType` | `UInt16` | `UInt16` |
55-
| `UInt32` | `DecimalType(20, 0)` | `Decimal(20, 0)` | `Decimal(20, 0)` |
56-
| `UInt64` | `DecimalType(20, 0)` | `Decimal(20, 0)` | `Decimal(20, 0)` |
57-
| `Float32` | `FloatType` | `Float32` | `Float32` |
58-
| `Float64` | `DoubleType` | `Float64` | `Float64` |
59-
| `Decimal(M, N)` | `DecimalType(M, N)` | `Decimal(M, N)` | `Decimal(M, N)` |
60-
| `Decimal32(N)` | `DecimalType(M, N)` | `Decimal32(M, N)` | `Decimal32(M, N)` |
61-
| `Decimal64(N)` | `DecimalType(M, N)` | `Decimal64(M, N)` | `Decimal64(M, N)` |
62-
| `Decimal128(N)` | `DecimalType(M, N)` | `Decimal128(M, N)` | `Decimal128(M, N)` |
63-
| `Decimal256(N)` | unsupported | unsupported | unsupported |
64-
| `DateTime` | `TimestampType` | `DateTime` | `DateTime` |
65-
| `Datetime64(6)` | `TimestampType` | `Datetime64(6)` | `DateTime32` |
66-
67-
``Array(T)`` `->` ``ArrayType(T)``:
68-
69-
**unsupported**
44+
#### By Default Array Type Mappings without Spark Dialect Extension is not supported

0 commit comments

Comments
 (0)