Skip to content

Commit 3cf26f8

Browse files
committed
feat: add new config
Signed-off-by: composer <[email protected]>
1 parent 78e6985 commit 3cf26f8

File tree

1 file changed

+20
-19
lines changed

1 file changed

+20
-19
lines changed

pipeline/outputs/doris.md

+20-19
Original file line numberDiff line numberDiff line change
@@ -12,32 +12,33 @@ operational Doris service running in your environment.
1212

1313
| Key | Description | Default |
1414
| :--- | :--- | :--- |
15-
| `host` | HTTP address of the target Doris fe or be | `127.0.0.1` |
16-
| `port` | HTTP port of the target Doris fe or be | `8030` |
17-
| `user` | Username for Doris access | _none_ |
18-
| `password` | Password for Doris access | _none_ |
19-
| `database` | The target Doris database | _none_ |
20-
| `table` | The target Doris table | _none_ |
21-
| `time_key` | The name of the time key in the output record | `date` |
22-
| `columns` | The column mappings, details in [Doris stream load](https://doris.apache.org/docs/data-operate/import/import-way/stream-load-manual) | `date, log` |
23-
| `timeout_second` | Timeout seconds for Doris stream load | `60` |
15+
| `host` | HTTP address of the target Doris frontend (fe) or frontend (be). | `127.0.0.1` |
16+
| `port` | HTTP port of the target Doris frontend (fe) or frontend (be). | `8030` |
17+
| `user` | Username for Doris access. | _none_ |
18+
| `password` | Password for Doris access. | _none_ |
19+
| `database` | The target Doris database. | _none_ |
20+
| `table` | The target Doris table. | _none_ |
21+
| `label_prefix` | Doris stream load label prefix, the final generated Label is {label_prefix}\_{timestamp}\_{uuid}. | `fluentbit` |
22+
| `time_key` | The name of the time key in the output record. | `date` |
23+
| `header` | Doris stream load headers. Multiple headers can be set. See [Doris stream load](https://doris.apache.org/docs/data-operate/import/import-way/stream-load-manual) for details. | _none_ |
24+
| `log_request` | Whether to output Doris Stream Load request and response metadata in logs for troubleshooting. | `true` |
25+
| `log_progress_interval` | The time interval in seconds to calculate and output the speed in the log. Set to 0 to disable this type of logging. | `10` |
2426
| `Workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `2` |
2527

2628
### TLS / SSL
2729

28-
Doris output plugin supports TLS/SSL. For more details about the properties
29-
available and general configuration, refer to[TLS/SSL](../../administration/transport-security.md).
30+
Doris output plugin supports TLS/SSL. See [TLS/SSL](../../administration/transport-security.md)
31+
for more details about the supported properties and general configuration.
3032

3133
## Get started
3234

33-
To insert records into a Doris database, you run the plugin from the
34-
command line or through the configuration file:
35+
To insert records into a Doris database, run the plugin from the command line or define a configuration file:
3536

3637
### Command Line
3738

38-
The **doris** plugin can read the parameters from the command through the `-p` argument (property).
39+
The Doris plugin can read the parameters from the command through the `-p` argument,
3940

40-
An example:
41+
as shown in the following example:
4142

4243
```shell copy
4344
fluent-bit -i cpu -t cpu -o doris \
@@ -48,14 +49,14 @@ fluent-bit -i cpu -t cpu -o doris \
4849
-p password=admin \
4950
-p database=d_fb \
5051
-p table=t_fb \
51-
-p columns='date, log=cast(cpu_p as string)'
52+
-p header='columns date, cpu_p, log=cast(cpu_p as string)'
5253
```
5354

5455
### Configuration File
5556

56-
In your main configuration file append the following `Input` and `Output` sections.
57+
In your main configuration file, append the following `Input` and `Output` sections.
5758

58-
```python
59+
```python copy
5960
[INPUT]
6061
Name cpu
6162
Tag cpu
@@ -69,5 +70,5 @@ In your main configuration file append the following `Input` and `Output` sectio
6970
password admin
7071
database d_fb
7172
table t_fb
72-
columns date, log=cast(cpu_p as string)
73+
columns date, cpu_p, log=cast(cpu_p as string)
7374
```

0 commit comments

Comments
 (0)