Skip to content

Commit 6765312

Browse files
authored
[Improve][Document] Refactor job env config document (#7631)
1 parent 7e0c20a commit 6765312

File tree

7 files changed

+43
-31
lines changed

7 files changed

+43
-31
lines changed

docs/en/concept/JobEnvConfig.md

Lines changed: 14 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -21,14 +21,26 @@ You can configure whether the task is in batch or stream mode through `job.mode`
2121

2222
### checkpoint.interval
2323

24-
Gets the interval in which checkpoints are periodically scheduled.
24+
Gets the interval (milliseconds) in which checkpoints are periodically scheduled.
2525

26-
In `STREAMING` mode, checkpoints is required, if you do not set it, it will be obtained from the application configuration file `seatunnel.yaml`. In `BATCH` mode, you can disable checkpoints by not setting this parameter.
26+
In `STREAMING` mode, checkpoints is required, if you do not set it, it will be obtained from the application configuration file `seatunnel.yaml`. In `BATCH` mode, you can disable checkpoints by not setting this parameter. In Zeta `STREAMING` mode, the default value is 30000 milliseconds.
27+
28+
### checkpoint.timeout
29+
30+
The timeout (in milliseconds) for a checkpoint. If the checkpoint is not completed before the timeout, the job will fail. In Zeta, the default value is 30000 milliseconds.
2731

2832
### parallelism
2933

3034
This parameter configures the parallelism of source and sink.
3135

36+
### shade.identifier
37+
38+
Specify the method of encryption, if you didn't have the requirement for encrypting or decrypting config files, this option can be ignored.
39+
40+
For more details, you can refer to the documentation [Config Encryption Decryption](../connector-v2/Config-Encryption-Decryption.md)
41+
42+
## Zeta Engine Parameter
43+
3244
### job.retry.times
3345

3446
Used to control the default retry times when a job fails. The default value is 3, and it only works in the Zeta engine.
@@ -43,12 +55,6 @@ This parameter is used to specify the location of the savemode when the job is e
4355
The default value is `CLUSTER`, which means that the savemode is executed on the cluster. If you want to execute the savemode on the client,
4456
you can set it to `CLIENT`. Please use `CLUSTER` mode as much as possible, because when there are no problems with `CLUSTER` mode, we will remove `CLIENT` mode.
4557

46-
### shade.identifier
47-
48-
Specify the method of encryption, if you didn't have the requirement for encrypting or decrypting config files, this option can be ignored.
49-
50-
For more details, you can refer to the documentation [Config Encryption Decryption](../connector-v2/Config-Encryption-Decryption.md)
51-
5258
## Flink Engine Parameter
5359

5460
Here are some SeaTunnel parameter names corresponding to the names in Flink, not all of them. Please refer to the official [Flink Documentation](https://flink.apache.org/).

docs/en/connector-v2/sink/Assert.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44
55
## Description
66

7-
A flink sink plugin which can assert illegal data by user defined rules
7+
A sink plugin which can assert illegal data by user defined rules
88

99
## Key Features
1010

docs/en/start-v2/docker/docker.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -146,14 +146,14 @@ docker run --rm -it apache/seatunnel bash -c '<YOUR_FLINK_HOME>/bin/start-cluste
146146

147147
there has 2 ways to create cluster within docker.
148148

149-
### 1. Use Docker Directly
149+
### Use Docker Directly
150150

151-
1. create a network
151+
#### create a network
152152
```shell
153153
docker network create seatunnel-network
154154
```
155155

156-
2. start the nodes
156+
#### start the nodes
157157
- start master node
158158
```shell
159159
## start master and export 5801 port
@@ -213,7 +213,7 @@ docker run -d --name seatunnel_worker_1 \
213213
```
214214

215215

216-
### 2. Use Docker-compose
216+
### Use Docker-compose
217217

218218
> docker cluster mode is only support zeta engine.
219219
@@ -368,7 +368,7 @@ and run `docker-compose up -d` command, the new worker node will start, and the
368368

369369
### Job Operation on cluster
370370

371-
1. use docker as a client
371+
#### use docker as a client
372372
- submit job :
373373
```shell
374374
docker run --name seatunnel_client \
@@ -393,7 +393,7 @@ more command please refer [user-command](../../seatunnel-engine/user-command.md)
393393

394394

395395

396-
2. use rest api
396+
#### use rest api
397397

398398
please refer [Submit A Job](../../seatunnel-engine/rest-api.md#submit-a-job)
399399

docs/en/start-v2/locally/deployment.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ You can download the source code from the [download page](https://seatunnel.apac
6969

7070
```shell
7171
cd seatunnel
72-
sh ./mvnw clean package -DskipTests -Dskip.spotless=true
72+
sh ./mvnw clean install -DskipTests -Dskip.spotless=true
7373
# get the binary package
7474
cp seatunnel-dist/target/apache-seatunnel-2.3.8-bin.tar.gz /The-Path-You-Want-To-Copy
7575

docs/zh/concept/JobEnvConfig.md

Lines changed: 14 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -21,14 +21,26 @@
2121

2222
### checkpoint.interval
2323

24-
获取定时调度检查点的时间间隔。
24+
获取定时调度检查点的时间间隔(毫秒)
2525

26-
`STREAMING`模式下,检查点是必须的,如果不设置,将从应用程序配置文件`seatunnel.yaml`中获取。 在`BATCH`模式下,您可以通过不设置此参数来禁用检查点。
26+
`STREAMING`模式下,检查点是必须的,如果不设置,将从应用程序配置文件`seatunnel.yaml`中获取。 在`BATCH`模式下,您可以通过不设置此参数来禁用检查点。在Zeta `STREAMING`模式下,默认值为30000毫秒。
27+
28+
### checkpoint.timeout
29+
30+
检查点的超时时间(毫秒)。如果检查点在超时之前没有完成,作业将失败。在Zeta中,默认值为30000毫秒。
2731

2832
### parallelism
2933

3034
该参数配置source和sink的并行度。
3135

36+
### shade.identifier
37+
38+
指定加密方式,如果您没有加密或解密配置文件的需求,此选项可以忽略。
39+
40+
更多详细信息,您可以参考文档 [Config Encryption Decryption](../../en/connector-v2/Config-Encryption-Decryption.md)
41+
42+
## Zeta 引擎参数
43+
3244
### job.retry.times
3345

3446
用于控制作业失败时的默认重试次数。默认值为3,并且仅适用于Zeta引擎。
@@ -44,12 +56,6 @@
4456
当值为`CLIENT`时,SaveMode操作在作业提交的过程中执行,使用shell脚本提交作业时,该过程在提交作业的shell进程中执行。使用rest api提交作业时,该过程在http请求的处理线程中执行。
4557
请尽量使用`CLUSTER`模式,因为当`CLUSTER`模式没有问题时,我们将删除`CLIENT`模式。
4658

47-
### shade.identifier
48-
49-
指定加密方式,如果您没有加密或解密配置文件的需求,此选项可以忽略。
50-
51-
更多详细信息,您可以参考文档 [Config Encryption Decryption](../../en/connector-v2/Config-Encryption-Decryption.md)
52-
5359
## Flink 引擎参数
5460

5561
这里列出了一些与 Flink 中名称相对应的 SeaTunnel 参数名称,并非全部,更多内容请参考官方 [Flink Documentation](https://flink.apache.org/) for more.

docs/zh/start-v2/docker/docker.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -149,14 +149,14 @@ docker下的集群模式仅支持Zeta引擎
149149
有两种方式来启动集群
150150

151151

152-
### 1. 直接使用Docker
152+
### 直接使用Docker
153153

154-
1. 创建一个network
154+
#### 创建一个network
155155
```shell
156156
docker network create seatunnel-network
157157
```
158158

159-
2. 启动节点
159+
#### 启动节点
160160
- 启动master节点
161161
```shell
162162
## start master and export 5801 port
@@ -214,7 +214,7 @@ docker run -d --name seatunnel_worker_1 \
214214
./bin/seatunnel-cluster.sh -r worker
215215
```
216216

217-
### 2. 使用docker-compose
217+
### 使用docker-compose
218218
`docker-compose.yaml` 配置文件为:
219219
```yaml
220220
version: '3.8'
@@ -360,7 +360,7 @@ networks:
360360

361361
### 提交作业到集群
362362

363-
1. 使用docker container作为客户端
363+
#### 使用docker container作为客户端
364364
- 提交任务
365365
```shell
366366
docker run --name seatunnel_client \
@@ -383,5 +383,5 @@ docker run --name seatunnel_client \
383383

384384
更多其他命令请参考[命令行工具](../../seatunnel-engine/user-command.md)
385385

386-
2. 使用RestAPI
386+
#### 使用RestAPI
387387
请参考 [提交作业](../../seatunnel-engine/rest-api.md#提交作业)

docs/zh/start-v2/locally/deployment.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ connector-console
6969

7070
```shell
7171
cd seatunnel
72-
sh ./mvnw clean package -DskipTests -Dskip.spotless=true
72+
sh ./mvnw clean install -DskipTests -Dskip.spotless=true
7373
# 获取构建好的二进制包
7474
cp seatunnel-dist/target/apache-seatunnel-2.3.8-bin.tar.gz /The-Path-You-Want-To-Copy
7575

0 commit comments

Comments
 (0)