Skip to content

Commit 708276b

Browse files
suzhoujiaoyirensuzhoujiaoyiren
committed
Improve the deploy_guide module
1 parent 2a505eb commit 708276b

File tree

2 files changed

+160
-53
lines changed

2 files changed

+160
-53
lines changed

‎docs/docs/deploy_guide/compile.mdx

+66-46
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ title: 编译
99
| **环境** | **版本** | 备注 |
1010
|---------|-----------|---------------------|
1111
| npm | 7.19.0 | |
12-
| node.js | 14.19.0 | |
12+
| node.js | 14.19.0+ | |
1313
| jdk | 1.8.0_201 | |
1414
| maven | 3.6.3 | |
1515
| lombok | 1.18.24 | 如果在idea编译，需要自行安装 插件 |
@@ -24,7 +24,7 @@ import TabItem from '@theme/TabItem';
2424
<Tabs groupId="operating-systems">
2525
<TabItem value="win" label="Windows" default>
2626

27-
[下载地址]( https://registry.npmmirror.com/-/binary/node/v14.19.0/node-v14.19.0-x64.msi)
27+
[node-v14.19.0 下载地址]( https://registry.npmmirror.com/-/binary/node/v14.19.0/node-v14.19.0-x64.msi)
2828

2929
下载完成后，双击傻瓜式安装即可
3030

@@ -37,7 +37,7 @@ npm install -g [email protected]
3737
</TabItem>
3838
<TabItem value="linux" label="Linux">
3939

40-
[下载地址](https://nodejs.org/download/release/v14.19.1/node-v14.19.1-linux-x64.tar.gz)
40+
[node-v14.19.1 下载地址](https://nodejs.org/download/release/v14.19.1/node-v14.19.1-linux-x64.tar.gz)
4141

4242
下载完成后，安装配置即可，操作如下：
4343

@@ -59,7 +59,7 @@ npm install -g [email protected]
5959
</TabItem>
6060
<TabItem value="mac" label="MacOS">
6161

62-
[下载地址]( https://registry.npmmirror.com/-/binary/node/v14.19.0/node-v14.19.0.pkg)
62+
[node-v14.19.0 下载地址]( https://registry.npmmirror.com/-/binary/node/v14.19.0/node-v14.19.0.pkg)
6363

6464
下载完成后，双击傻瓜式安装即可
6565

@@ -74,41 +74,72 @@ MySQL版本选择5.7+
7474
<Tabs groupId="operating-systems">
7575
<TabItem value="win" label="Windows" default>
7676

77-
[下载地址](https://dev.mysql.com/downloads/file/?id=510038)
77+
[mysql-8.0+ 下载地址](https://dev.mysql.com/downloads/file/?id=510038)
7878

7979
下载完成后，双击傻瓜式安装即可
8080

8181
</TabItem>
8282
<TabItem value="linux" label="Linux">
8383

84-
[下载地址](http://dev.mysql.com/get/mysql57-community-release-el7-10.noarch.rpm)
84+
本次以ARM架构下安装为例，与X86架构步骤相似。MySQL版本选择5.7+
8585

86+
[mysql-8.0.30 下载地址](https://downloads.mysql.com/archives/community/)
87+
![mysql-download](http://www.aiwenmo.com/dinky/docs/test/mysql-download.png)
8688
下载完成后，安装配置即可，操作如下：
87-
8889
```bash
89-
#如果没有wget命令
90-
yum install wget
91-
#下载mysql 5.7
92-
wget http://dev.mysql.com/get/mysql57-community-release-el7-11.noarch.rpm
93-
#安装yum repository
94-
yum -y install mysql57-community-release-el7-11.noarch.rpm
95-
#在线安装
96-
yum -y install mysql-community-server
97-
#修改配置文件
98-
vi /etc/my.cnf
99-
skip-grant-tables #末尾添加这句话，这时候登入mysql就不需要密码
100-
#开启mysql服务
101-
service mysqld start
102-
#空密码登录mysql
90+
#卸载系统自带的MySQL和MariaDB
91+
rpm -qa | grep mariadb
92+
rpm -e --nodeps mariadb-libs
93+
rpm -e mariadb-server --nodeps
94+
rm -rf /var/lib/mysql
95+
cd /var/log
96+
rm -rf mysql.log
97+
rm -rf mysqld.log
98+
#解压并安装
99+
tar -xvf mysql-8.0.30-1.el7.aarch64.rpm-bundle.tar
100+
#安装依赖库（离线环境需要配置yum源）
101+
yum install -y libaio*
102+
yum install -y libncurses*
103+
#安装rpm包
104+
rpm -ivh mysql-community-common-8.0.30-1.el8.aarch64.rpm
105+
rpm -ivh mysql-community-client-plugins-8.0.30-1.el8.aarch64.rpm
106+
rpm -ivh mysql-community-libs-8.0.30-1.el8.aarch64.rpm
107+
rpm -ivh mysql-community-client-8.0.30-1.el8.aarch64.rpm
108+
rpm -ivh mysql-community-icu-data-files-8.0.30-1.el8.aarch64.rpm
109+
rpm -ivh mysql-community-server-8.0.30-1.el8.aarch64.rpm
110+
#安装过程报错
111+
这里可能会因为缺少compat-openssl报错,官网地址CentOS Repositories - pkgs.org
112+
下载链接：https://vault.centos.org/centos/8/AppStream/aarch64/os/Packages/compat-openssl10-1.0.2o-3.el8.aarch64.rpm
113+
#添加大小写敏感参数
114+
vim /etc/my.cnf
115+
lower-case-table-names=1
116+
#初始化数据库
117+
mysqld --initialize --console --lower-case-table-names=1
118+
#目录授权
119+
chown -R mysql:mysql /var/lib/mysql/
120+
#启动
121+
systemctl rstart mysqld
122+
#查看临时密码
123+
grep 'temporary password' /var/log/mysqld.log
124+
#使用临时密码登录
103125
mysql -u root -p
104-
#设置root密码
105-
flush privileges;
106-
set password for root@localhost = password('123456');
107-
#恢复mysql配置
108-
service mysqld stop #停止mysql服务
126+
#修改临时密码
127+
ALTER USER 'root'@'localhost' IDENTIFIED WITH mysql_native_password BY '你的密码';
128+
#设置远程访问权限
129+
mysql> create user 'bigdata'@'%' identified by 'Mssq@2022!';
130+
Query OK, 0 rows affected (0.01 sec)
131+
mysql> GRANT ALL PRIVILEGES ON *.* TO 'bigdata'@'%' WITH GRANT OPTION;
132+
Query OK, 0 rows affected (0.01 sec)
133+
#调优
109134
vi /etc/my.cnf #修改配置文件
110135
# skip-grant-tables # 注释掉这句话
111-
service mysqld start # 启动mysql服务
136+
#添加以下内容
137+
[mysql]
138+
default-character-set = utf8mb4
139+
[client]
140+
default-character-set = utf8mb4
141+
[mysqld]
142+
max_connections=1000
112143
#设置开机自启动
113144
systemctl enable mysqld
114145
-------------------------------修改密码策略-------------------------
@@ -119,17 +150,6 @@ collation_server = utf8mb4_general_ci
119150
character_set_server = utf8mb4
120151
#重启服务
121152
service mysqld restart 或者 systemctl restart mysqld.service
122-
123-
#卸载自动更新
124-
yum -y remove mysql57-community-release-el7-11.noarch
125-
126-
------------------------------------远程连接----------------------------
127-
#输入mysql -uroot -p123456 进入到mysql命令行
128-
#授权
129-
grant all privileges on *.* to 'root'@'%' identified by '123456' with grant option;
130-
#刷新权限
131-
flush privileges;
132-
133153
---------------------------------修改默认编码-------------------------------------------
134154
#root用户
135155
vi /etc/my.cnf
@@ -159,34 +179,34 @@ SHOW VARIABLES LIKE 'collation_%'; 排序规则
159179
<Tabs groupId="operating-systems">
160180
<TabItem value="win" label="Windows" default>
161181

162-
[下载地址](https://dlcdn.apache.org/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.zip)
182+
[apache-maven-3.8.8下载地址](https://dlcdn.apache.org/maven/maven-3/3.8.8/binaries/apache-maven-3.8.8-bin.zip)
163183

164184
下载完成后后，解压到对应目录
165185

166186
```
167-
1.将安装包解压到某目录，这里解压到C:\Program Files\apache-maven-3.6.3
168-
3.设置系统变量MAVEN_HOME，值为C:\Program Files\apache-maven-3.6.3
187+
1.将安装包解压到某目录，这里解压到C:\Program Files\apache-maven-3.8.8
188+
3.设置系统变量MAVEN_HOME，值为C:\Program Files\apache-maven-3.8.8
169189
4. 更新 PATH 变量，添加 Maven bin 文件夹到 PATH 的最后，%MAVEN_HOME%\bin
170190
完成，以验证它，执行 mvn –v 在命令提示符
171191
```
172192

173193
</TabItem>
174194
<TabItem value="linux" label="Linux">
175195

176-
[下载地址](https://dlcdn.apache.org/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz)
196+
[apache-maven-3.8.8 下载地址](https://dlcdn.apache.org/maven/maven-3/3.8.8/binaries/apache-maven-3.8.8-bin.tar.gz)
177197

178198
下载完成后后，解压到对应目录
179199

180200
解压安装
181201

182202
```bash
183-
tar xf apache-maven-3.6.3-bin.tar.gz -C /opt/module/
203+
tar xf apache-maven-3.8.8-bin.tar.gz -C /opt/module/
184204
cd /opt/module/
185-
mv apache-maven-3.6.3-bin maven-3.6.3
205+
mv apache-maven-3.8.8-bin maven-3.8.8
186206

187207
#添加环境变量
188208
vim /etc/profile
189-
export MAVEN_HOME=/opt/module/maven-3.6.3
209+
export MAVEN_HOME=/opt/module/maven-3.8.8
190210
export PATH=$MAVEN_HOME/bin:$PATH
191211

192212
#保存退出，刷新环境变量
@@ -233,7 +253,7 @@ maven ->> dinky->> 配置文件->> 生命周期->> 跳过测试 ->> 双击 insta
233253

234254
具体 `profile` 选择请参考如上
235255

236-
![local_debug_maven_profile_intro.png](http://www.aiwenmo.com/dinky/docs/zh-CN/developer_guide/local_debug/local_debug_maven_profile_intro.png)
256+
![local_debug_maven_profile_intro.png](http://www.aiwenmo.com/dinky/docs/test/local_debug_maven_profile_intro.png)
237257

238258
说明：如果要对 Dinky 做二次开发，详见开发者指南中的[本地调试](../developer_guide/local_debug)
239259
:::

‎docs/docs/deploy_guide/deploy.mdx

+94-7
Original file line numberDiff line numberDiff line change
@@ -130,19 +130,26 @@ https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-hadoop-3-uber?r
130130
│ ├── dlink-app-1.13-${VERSION}-jar-with-dependencies.jar -- 适配 Flink1.13.x application
131131
│ ├── dlink-app-1.14-${VERSION}-jar-with-dependencies.jar -- 适配 Flink1.14.x application
132132
│ ├── dlink-app-1.15-${VERSION}-jar-with-dependencies.jar -- 适配 Flink1.15.x application
133-
│ └── dlink-app-1.16-${VERSION}-jar-with-dependencies.jar -- 适配 Flink1.16.x application
133+
│ ├── dlink-app-1.16-${VERSION}-jar-with-dependencies.jar -- 适配 Flink1.16.x application
134+
│ └── dlink-app-1.17-${VERSION}-jar-with-dependencies.jar -- 适配 Flink1.17.x application
134135
├── lib
135136
│ ├── dlink-admin-${VERSION}.jar --主程序包
136137
│ ├── dlink-alert-base-${VERSION}.jar
137138
│ ├── dlink-alert-dingtalk-${VERSION}.jar
138139
│ ├── dlink-alert-email-${VERSION}.jar
139140
│ ├── dlink-alert-feishu-${VERSION}.jar
141+
│ ├── dlink-alert-sms-${VERSION}.jar
140142
│ ├── dlink-alert-wechat-${VERSION}.jar
143+
│ ├── dlink-catalog-mysql-1.14-${VERSION}.jar
144+
│ ├── dlink-cdc-core-${VERSION}.jar
141145
│ ├── dlink-client-base-${VERSION}.jar
146+
│ ├── dlink-client-${VERSION}.jar
147+
│ ├── dlink-client-hadoop-${VERSION}.jar
142148
│ ├── dlink-common-${VERSION}.jar
149+
│ ├── dlink-connector-jdbc-1.14-${VERSION}.jar
143150
│ ├── dlink-core-${VERSION}.jar
144151
│ ├── dlink-daemon-${VERSION}.jar
145-
│ ├── dlink-executor-${VERSION}.jar
152+
│ ├── dlink-flink-1.14-${VERSION}.jar
146153
│ ├── dlink-function-${VERSION}.jar
147154
│ ├── dlink-gateway-${VERSION}.jar
148155
│ ├── dlink-metadata-base-${VERSION}.jar
@@ -156,8 +163,84 @@ https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-hadoop-3-uber?r
156163
│ ├── dlink-metadata-presto-${VERSION}.jar
157164
│ ├── dlink-metadata-sqlserver-${VERSION}.jar
158165
│ ├── dlink-metadata-starrocks-${VERSION}.jar
159-
│ ├── dlink-process-${VERSION}.jar
160166
│ ├── dlink-scheduler-${VERSION}.jar
167+
│ ├── accessors-smart-2.4.9.jar
168+
│ ├── activation-1.1.1.jar
169+
│ ├── aircompressor-0.8.jar
170+
│ ├── ant-1.6.5.jar
171+
│ ├── ant-1.9.1.jar
172+
│ ├── ant-launcher-1.9.1.jar
173+
│ ├── antlr-runtime-3.5.2.jar
174+
│ ├── aopalliance-1.0.jar
175+
│ ├── argparse4j-0.8.1.jar
176+
│ ├── asm-3.1.jar
177+
│ ├── asm-9.3.jar
178+
│ ├── asm-all-5.0.2.jar
179+
│ ├── asm-commons-3.1.jar
180+
│ ├── asm-tree-3.1.jar
181+
│ ├── aspectjweaver-1.9.7.jar
182+
│ ├── audience-annotations-0.5.0.jar
183+
│ ├── avatica-core-1.17.0.jar
184+
│ ├── avro-1.7.7.jar
185+
│ ├── awaitility-4.2.0.jar
186+
│ ├── aws-java-sdk-core-1.12.589.jar
187+
│ ├── aws-java-sdk-kms-1.12.589.jar
188+
│ ├── aws-java-sdk-s3-1.12.589.jar
189+
│ ├── bcpkix-jdk15on-1.69.jar
190+
│ ├── bcprov-ext-jdk15on-1.69.jar
191+
│ ├── bcprov-jdk15on-1.69.jar
192+
│ ├── bcutil-jdk15on-1.69.jar
193+
│ ├── bonecp-0.8.0.RELEASE.jar
194+
│ ├── byte-buddy-1.12.23.jar
195+
│ ├── checker-qual-3.12.0.jar
196+
│ ├── chill_2.12-0.7.6.jar
197+
│ ├── chill-java-0.7.6.jar
198+
│ ├── classgraph-4.1.7.jar
199+
│ ├── classmate-1.5.1.jar
200+
│ ├── clickhouse-jdbc-0.2.6.jar
201+
│ ├── commonmark-0.21.0.jar
202+
│ ├── commons-beanutils-1.9.4.jar
203+
│ ├── commons-cli-1.3.1.jar
204+
│ ├── commons-codec-1.15.jar
205+
│ ├── commons-collections-3.2.2.jar
206+
│ ├── commons-collections4-4.4.jar
207+
│ ├── commons-compiler-3.1.9.jar
208+
│ ├── commons-compress-1.21.jar
209+
│ ├── commons-configuration2-2.1.1.jar
210+
│ ├── commons-csv-1.0.jar
211+
│ ├── commons-daemon-1.0.13.jar
212+
│ ├── commons-dbcp-1.4.jar
213+
│ ├── commons-el-1.0.jar
214+
│ ├── commons-email-1.5.jar
215+
│ ├── commons-httpclient-3.1.jar
216+
│ ├── commons-io-2.11.0.jar
217+
│ ├── commons-jexl3-3.2.1.jar
218+
│ ├── commons-lang-2.6.jar
219+
│ ├── commons-lang3-3.3.2.jar
220+
│ ├── commons-logging-1.2.jar
221+
│ ├── commons-math-2.2.jar
222+
│ ├── commons-math3-3.6.1.jar
223+
│ ├── commons-net-3.6.jar
224+
│ ├── commons-pool-1.6.jar
225+
│ ├── commons-text-1.4.jar
226+
│ ├── curator-client-4.2.0.jar
227+
│ ├── curator-framework-2.7.1.jar
228+
│ ├── curator-recipes-4.2.0.jar
229+
│ ├── curvesapi-1.07.jar
230+
│ ├── datanucleus-api-jdo-4.2.4.jar
231+
│ ├── datanucleus-core-4.1.17.jar
232+
│ ├── datanucleus-rdbms-4.1.19.jar
233+
│ ├── derby-10.14.2.0.jar
234+
│ ├── disruptor-3.3.6.jar
235+
│ ├── dnsjava-2.1.7.jar
236+
│ ├── docker-java-api-3.2.14.jar
237+
│ ├── docker-java-core-3.2.14.jar
238+
│ ├── docker-java-transport-3.2.14.jar
239+
│ ├── docker-java-transport-httpclient5-3.2.14.jar
240+
│ ├── dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
241+
│ ├── druid-1.2.8.jar
242+
│ ├── druid-spring-boot-starter-1.2.8.jar
243+
│ ├── easy-rules-core-4.1.0.jar
161244
├── plugins
162245
│ ├── flink1.13 -- 适配 Flink1.13.x
163246
│ ├── dinky-connector-jdbc-1.13-${VERSION}.jar -- dlink 的 jdbc 连接器增强实现
@@ -170,9 +253,13 @@ https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-hadoop-3-uber?r
170253
│ ├── flink1.15 -- 适配 Flink1.15.x
171254
│ │ ├── dlink-catalog-mysql-1.15-${VERSION}.jar -- dlink 的 catalog 实现
172255
│ │ └── dlink-client-1.15-${VERSION}.jar
173-
│ └── flink1.16 -- 适配 Flink1.15.x
174-
│ ├── dlink-catalog-mysql-1.16-${VERSION}.jar -- dlink 的 catalog 实现
175-
│ └── dlink-client-1.16-${VERSION}.jar
256+
│ ├── flink1.16 -- 适配 Flink1.15.x
257+
│ │ ├── dlink-catalog-mysql-1.16-${VERSION}.jar -- dlink 的 catalog 实现
258+
│ │ └── dlink-client-1.16-${VERSION}.jar
259+
│ ├── flink1.16 -- 适配 Flink1.15.x
260+
│ ├── dlink-catalog-mysql-1.17-${VERSION}.jar -- dlink 的 catalog 实现
261+
│ │ └── dlink-client-1.17-${VERSION}.jar
262+
│ └──
176263
└── sql
177264
├── dinky-mysql.sql -- Mysql 首次初始化脚本
178265
└── upgrade -- 各个版本的升级 SQL
@@ -196,7 +283,7 @@ sh auto.sh status
196283
```
197284

198285
#### 版本适配
199-
启动指令的第二个参数则是版本选择，支持 【1.13, 1.14, 1.15, 1.16】,参考指令如下：
286+
启动指令的第二个参数则是版本选择，支持 【1.13, 1.14, 1.15, 1.16,1.17】,参考指令如下：
200287
```shell
201288
#启动
202289
sh auto.sh start 1.14

0 commit comments

Comments
 (0)