You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: k8s/README.md
+23-14Lines changed: 23 additions & 14 deletions
Original file line number
Diff line number
Diff line change
@@ -1,4 +1,4 @@
1
-
# Runs PyFlink jobs on Kubernetes
1
+
# Run PyFlink jobs on Kubernetes
2
2
3
3
In this example, we'd like to give a simple example to show how to run PyFlink jobs on Kubernetes in application mode.
4
4
It has been documented clearly in Flink's [official documentation](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/resource-providers/native_kubernetes/) about how to work with Kubernetes.
@@ -57,8 +57,6 @@ Note: Make sure to publish the Docker image to a repository which is accessible
57
57
58
58
### Submit PyFlink jobs
59
59
60
-
#### Submit PyFlink on host machine
61
-
62
60
1) Download Flink distribution, e.g. for Flink 1.14.4, it's available in https://www.apache.org/dyn/closer.lua/flink/flink-1.14.4/flink-1.14.4-bin-scala_2.11.tgz
63
61
64
62
2) Extract it
@@ -71,11 +69,12 @@ tar zxvf flink-1.14.4-bin-scala_2.11.tgz
Among them, the JobManager runs in the pod `word-count-5f5d44b598-zg5z8 ` and the TaskManager runs in the pods `word-count-taskmanager-1-1` and `word-count-taskmanager-1-2`.
106
+
Among them, the JobManager runs in the pod `word-count-5f5d44b598-zg5z8 ` and the TaskManager runs in the pod `word-count-taskmanager-1-1`.
109
107
110
108
If the pods are not running normally, you could check the logs of the pods, e.g. checking the log of the JM as following:
Then you could access Flink's Web UI of the job via `http://127.0.0.1:8081`.
125
123
126
-
You could refer to Flink's [official documentation](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/resource-providers/native_kubernetes/#accessing-flinks-web-ui) on more details.
124
+
You could refer to Flink's [official documentation](https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/resource-providers/native_kubernetes/#accessing-flinks-web-ui) for more details.
127
125
128
126
### Cancel the jobs
129
127
130
-
You could either cancel the job through Flink's Web UI or via CLI commands as following:
128
+
You could either cancel the job through Flink's Web UI or REST API.
129
+
130
+
## FAQ
131
+
132
+
### 0/1 nodes are available: 1 Insufficient memory
131
133
134
+
If the pods of the TaskManagers are always running in `PENDING` status after a long while, you could use the following command to see what happens:
132
135
```shell
133
-
# list jobs:
134
-
./bin/flink list --target kubernetes-application -Dkubernetes.cluster-id=word-count
0 commit comments