Skip to content
This repository was archived by the owner on Feb 28, 2025. It is now read-only.

Commit 1f6aef9

Browse files
evantahleralafanechere
evantahler
and
alafanechere
authored
yum clean all after every yum install to save space (airbytehq#27555)
* `yum clean all` after every yum install to save space * docs and versions * update env clean * fix python install confusion --------- Co-authored-by: Augustin <[email protected]>
1 parent 6c62f38 commit 1f6aef9

File tree

28 files changed

+345
-327
lines changed

28 files changed

+345
-327
lines changed

‎airbyte-base-java-image/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ ARG DOCKER_BUILD_ARCH=amd64
44

55
WORKDIR /app
66

7-
RUN yum install -y tar
7+
RUN yum install -y tar && yum clean all
88

99
# Add the Datadog Java APM agent
1010
ADD https://dtdg.co/latest-java-tracer dd-java-agent.jar

‎airbyte-integrations/connectors/destination-bigquery/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ RUN tar xf ${APPLICATION}.tar --strip-components=1 && rm -rf ${APPLICATION}.tar
1818

1919
FROM airbyte/integration-base-java:dev
2020

21-
RUN yum install -y python3 python3-devel jq sshpass git && \
21+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
2222
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
2323
python -m ensurepip --upgrade && \
2424
pip3 install dbt-bigquery==1.0.0
@@ -44,7 +44,7 @@ ENV AIRBYTE_NORMALIZATION_INTEGRATION bigquery
4444

4545
COPY --from=build /airbyte /airbyte
4646

47-
LABEL io.airbyte.version=1.4.4
47+
LABEL io.airbyte.version=1.4.5
4848
LABEL io.airbyte.name=airbyte/destination-bigquery
4949

5050
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-bigquery/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: database
33
connectorType: destination
44
definitionId: 22f6c74f-5699-40ff-833c-4a879ea40133
5-
dockerImageTag: 1.4.4
5+
dockerImageTag: 1.4.5
66
dockerRepository: airbyte/destination-bigquery
77
githubIssueLabel: destination-bigquery
88
icon: bigquery.svg

‎airbyte-integrations/connectors/destination-clickhouse-strict-encrypt/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
# Please reach out to the Connectors Operations team if you have any question.
99
FROM airbyte/integration-base-java:dev AS build
1010

11-
RUN yum install -y python3 python3-devel jq sshpass git && \
11+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
1212
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
1313
python -m ensurepip --upgrade && \
1414
pip3 install dbt-clickhouse>=1.4.0
@@ -44,7 +44,7 @@ ENV AIRBYTE_NORMALIZATION_INTEGRATION clickhouse
4444

4545
COPY --from=build /airbyte /airbyte
4646

47-
LABEL io.airbyte.version=0.2.4
47+
LABEL io.airbyte.version=0.2.5
4848
LABEL io.airbyte.name=airbyte/destination-clickhouse-strict-encrypt
4949

5050
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-clickhouse-strict-encrypt/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ data:
77
connectorSubtype: database
88
connectorType: destination
99
definitionId: ce0d828e-1dc4-496c-b122-2da42e637e48
10-
dockerImageTag: 0.2.4
10+
dockerImageTag: 0.2.5
1111
dockerRepository: airbyte/destination-clickhouse-strict-encrypt
1212
githubIssueLabel: destination-clickhouse
1313
icon: clickhouse.svg

‎airbyte-integrations/connectors/destination-clickhouse/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
# Please reach out to the Connectors Operations team if you have any question.
99
FROM airbyte/integration-base-java:dev AS build
1010

11-
RUN yum install -y python3 python3-devel jq sshpass git && \
11+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
1212
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
1313
python -m ensurepip --upgrade && \
1414
pip3 install dbt-clickhouse>=1.4.0
@@ -44,7 +44,7 @@ ENV APPLICATION destination-clickhouse
4444

4545
COPY --from=build /airbyte /airbyte
4646

47-
LABEL io.airbyte.version=0.2.4
47+
LABEL io.airbyte.version=0.2.5
4848
LABEL io.airbyte.name=airbyte/destination-clickhouse
4949

5050
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-clickhouse/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: database
33
connectorType: destination
44
definitionId: ce0d828e-1dc4-496c-b122-2da42e637e48
5-
dockerImageTag: 0.2.4
5+
dockerImageTag: 0.2.5
66
dockerRepository: airbyte/destination-clickhouse
77
githubIssueLabel: destination-clickhouse
88
icon: clickhouse.svg

‎airbyte-integrations/connectors/destination-mssql-strict-encrypt/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
# Please reach out to the Connectors Operations team if you have any question.
99
FROM airbyte/integration-base-java:dev AS build
1010

11-
RUN yum install -y python3 python3-devel jq sshpass git && \
11+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
1212
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
1313
python -m ensurepip --upgrade && \
1414
pip3 install dbt-sqlserver==1.0.0
@@ -44,7 +44,7 @@ ENV APPLICATION destination-mssql-strict-encrypt
4444

4545
COPY --from=build /airbyte /airbyte
4646

47-
LABEL io.airbyte.version=0.1.24
47+
LABEL io.airbyte.version=0.1.25
4848
LABEL io.airbyte.name=airbyte/destination-mssql-strict-encrypt
4949

5050
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-mssql-strict-encrypt/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ data:
77
connectorSubtype: database
88
connectorType: destination
99
definitionId: d4353156-9217-4cad-8dd7-c108fd4f74cf
10-
dockerImageTag: 0.1.24
10+
dockerImageTag: 0.1.25
1111
dockerRepository: airbyte/destination-mssql-strict-encrypt
1212
githubIssueLabel: destination-mssql
1313
icon: mssql.svg

‎airbyte-integrations/connectors/destination-mssql/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
# Please reach out to the Connectors Operations team if you have any question.
99
FROM airbyte/integration-base-java:dev AS build
1010

11-
RUN yum install -y python3 python3-devel jq sshpass git && \
11+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
1212
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
1313
python -m ensurepip --upgrade && \
1414
pip3 install dbt-sqlserver==1.0.0
@@ -44,7 +44,7 @@ ENV APPLICATION destination-mssql
4444

4545
COPY --from=build /airbyte /airbyte
4646

47-
LABEL io.airbyte.version=0.1.24
47+
LABEL io.airbyte.version=0.1.25
4848
LABEL io.airbyte.name=airbyte/destination-mssql
4949

5050
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-mssql/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: database
33
connectorType: destination
44
definitionId: d4353156-9217-4cad-8dd7-c108fd4f74cf
5-
dockerImageTag: 0.1.24
5+
dockerImageTag: 0.1.25
66
dockerRepository: airbyte/destination-mssql
77
githubIssueLabel: destination-mssql
88
icon: mssql.svg

‎airbyte-integrations/connectors/destination-redshift/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
FROM airbyte/integration-base-java:dev AS build
1010

1111
# amazon linux 2 isn't compatible with urllib3 2.x, so force 1.26.15
12-
RUN yum install -y python3 python3-devel jq sshpass git && \
12+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
1313
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
1414
python -m ensurepip --upgrade && \
1515
pip3 install dbt-redshift==1.0.0 "urllib3<2"
@@ -43,7 +43,7 @@ ENV APPLICATION destination-redshift
4343

4444
COPY --from=build /airbyte /airbyte
4545

46-
LABEL io.airbyte.version=0.4.8
46+
LABEL io.airbyte.version=0.4.9
4747
LABEL io.airbyte.name=airbyte/destination-redshift
4848

4949
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-redshift/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: database
33
connectorType: destination
44
definitionId: f7a7d195-377f-cf5b-70a5-be6b819019dc
5-
dockerImageTag: 0.4.8
5+
dockerImageTag: 0.4.9
66
dockerRepository: airbyte/destination-redshift
77
githubIssueLabel: destination-redshift
88
icon: redshift.svg

‎airbyte-integrations/connectors/destination-s3/Dockerfile

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,5 +48,6 @@ RUN /bin/bash -c 'set -e && \
4848
echo "unknown arch" ;\
4949
fi'
5050

51-
LABEL io.airbyte.version=0.4.1
51+
RUN yum clean all
52+
LABEL io.airbyte.version=0.4.2
5253
LABEL io.airbyte.name=airbyte/destination-s3

‎airbyte-integrations/connectors/destination-s3/finalize_build.sh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,3 +34,5 @@ elif [ "$ARCH" == "aarch64" ] || [ "$ARCH" = "arm64" ]; then
3434
else
3535
echo "Unknown architecture"
3636
fi
37+
38+
yum clean all

‎airbyte-integrations/connectors/destination-s3/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: file
33
connectorType: destination
44
definitionId: 4816b78f-1489-44c1-9060-4b19d5fa9362
5-
dockerImageTag: 0.4.1
5+
dockerImageTag: 0.4.2
66
dockerRepository: airbyte/destination-s3
77
githubIssueLabel: destination-s3
88
icon: s3.svg

‎airbyte-integrations/connectors/destination-snowflake/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ FROM airbyte/integration-base-java:dev
1616
# rm /tmp/YourKit-JavaProfiler-2021.3-docker.zip
1717

1818
# amazon linux 2 isn't compatible with urllib3 2.x, so force 1.26.15
19-
RUN yum install -y python3 python3-devel jq sshpass git gcc-c++ && \
19+
RUN yum install -y python3 python3-devel jq sshpass git gcc-c++ && yum clean all && \
2020
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
2121
python -m ensurepip --upgrade && \
2222
pip3 install dbt-snowflake==1.0.0 "urllib3<2"
@@ -45,7 +45,7 @@ RUN tar xf ${APPLICATION}.tar --strip-components=1
4545

4646
ENV ENABLE_SENTRY true
4747

48-
LABEL io.airbyte.version=1.0.5
48+
LABEL io.airbyte.version=1.0.6
4949
LABEL io.airbyte.name=airbyte/destination-snowflake
5050

5151
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-snowflake/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: database
33
connectorType: destination
44
definitionId: 424892c4-daac-4491-b35d-c6688ba547ba
5-
dockerImageTag: 1.0.5
5+
dockerImageTag: 1.0.6
66
dockerRepository: airbyte/destination-snowflake
77
githubIssueLabel: destination-snowflake
88
icon: snowflake.svg

‎airbyte-integrations/connectors/destination-tidb/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
# Please reach out to the Connectors Operations team if you have any question.
99
FROM airbyte/integration-base-java:dev AS build
1010

11-
RUN yum install -y python3 python3-devel jq sshpass git && \
11+
RUN yum install -y python3 python3-devel jq sshpass git && yum clean all && \
1212
alternatives --install /usr/bin/python python /usr/bin/python3 60 && \
1313
python -m ensurepip --upgrade && \
1414
pip3 install dbt-tidb==1.0.1
@@ -42,7 +42,7 @@ ENV APPLICATION destination-tidb
4242

4343
COPY --from=build /airbyte /airbyte
4444

45-
LABEL io.airbyte.version=0.1.3
45+
LABEL io.airbyte.version=0.1.4
4646
LABEL io.airbyte.name=airbyte/destination-tidb
4747

4848
ENV AIRBYTE_ENTRYPOINT "/airbyte/run_with_normalization.sh"

‎airbyte-integrations/connectors/destination-tidb/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ data:
22
connectorSubtype: database
33
connectorType: destination
44
definitionId: 06ec60c7-7468-45c0-91ac-174f6e1a788b
5-
dockerImageTag: 0.1.3
5+
dockerImageTag: 0.1.4
66
dockerRepository: airbyte/destination-tidb
77
githubIssueLabel: destination-tidb
88
icon: tidb.svg

‎docs/integrations/destinations/bigquery.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -134,7 +134,8 @@ Now that you have set up the BigQuery destination connector, check out the follo
134134
### bigquery
135135

136136
| Version | Date | Pull Request | Subject |
137-
|:--------|:-----------|:-----------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------|
137+
| :------ | :--------- | :--------------------------------------------------------- | :----------------------------------------------------------------------------------------------------------------------- |
138+
| 1.4.5 | 2023-06-21 | [\#27555](https://github.com/airbytehq/airbyte/pull/27555) | Reduce image size |
138139
| 1.4.4 | 2023-05-25 | [\#26585](https://github.com/airbytehq/airbyte/pull/26585) | Small tweak in logs for clarity |
139140
| 1.4.3 | 2023-05-17 | [\#26213](https://github.com/airbytehq/airbyte/pull/26213) | Fix bug in parsing file buffer config count |
140141
| 1.4.2 | 2023-05-10 | [\#25925](https://github.com/airbytehq/airbyte/pull/25925) | Testing update. Normalization tests are now done in the destination container. |

0 commit comments

Comments
 (0)