Skip to content

added base images with transformer version 4 #247

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions container/ffmpeg-hf.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-ffmpeg-torch2:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg-hf image is shipped with clams-python, ffmpeg, and vairous huggingface libraries (PyTorch backend)"

RUN pip install --no-cache-dir transformers[torch,tokenizers]==4.*
RUN pip install --no-cache-dir datasets

7 changes: 7 additions & 0 deletions container/ffmpeg-tf2-hf.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-ffmpeg-tf2-torch2:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg-tf2-hf image is shipped with clams-python, ffmpeg, tensorflow2, and vairous huggingface libraries"

RUN pip install --no-cache-dir transformers[tf,tokenizers]==4.*
RUN pip install --no-cache-dir datasets

3 changes: 2 additions & 1 deletion container/ffmpeg-tf2.containerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-ffmpeg:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg-tf2 image is shipped with clams-python, ffmpeg and tensorflow2 libraries"
LABEL org.opencontainers.image.description="clams-python-ffmpeg-tf2 image is shipped with clams-python, ffmpeg, and tensorflow2"

RUN apt-get install -y build-essential libhdf5-dev
RUN pip install --no-cache-dir tensorflow==2.*

3 changes: 2 additions & 1 deletion container/ffmpeg-torch2.containerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-ffmpeg:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg-torch image is shipped with clams-python, ffmpeg and PyTorch2"
LABEL org.opencontainers.image.description="clams-python-ffmpeg-torch2 image is shipped with clams-python, ffmpeg, and PyTorch2"

RUN pip install --no-cache-dir torch==2.*

Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-ffmpeg:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg-torch image is shipped with clams-python, ffmpeg and PyTorch"
LABEL org.opencontainers.image.description="clams-python-ffmpeg-transformers4 image is shipped with clams-python, ffmpeg and HF's transformers4"

RUN pip install --no-cache-dir torch==1.*
RUN pip install --no-cache-dir transformers==4.*
3 changes: 2 additions & 1 deletion container/ffmpeg.containerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg image is shipped with clams-python and ffmpeg (+ python binding)"
LABEL org.opencontainers.image.description="clams-python-ffmpeg image is shipped with clams-python and ffmpeg"

RUN apt-get update && apt-get install -y ffmpeg
RUN pip install --no-cache-dir ffmpeg-python==0.2.*

7 changes: 7 additions & 0 deletions container/hf.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python--torch2:$clams_version
LABEL org.opencontainers.image.description="clams-python-hf image is shipped with clams-python and vairous huggingface libraries (PyTorch backend)"

RUN pip install --no-cache-dir transformers[torch,tokenizers]==4.*
RUN pip install --no-cache-dir datasets

1 change: 1 addition & 0 deletions container/jdk8.containerfile
Original file line number Diff line number Diff line change
Expand Up @@ -5,3 +5,4 @@ LABEL org.opencontainers.image.description="clams-python-jdk8 image is shipped w
ENV JAVA_HOME=/opt/java/openjdk
COPY --from=eclipse-temurin:8 $JAVA_HOME $JAVA_HOME
ENV PATH="${JAVA_HOME}/bin:${PATH}"

7 changes: 7 additions & 0 deletions container/opencv4-hf.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-opencv4-torch2:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv4-hf image is shipped with clams-python, opencv4 (ffmpeg backend), and vairous huggingface libraries (PyTorch backend)"

RUN pip install --no-cache-dir transformers[torch,tokenizers]==4.*
RUN pip install --no-cache-dir datasets

7 changes: 7 additions & 0 deletions container/opencv4-tf2-hf.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-opencv4-tf2-torch2:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv4-tf2-hf image is shipped with clams-python, opencv4 (ffmpeg backend), tensorflow2, and vairous huggingface libraries"

RUN pip install --no-cache-dir transformers[tf,tokenizers]==4.*
RUN pip install --no-cache-dir datasets

3 changes: 2 additions & 1 deletion container/opencv4-tf2.containerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-opencv4:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv4-tf2 image is shipped with clams-python, ffmpeg, opencv4 and tensorflow2 libraries"
LABEL org.opencontainers.image.description="clams-python-opencv4-tf2 image is shipped with clams-python, opencv4 (ffmpeg backend), and tensorflow2"

RUN apt-get install -y build-essential libhdf5-dev
RUN pip install --no-cache-dir tensorflow==2.*

3 changes: 2 additions & 1 deletion container/opencv4-torch2.containerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-opencv4:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv4-torch image is shipped with clams-python, ffmpeg, opencv4, and PyTorch2"
LABEL org.opencontainers.image.description="clams-python-opencv4-torch2 image is shipped with clams-python, opencv4 (ffmpeg backend), and PyTorch2"

RUN pip install --no-cache-dir torch==2.*

Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-opencv4:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv4-torch image is shipped with clams-python, ffmpeg, opencv4, and PyTorch"
LABEL org.opencontainers.image.description="clams-python-opencv4-transformers4 image is shipped with clams-python, ffmpeg, opencv4, and HF's transformers4"

RUN pip install --no-cache-dir torch==1.*
RUN pip install --no-cache-dir transformers==4.*
5 changes: 3 additions & 2 deletions container/opencv4.containerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-ffmpeg:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv image is shipped with clams-python, ffmpeg, and opencv4 with their python bindings"
FROM ghcr.io/clamsproject/clams-python--ffmpeg:$clams_version
LABEL org.opencontainers.image.description="clams-python-opencv4 image is shipped with clams-python and opencv4 (ffmpeg backend)"

ARG OPENCV_VERSION=4.10.0
ARG OPENCV_PATH=/opt/opencv-${OPENCV_VERSION}
Expand Down Expand Up @@ -43,3 +43,4 @@ RUN rm -rf ${OPENCV_PATH} ${OPENCV_EXTRA_PATH}
RUN pip uninstall opencv-python
RUN pip install --no-cache-dir opencv-python-headless~=${OPENCV_VERSION}
RUN apt-get remove -y g++ cmake make wget unzip libavcodec-dev libavformat-dev libavutil-dev libswscale-dev && apt-get autoremove -y

7 changes: 7 additions & 0 deletions container/tf2-hf.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python-tf2-torch2:$clams_version
LABEL org.opencontainers.image.description="clams-python-tf2-hf image is shipped with clams-python, tensorflow2, and vairous huggingface libraries"

RUN pip install --no-cache-dir transformers[tf,tokenizers]==4.*
RUN pip install --no-cache-dir datasets

1 change: 1 addition & 0 deletions container/tf2.containerfile
Original file line number Diff line number Diff line change
Expand Up @@ -4,3 +4,4 @@ LABEL org.opencontainers.image.description="clams-python-tf2 image is shipped wi

RUN apt-get install -y build-essential libhdf5-dev
RUN pip install --no-cache-dir tensorflow==2.*

5 changes: 0 additions & 5 deletions container/torch.containerfile

This file was deleted.

3 changes: 2 additions & 1 deletion container/torch2.containerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python:$clams_version
LABEL org.opencontainers.image.description="clams-python-ffmpeg image is shipped with clams-python and PyTorch2"
LABEL org.opencontainers.image.description="clams-python-torch2 image is shipped with clams-python and PyTorch2"

RUN pip install --no-cache-dir torch==2.*

5 changes: 5 additions & 0 deletions container/transformers4.containerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
ARG clams_version
FROM ghcr.io/clamsproject/clams-python:$clams_version
LABEL org.opencontainers.image.description="clams-python-transformers4 image is shipped with clams-python and HF's transformers4"

RUN pip install --no-cache-dir transformers==4.*