Add a faster way of launching Stable Diffusion example by pulling Docker image from GCR (skypilot-org#1216)

* add a faster way of launching stable diffusion example by pulling docker image from gcr

* addressed PR comments

* address more PR comments

* fix more PR comments

* add fixes to yaml file since model path has been updated

* tailing space

Co-authored-by: Sumanth <[email protected]>
Co-authored-by: Sumanth <[email protected]>
Co-authored-by: Zhanghao Wu <[email protected]>

Author: 4 people

examples/stable_diffusion/README.md

@@ -2,19 +2,21 @@
 
 1. Install skypilot package by following these [instructions](https://skypilot.readthedocs.io/en/latest/getting-started/installation.html).
 
-2. Run: `git clone https://github.com/skypilot-org/skypilot.git && cd examples/stable_diffusion`.
+2. Run `git clone https://github.com/skypilot-org/skypilot.git && cd examples/stable_diffusion`
 
-3. Run `sky launch -c stable-diffusion stable_diffusion_docker.yaml`.
+3. Run `sky launch -c stable-diffusion stable_diffusion_docker.yaml` 
 
-4. Run `ssh -L 7860:localhost:7860 stable-diffusion`.
+4. Run `ssh -L 7860:localhost:7860 stable-diffusion`
 
 5. Open [`http://localhost:7860/`](http://localhost:7860/) in browser.
 
 6. Type in text prompt and click "Generate".
 
 ![Stable Diffusion Web Tool UI](assets/stable_diffusion_ui.png)
 
-7. Once you are done, run `sky down stable-diffusion` to terminate the VM.
+7. Once you are done, run `sky stop stable-diffusion` to stop the VM.
+
+8. To restart VM, repeat steps 3 and 4.
 
 
 ## Usage Tips
@@ -37,3 +39,4 @@
    - "rap song album cover"
    - "Wall Street bull rodeo"
    - "Trump in minecraft"
+   

examples/stable_diffusion/docker-compose.yml

@@ -0,0 +1,21 @@
+version: '3.9'
+
+services:
+  model:
+    image: berkeleyskypilot/stable-diffusion
+    restart: on-failure
+    ports:
+      - "7860:7860"
+    volumes:
+      - ./cache:/cache
+      - ./output:/output
+      - ./models:/models
+    environment:
+      - CLI_ARGS=--extra-models-cpu --optimized-turbo
+    deploy:
+      resources:
+        reservations:
+          devices:
+              - driver: nvidia
+                device_ids: ['0']
+                capabilities: [gpu]

examples/stable_diffusion/pushing_docker_image.md

@@ -0,0 +1,34 @@
+## GCR
+
+1. Install skypilot package by following these [instructions](https://skypilot.readthedocs.io/en/latest/getting-started/installation.html).
+
+2. Run `git clone https://github.com/skypilot-org/skypilot.git `.
+
+3. Steps 4-6 are based on these [GCR setup instructions](https://cloud.google.com/container-registry/docs/pushing-and-pulling)
+
+4. First [enable container registry](https://cloud.google.com/container-registry/docs/enable-service) in your project
+
+5. Next follow these [steps](https://cloud.google.com/container-registry/docs/advanced-authentication) to install and authenticate Docker on your CLI
+
+6. Ensure that you have [Storage Admin](https://cloud.google.com/storage/docs/access-control/iam-roles) permission in your project
+
+7. Run `cd skypilot/examples/stable_diffusion` and `docker build Dockerfile`
+
+8. Run `docker tag stable-diffusion-webui-docker_model gcr.io/(my-project)/stable-diffusion`.
+
+9. Run `docker push gcr.io/(my-project)/stable-diffusion` and verify on GCR that the image is there.
+
+## DockerHub
+
+1. Make a free [DockerHub](https://hub.docker.com/) account.
+
+2. In your CLI, run `docker login` and use the login credentials from your DockerHub account.
+
+3. Run `cd skypilot/examples/stable_diffusion` and `docker build Dockerfile`
+
+4. Run `docker tag stable-diffusion-webui-docker_model (my-dockerhub-username)/stable-diffusion`.
+
+5. Run `docker push (my-dockerhub-username)/stable-diffusion` and verify on Dockerhub that the image is there.
+
+
+

examples/stable_diffusion/stable_diffusion_docker.yaml

@@ -7,17 +7,18 @@ file_mounts:
   /stable_diffusion: .
 
 setup: |
-  sudo rm -r stable-diffusion-webui-docker
-  git clone https://github.com/AbdBarho/stable-diffusion-webui-docker.git
   sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
   sudo chmod +x /usr/local/bin/docker-compose
+  cd stable-diffusion-webui-docker  
+  sudo rm -r stable-diffusion-webui-docker
+  git clone https://github.com/AbdBarho/stable-diffusion-webui-docker.git
   cd stable-diffusion-webui-docker
   git reset --hard 0d8b7d4ac8f9ba99e041ca332547eab9d65e6360
-  wget https://www.googleapis.com/storage/v1/b/aai-blog-files/o/sd-v1-4.ckpt?alt=media -P models
-  mv models/'sd-v1-4.ckpt?alt=media' models/model.ckpt
-  rm build/Dockerfile
-  cp /stable_diffusion/Dockerfile build/
-  docker-compose build
+  wget https://huggingface.co/CompVis/stable-diffusion-v-1-4-original/resolve/main/sd-v1-4.ckpt -P models
+  mv models/sd-v1-4.ckpt models/model.ckpt
+  docker pull berkeleyskypilot/stable-diffusion
+  rm docker-compose.yml
+  cp /stable_diffusion/docker-compose.yml .
 
 run: |
   cd stable-diffusion-webui-docker