add demo video

Author: mv-lab

README.md

@@ -1,5 +1,5 @@
 # InstructIR ✏️🖼️
-## [High-Quality Image Restoration Following Human Instructions](https://mv-lab.github.io/InstructIR/)
+## [High-Quality Image Restoration Following Human Instructions](https://arxiv.org/abs/2401.16468)
 
 [![arXiv](https://img.shields.io/badge/arXiv-Paper-<COLOR>.svg)](https://arxiv.org/abs/2401.16468)
 <a href="https://colab.research.google.com/drive/1OrTvS-i6uLM2Y8kIkq8ZZRwEQxQFchfq?usp=sharing"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="google colab logo"></a> 
@@ -8,11 +8,15 @@
 [![Paper page](https://huggingface.co/datasets/huggingface/badges/resolve/main/paper-page-sm.svg)](https://huggingface.co/papers/2401.16468)
 
 
-[Marcos V. Conde](https://scholar.google.com/citations?user=NtB1kjYAAAAJ&hl=en), [Gregor Geigle](https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en), [Radu Timofte](https://scholar.google.com/citations?user=u3MwH5kAAAAJ&hl=en)
+[Marcos V. Conde](https://mv-lab.github.io/), [Gregor Geigle](https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en), [Radu Timofte](https://scholar.google.com/citations?user=u3MwH5kAAAAJ&hl=en)
 
 Computer Vision Lab, University of Wuerzburg | Sony PlayStation, FTG
 
-<a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir_teaser.png" alt="InstructIR" width=100%></a>
+
+<a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir.gif" alt="InstructIR" width=100%></a>
+
+Video courtesy of Gradio ([see their post about InstructIR](https://twitter.com/Gradio/status/1752776176811041049)). Also shoutout to AK -- [see his tweet](https://twitter.com/_akhaliq/status/1752551364566126798).
+
 
 ### TL;DR: quickstart
 InstructIR takes as input an image and a human-written instruction for how to improve that image. The neural model performs all-in-one image restoration. InstructIR achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement.
@@ -45,12 +49,9 @@ Image restoration is a fundamental problem that involves recovering a high-quali
 🚀 You can start with the [demo tutorial](demo.ipynb). We also host the same tutorial on [google colab](https://colab.research.google.com/drive/1OrTvS-i6uLM2Y8kIkq8ZZRwEQxQFchfq?usp=sharing) so you can run it using free GPUs!.
 
 
-| | | 
-|----------|:-------------:
-| <a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir_teaser.gif" alt="InstructIR App"></a> |  <a href="https://mv-lab.github.io/InstructIR/"><img src="static/replicate.png" alt="InstructIR App"></a> |
-
+<a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir_teaser.png" alt="InstructIR" width=100%></a>
 
-### Gradio Demo
+### Gradio Demo <a href='https://github.com/gradio-app/gradio'><img src='https://img.shields.io/github/stars/gradio-app/gradio'></a> 
 We made a simple [Gradio demo](app.py) you can run (locally) on your machine [here](app.py). You need Python>=3.9 and [these requirements](requirements_gradio.txt) for it: `pip install -r requirements_gradio.txt`
 
 ```

images/instructir.gif

@@ -117,7 +117,7 @@ <h1 class="title is-1 publication-title">InstructIR: High-Quality Image Restorat
             <br>
             <div class="is-size-4 publication-authors">
               <span class="author-block">
-                <a href="https://scholar.google.com/citations?user=NtB1kjYAAAAJ" style="color:#f68946;font-weight:normal;">Marcos V. Conde<sup>1,2</sup></a>,
+                <a href="https://mv-lab.github.io/" style="color:#f68946;font-weight:normal;">Marcos V. Conde<sup>1,2</sup></a>,
               </span>
               <span class="author-block">
                 <a href="https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en" style="color:#008AD7;font-weight:normal;">Gregor Geigle<sup>1</sup></a>,
@@ -195,7 +195,7 @@ <h1 class="title is-1 publication-title">InstructIR: High-Quality Image Restorat
       <!-- Abstract. -->
       <div class="columns is-centered has-text-centered">
         <div class="column is-six-fifths">
-          <h2 class="title is-3">TL;DR & Abstract </h2>
+          <h2 class="title is-3">TL;DR</h2>
 
           <div class="content has-text-justified">
 
@@ -211,16 +211,6 @@ <h2 class="title is-3">TL;DR & Abstract </h2>
               <br>
               <br>
 
-            <center>
-            <details>
-            <summary> <h3> Abstract</h4> (click me to read)</summary>
-            <p align="justify">
-            Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement.
-            </p>
-            </details>
-            </center>
-
-
           </div>
 
         </div>
@@ -236,7 +226,17 @@ <h2 class="title is-3">TL;DR & Abstract </h2>
   <div class="columns is-centered has-text-centered">
     <div class="column is-six-fifths">
       <h2 class="title is-3"> Examples of InstructIR</h2>
-      <img src="images/instructir_teaser.png" width="50%">
+
+      <video width="860" height="640" autoplay loop controls>
+        <source src="images/instructir.mp4" type="video/mp4">
+      Your browser does not support the video tag.
+      </video> 
+
+      <!--
+        <img src="images/instructir_teaser.png" width="50%">
+      -->
+      
+    
     </div>
   </div>