Skip to content

Commit 8459a19

Browse files
committed
fix all image links
1 parent 8c7d411 commit 8459a19

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

generative-modeling.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -100,7 +100,7 @@ One drawback of Pixel RNN is that the sequential generation is slow and we need
100100

101101
You may wonder: are we able to generate the whole image with masked convolution? In fact, if we stack enough layers of this kind of masked convolution, we can achieve the same effective receptive field as the pixel generation that conditional on all of the previous pixels (pixel RNN).
102102

103-
![](https://i.imgur.com/2eSJZ2Y.png =500x200)
103+
![](https://i.imgur.com/2eSJZ2Y.png)
104104
<figcaption> Pixel CNN Generating Example </figcaption>
105105

106106

@@ -149,7 +149,7 @@ $$
149149
The estimate of $\mathbb{E}_z [\log p_{\theta} (x^{(i)} | z)]$ can be computed through sampling. $D_{KL}(q_{\phi}(z | x^{(i)}) || p_{\theta}(z))$ has closed-form solution. $D_{KL}(q_{\phi}(z | x^{(i)})|| p_{\theta}(z | x^{(i)}))$ would be always larger than or equal to zero. Thus, we have tractable lower bound.
150150

151151
### VAE training process
152-
![](https://i.imgur.com/IK8laIh.png =750x400)
152+
![](https://i.imgur.com/IK8laIh.png)
153153

154154

155155
$q_{\phi}(z | x^{(i)})$ is the encoder network in this process. The goal of $D_{KL}(q_{\phi}(z | x^{(i)}) || p_{\theta}(z))$ is to estimate a posterior distribution close to prior distribution. On the other hand, $p_{\theta} (x^{(i)} | z)$ is the decoder network and reconstruct the input data. We compute them in the forward pass for every minibatch of input data and then perform back-propagation.
@@ -222,7 +222,7 @@ The training process is to alternate between
222222

223223
Problem of 2 is the gradient dominated by the region sample is already good. Training is very slow and unstable at the beginning. One solution is to change to use gradient ascent on generator and modify the different objective.
224224

225-
![](https://i.imgur.com/zvAex6j.png =750x250)
225+
![](https://i.imgur.com/zvAex6j.png)
226226
<figcaption> Generative Adversaial Nets training flow </figcaption>
227227

228228

0 commit comments

Comments
 (0)