Skip to content

Commit 63450b4

Browse files
authored
Fix spelling and grammatical errors
1 parent 20e7eb5 commit 63450b4

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ clip = CLIP(
4747
use_all_token_embeds = True, # whether to use fine-grained contrastive learning (FILIP)
4848
decoupled_contrastive_learning = True, # use decoupled contrastive learning (DCL) objective function, removing positive pairs from the denominator of the InfoNCE loss (CLOOB + DCL)
4949
extra_latent_projection = True, # whether to use separate projections for text-to-image vs image-to-text comparisons (CLOOB)
50-
use_visual_ssl = True, # whether to do self supervised learning on iages
50+
use_visual_ssl = True, # whether to do self supervised learning on images
5151
visual_ssl_type = 'simclr', # can be either 'simclr' or 'simsiam', depending on using DeCLIP or SLIP
5252
use_mlm = False, # use masked language learning (MLM) on text (DeCLIP)
5353
text_ssl_loss_weight = 0.05, # weight for text MLM loss
@@ -616,7 +616,7 @@ clip = CLIP(
616616
# 3 unets for the decoder (a la cascading DDPM)
617617

618618
# first two unets are doing latent diffusion
619-
# vqgan-vae must be trained before hand
619+
# vqgan-vae must be trained beforehand
620620

621621
vae1 = VQGanVAE(
622622
dim = 32,

0 commit comments

Comments
 (0)