You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -47,7 +47,7 @@ clip = CLIP(
47
47
use_all_token_embeds=True, # whether to use fine-grained contrastive learning (FILIP)
48
48
decoupled_contrastive_learning=True, # use decoupled contrastive learning (DCL) objective function, removing positive pairs from the denominator of the InfoNCE loss (CLOOB + DCL)
49
49
extra_latent_projection=True, # whether to use separate projections for text-to-image vs image-to-text comparisons (CLOOB)
50
-
use_visual_ssl=True, # whether to do self supervised learning on iages
50
+
use_visual_ssl=True, # whether to do self supervised learning on images
51
51
visual_ssl_type='simclr', # can be either 'simclr' or 'simsiam', depending on using DeCLIP or SLIP
52
52
use_mlm=False, # use masked language learning (MLM) on text (DeCLIP)
53
53
text_ssl_loss_weight=0.05, # weight for text MLM loss
0 commit comments