Skip to content
This repository has been archived by the owner on Jan 5, 2024. It is now read-only.

add visual search #51

Open
wants to merge 9 commits into
base: master
Choose a base branch
from
Open

add visual search #51

wants to merge 9 commits into from

Conversation

shashikg
Copy link

  • candidate_models/model_commitments/vs_layer.py is added to use pre-defined layers for target and search image.
  • candidate_models/base_models/init.py : Changes are done to use specific input_size for base_models if specified.

check score_model example on visual search benchmark.

@shashikg
Copy link
Author

@mschrimpf

Comment on lines 25 to 30
vs_model_param = {}
vs_model_param['tar_pool'] = target_model_pool
vs_model_param['stim_pool'] = stimuli_model_pool
vs_model_param['model_layers'] = visual_search_layer
vs_model_param['tar_size'] = target_img_size
vs_model_param['stim_size'] = stimuli_img_size
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also confused by these here

Comment on lines +5 to +7
layers = {
'vgg-16': [f'block{i + 1}_pool' for i in range(3,5)],
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would create another vgg-16 BrainModel from the same underlying BaseModel that makes these exact commitments

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The issue is that the "target_image" size is just 28x28 pixels. So we will need to exclusively define which layer will work for a specific ML model. So isn't it much better that we commit these layers in a separate py file? i.e. which layer to use for which ML model?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants