evaluation process prototype

[keighrim]

The goal of development of the "evaluation process" is to significantly automate evaluations of existing and new CLAMS apps that can be evaluated using annotated data stored in https://github.com/clamsproject/aapb-annotations and possibly other data repository.

• define "evaluator" interface #9
• define "invoker" behavior  #11
• further development of added script for golds download #7 into 🦮

[keighrim]

My first take on a very rough sketch of the overall process and some software components.

[keighrim]

A few note

1. For the above to work, the annotation repo (repository structure in discussion aapb-annotations#2) must be able to provide the follow mappings;
   • goldDataId -> batchId
   • batchId -> [GUID]
2. We might want to invoke an evaluation process with multiple batches, or we need to consider the possibility that a goldDataId is mapped to multiple batches.