Validate NMDC JAT Templates Through Test Ingestion

[Shalsh23]

Objective

Validate JAT templates by performing test ingestions into JAMO and verifying data/metadata integrity.

Tasks

1. Create Test Metadata Files

   • Generate metadata.json for each workflow type
   • Include required fields from templates
   • Validate metadata format

2. Test Ingestion

   • Ingest using JAT + metadata combinations
   • Record ingestion logs and errors
   • Document any template adjustments needed

3. Validation Checks

   • Verify files are ingested correctly
   • Confirm jamo keys added to files
   • Test data retrieval using keys

Technical Details

• Test data location: perlmutter.nersc.lbl.gov:/global/cfs/cdirs/m3408/results
• JAMO environment:
  • jamo dev
  • JAMO CLI Documentation
• Test metadata examples: ReadsQC Example

Success Criteria

• All required metadata keys populated
• Data retrievable via metadata queries

Deliverables

1. Test metadata files for each workflow
2. Ingestion test results
3. Documentation of any template updates needed

/cc @shreddd @aclum @kaijli

[ssarrafan]

Appears to be in progress so will move to current sprint. @Shalsh23 let me know if you're not working on this anymore.