-
Notifications
You must be signed in to change notification settings - Fork 14
feat(eval): token budget tracking and cost reports #1050
Copy link
Copy link
Open
Labels
evalSkill evaluation pipelineSkill evaluation pipeline
Description
Summary
REVISED: Descoped from token tracking to duration tracking.
CC Max = flat rate. Token costs irrelevant. Track eval duration instead.
EVAL DURATION REPORT
Skill Trigger Quality Total
commit 45s 120s 2m 45s
assess 38s 95s 2m 13s
api-design 52s 180s 3m 52s
Helps decide whether to run --all or just changed skills.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
evalSkill evaluation pipelineSkill evaluation pipeline