Skip to content

Conversation

@CharlesR-W
Copy link

Summary

  • BestOfKOrchestrator: Generates K candidate explanations in parallel, evaluates each with configured scorers, and selects the best explanation based on scorer results.
  • HillClimbingOrchestrator: Iteratively refines explanations over multiple rounds using scorer feedback (false positives/negatives) to improve explanation quality.
  • Added duration fields to ExplainerResult and ScorerResult for timing instrumentation.
  • Added config fields for bestofk_* and iterative_* parameters.

Both orchestrators are standalone classes (no inheritance from Explainer base) that run scorers internally, invoked via if-branches in __main__.py when --explainer bestofk or --explainer iterative is specified.

Test plan

  • Verify syntax with python -m py_compile on new files
  • Run with --explainer default to confirm no regression
  • Run with --explainer bestofk to test best-of-K selection
  • Run with --explainer iterative to test hill-climbing refinement

🤖 Generated with Claude Code

New features:
- BestOfKOrchestrator: generates K explanations, selects best via scorer
- HillClimbingOrchestrator: refines explanations iteratively using FP/FN feedback
- Duration fields added to ExplainerResult and ScorerResult
- Config fields for bestofk_* and iterative_* parameters

The orchestrators are standalone classes (no inheritance from Explainer base)
that run scorers internally and are invoked via if-branches in __main__.py.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <[email protected]>
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants