Skip to content

Commit

Permalink
Cn/expansion status stabilization (#294)
Browse files Browse the repository at this point in the history
* Update ranking-notes.md

* Update ranking-notes.md
  • Loading branch information
keithcoleman authored Dec 13, 2024
1 parent cfe3c71 commit e4adc8e
Showing 1 changed file with 5 additions and 4 deletions.
9 changes: 5 additions & 4 deletions documentation/under-the-hood/ranking-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -288,10 +288,8 @@ This approach allows us to continue optimizing the ranking algorithm with a focu
Before a note is two weeks old, the helpfulness status will continue to be updated each time time the ranking algorithm is run.
After a note turns two weeks old we store the helpfulness status for that note and use the stored status in the future, including for displaying notes on X and calculating user contribution statistics.

While a note may be scored by the Core, Expansion and Group models, we only finalize note status based on the Core model.
Notes that are only ranked by the Expansion model are not eligible for stabilization since the Expansion model is under development and may be revised to improve quality at any time.
Similarly, if a note is rated Helpful by a Group model and Needs More Ratings by the Core model, we will allow the note status to remain at Helpful even after the note is two weeks old.
If at any point both models agree and the Core model scores the note as Helpful or a Group model scores the note as Needs More Ratings, then the status will be finalized in agreement with both models.
We finalize note status if the status was decided by the Core, Expansion or Group models.
Notes that are only ranked by the ExpansionPlus model, or whose status is set to Needs More Ratings by a TopicModel, are not eligible for stabilization since those models are under development and may be revised to improve quality at any time.

## Determining Note Status Explanation Tags

Expand Down Expand Up @@ -352,6 +350,9 @@ For not-helpful notes:

## What’s New?

**Dec 12, 2024**
- Begin status stabilization for note statuses decided by the Expansion model.

**Oct 14, 2024**
- Update topic modeling to allow the learned topic assignment model to override rule-based labels at high confidence levels.

Expand Down

0 comments on commit e4adc8e

Please sign in to comment.