RPI (Radial Priority Indexing) - A fork for self-correcting vector memory #8616
heydaytime
started this conversation in
Ideas
Replies: 1 comment 1 reply
-
|
Hm, if I understood your approach, you demote/promote results globally. So, if any query finds document A irrelevant, then is will be de-prioritized for all other queries as well, right? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I forked Qdrant to experiment with a feedback-driven retrieval policy called Radial Priority Indexing (RPI).
The problem: In repeated-query workloads (like NPC memory in games), bad context keeps surfacing. The model rejects it, you retry with a wider search, latency compounds.
The idea: Points live in trust shells (k=1 = high trust, k=N = low trust). Good retrievals get promoted inward, bad ones get demoted outward. Search starts at k=1 and falls through only if needed.
Key insight: Changing only a vector's magnitude doesn't change its cosine similarity direction - the semantic meaning stays stable. We use this to move points between Euclidean shell tiers for trust ranking while preserving their semantic relationships.
Results on 20 Newsgroups (5k docs, 5 epochs):
Not claiming this is production-ready or universally better - it's optimized for feedback-heavy, repeated-interaction workloads.
Repo: https://github.com/heydaytime/qdrant-rpi
Writeup: https://heydaytime.net/blog/rpi-semantic-cache-for-npc-memory
Would love any feedback from the community.
Beta Was this translation helpful? Give feedback.
All reactions