_99.search bug

[ThePrimeagen]

when using search about ~30% of the time (afaict) the results do not get written to the file but as one of the last responses.

i could try parsing out the last known response from search as an attempt to save a broken session.

could be quite interesting way to prevent silly failures, though i deeply dislike that i am compensating for poor model context following. likely i need better "context engineering"

I have also found when i include a large prompt (some error output) that it will just simply NEVER write to the temp file. again, i think the context has poisoned its ability to reason well. But this also makes me worried that the output is likely not in the format i want anyways.

[codegirl-007]

According to a paper I've read, it's worth trying to move the temp file instructions to the beginning as the instruction at the end gets lost when there's a lot of other stuff to process. The model can only look backward, never forward. So earlier tokens are visible to everything that comes after them. Token 500 (buried at the end) is only seen by tokens that come after it which might be nothing. It's like putting the most important rule at the beginning of a book instead of the end. Everyone reads the beginning, but not everyone makes it to the end. (reference - page 2, second bullet point)

Another idea would to just capture the result from stdout so that you don't have to rely on the temp file. But that has its own gotchas (conversation noise mixed with results).