Skip to content

Commit ac44aae

Browse files
authored
Add info about logging and link to logviz (#1480)
A useful 3rd party tool has been developed by @naimenz for visualizing openai/eval logs: https://github.com/naimenz/logviz Adding a link to it from our README seems good as it is probably useful for users. :)
1 parent 9b2e1b1 commit ac44aae

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/run-evals.md

+4
Original file line numberDiff line numberDiff line change
@@ -38,3 +38,7 @@ Running with more threads will make the eval faster, though keep in mind the cos
3838
If you have to stop your run or your run crashes, we've got you covered! `oaievalset` records the evals that finished in `/tmp/oaievalset/{model}.{eval_set}.progress.txt`. You can simply rerun the command to pick up where you left off. If you want to run the eval set starting from the beginning, delete this progress file.
3939

4040
Unfortunately, you can't resume a single eval from the middle. You'll have to restart from the beginning, so try to keep your individual evals quick to run.
41+
42+
## Logging
43+
44+
By default, `oaieval` [records events](/evals/record.py) into local JSONL logs which can be inspected using a text editor or analyzed programmatically. 3rd-party tools such as [naimenz/logviz](https://github.com/naimenz/logviz) may be helpful to visualize the logs, though we don't provide support or guarantees for their use.

0 commit comments

Comments
 (0)