Skip to content

Commit e31d19b

Browse files
authored
Merge pull request #208 from RobotSail/update-changelog
chore: update changelog for 0.5.0
2 parents c437ef2 + ab37b54 commit e31d19b

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

CHANGELOG.md

+4
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,7 @@
1+
## 0.5.0
2+
3+
* Introduces Ragas as a supported evaluation framework. This integration only supports the `RubricsScore` metric and OpenAI models. Users can pass in either a dataset with a pre-computed `user_input`, `reference` and `response` fields or they can provide a dataset containing `user_input` and `reference` along with information about a model endpoint that will be used for computing the `response` field.
4+
15
## 0.4.2
26

37
* Adds the ability to provide a custom system prompt to the MMLU-based evaluators. When a system prompt is provided, LM-eval applies the chat template under the hood, else it will pass the model a barebones prompt.

0 commit comments

Comments
 (0)