You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Make test point less brittle
`tazureChat/generateWithStructuredOutput` has somewhat frequent spurious failures of this type:
```
================================================================================
Verification failed in tazureChat/generateWithStructuredOutput.
---------------------
Framework Diagnostic:
---------------------
OrConstraint failed.
--> + [First Condition]:
| OrConstraint failed.
| --> + [First Condition]:
| | IsEqualTo failed.
| | --> StringComparator failed.
| | --> The strings are not equal.
| |
| | Actual Value:
| | "western honey bee"
| | Expected Value:
| | "honeybee"
| --> OR
| + [Second Condition]:
| | IsEqualTo failed.
| | --> StringComparator failed.
| | --> The strings are not equal.
| |
| | Actual Value:
| | "western honey bee"
| | Expected Value:
| | "honey bee"
| -+---------------------
--> OR
+ [Second Condition]:
| IsEqualTo failed.
| --> StringComparator failed.
| --> The strings are not equal.
|
| Actual Value:
| "western honey bee"
| Expected Value:
| "bee"
-+---------------------
```
Rather than trying to add more and more valid alternatives, it is probably better to relax the requirements a bit.
* Make test less noisy
`texampleTests/testAnalyzeTextDataUsingParallelFunctionCallwithOllama` was lacking the `evalc` against noise cluttering the output.
0 commit comments