New cloner-aiding transformation #209
GitHub Actions / Test Results (Souffle 2.3)
failed
Aug 6, 2024 in 0s
1 fail, 54 pass in 37m 31s
55 tests 54 ✅ 37m 31s ⏱️
1 suites 0 💤
1 files 1 ❌
Results for commit eb4a9ac.
Annotations
Check warning on line 0 in test_gigahorse
github-actions / Test Results (Souffle 2.3)
test_gigahorse[default-fallback-scalable.2d56cd44e89f2cf76a935c2508f710e7] (test_gigahorse) failed
test-results.xml [took 31s]
Raw output
AssertionError: Value for Analytics_JumpToMany (2) not within margin of expected value (1).
assert False
+ where False = <function LogicTestCase.run.<locals>.within_margin at 0x7fd14ab44af0>(2, 1, 0)
gigahorse_test = default-fallback-scalable.2d56cd44e89f2cf76a935c2508f710e7
@pytest.mark.parametrize("gigahorse_test", testdata)
def test_gigahorse(gigahorse_test):
> gigahorse_test.run()
test_gigahorse.py:148:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = default-fallback-scalable.2d56cd44e89f2cf76a935c2508f710e7
def run(self):
def within_margin(actual: int, expected: int, margin: float) -> bool:
return (1 - margin) * expected <= actual <= (1 + margin) * expected
result = self.__run()
with open(join(self.working_dir, 'stdout'), 'wb') as f:
f.write(result.stdout)
with open(join(self.working_dir, 'stderr'), 'wb') as f:
f.write(result.stderr)
assert result.returncode == 0, f"Gigahorse exited with an error code: {result.returncode}"
with open(self.results_file) as f:
(_, _, _, temp_analytics), = json.load(f)
analytics = {}
for x, y in temp_analytics.items():
analytics[x] = y
for metric, expected, margin in self.expected_analytics:
> assert within_margin(analytics[metric], expected, margin), f"Value for {metric} ({analytics[metric]}) not within margin of expected value ({expected})."
E AssertionError: Value for Analytics_JumpToMany (2) not within margin of expected value (1).
E assert False
E + where False = <function LogicTestCase.run.<locals>.within_margin at 0x7fd14ab44af0>(2, 1, 0)
test_gigahorse.py:96: AssertionError
Loading