Skip to content

New cloner-aiding transformation #209

New cloner-aiding transformation

New cloner-aiding transformation #209

GitHub Actions / Test Results (Souffle 2.3) failed Aug 6, 2024 in 0s

1 fail, 54 pass in 37m 31s

55 tests   54 ✅  37m 31s ⏱️
 1 suites   0 💤
 1 files     1 ❌

Results for commit eb4a9ac.

Annotations

Check warning on line 0 in test_gigahorse

See this annotation in the file changed.

@github-actions github-actions / Test Results (Souffle 2.3)

test_gigahorse[default-fallback-scalable.2d56cd44e89f2cf76a935c2508f710e7] (test_gigahorse) failed

test-results.xml [took 31s]
Raw output
AssertionError: Value for Analytics_JumpToMany (2) not within margin of expected value (1).
assert False
 +  where False = <function LogicTestCase.run.<locals>.within_margin at 0x7fd14ab44af0>(2, 1, 0)
gigahorse_test = default-fallback-scalable.2d56cd44e89f2cf76a935c2508f710e7

    @pytest.mark.parametrize("gigahorse_test", testdata)
    def test_gigahorse(gigahorse_test):
>       gigahorse_test.run()

test_gigahorse.py:148: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = default-fallback-scalable.2d56cd44e89f2cf76a935c2508f710e7

    def run(self):
        def within_margin(actual: int, expected: int, margin: float) -> bool:
            return (1 - margin) * expected <= actual <= (1 + margin) * expected
        result = self.__run()
    
        with open(join(self.working_dir, 'stdout'), 'wb') as f:
            f.write(result.stdout)
    
        with open(join(self.working_dir, 'stderr'), 'wb') as f:
            f.write(result.stderr)
    
        assert result.returncode == 0, f"Gigahorse exited with an error code: {result.returncode}"
    
        with open(self.results_file) as f:
            (_, _, _, temp_analytics), = json.load(f)
    
        analytics = {}
        for x, y in temp_analytics.items():
            analytics[x] = y
    
        for metric, expected, margin in self.expected_analytics:
>           assert within_margin(analytics[metric], expected, margin), f"Value for {metric} ({analytics[metric]}) not within margin of expected value ({expected})."
E           AssertionError: Value for Analytics_JumpToMany (2) not within margin of expected value (1).
E           assert False
E            +  where False = <function LogicTestCase.run.<locals>.within_margin at 0x7fd14ab44af0>(2, 1, 0)

test_gigahorse.py:96: AssertionError