Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GC improvements #4

Open
purbon opened this issue Dec 8, 2014 · 2 comments
Open

GC improvements #4

purbon opened this issue Dec 8, 2014 · 2 comments

Comments

@purbon
Copy link
Contributor

purbon commented Dec 8, 2014

Usually GC might be an impediment for proper benchmarking, we've to be sure the final numbers are not too biased by this.
Might be we can start a GC before each execution, but don't add this to the timing.

@colinsurprenant
Copy link
Contributor

GC activity is "normal" and I think it might be interesting to try to spot abnormal GC signatures or potential memory leaks for example. I like to run VisualVM once in a while to visualize GC activity and check for "unhealthy" activity.

GC might distort benchmarks on very short tests but when running longer tests, GC activity is just normal and part of the run time.

@purbon
Copy link
Contributor Author

purbon commented Dec 8, 2014

@colinsurprenant sure we can workaround GC affectation with long running test, but at the end is a way to average/normalize its influence.

One thing that we might do is running the test multiple times, remove the outliers and take the average, usually you can get pretty nice approximations like this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants