Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Collect stdlib benchmarks results #7599

Merged
merged 25 commits into from
Sep 6, 2023
Merged

Collect stdlib benchmarks results #7599

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
340e9bc
[TMP] LibBenchRunner generates just a single JMH benchmark
Akirathan Aug 17, 2023
dded777
[WIP] Style improvements to bench-downloader
Akirathan Aug 17, 2023
7339149
Add since date filter functionality
Akirathan Aug 18, 2023
8cf22f7
Clear selection when apply filter clicked
Akirathan Aug 18, 2023
0a509a3
Add deps check to bench_download.py
Akirathan Aug 23, 2023
62a4ed4
bench report parsing uses XML ElementTree library
Akirathan Aug 23, 2023
fa5f5fc
Fix run without cache
Akirathan Aug 23, 2023
bfc4f17
Make the bench downloader asynchronous
Akirathan Aug 23, 2023
68b748b
Issue warnings if since parameter is older than 90 days
Akirathan Aug 23, 2023
f0c3872
Style section with filters
Akirathan Aug 23, 2023
53b7b00
Remove compare runs
Akirathan Aug 23, 2023
79467e2
Add benchmark --source parameter
Akirathan Aug 23, 2023
9719a14
bench reports XML files can have more than one score
Akirathan Aug 23, 2023
f64e968
HTML title corresponds to the source
Akirathan Aug 23, 2023
559467b
Add generated_site dir to .gitignore
Akirathan Aug 23, 2023
914bf30
Update docs
Akirathan Aug 23, 2023
4498c0b
--source param is required
Akirathan Aug 23, 2023
4ceace3
Reorder parameters - nicer help message
Akirathan Aug 23, 2023
ae4c431
GH dependency is checked after printing help
Akirathan Aug 23, 2023
fa01155
Generated site path corresponds to the bench source
Akirathan Aug 23, 2023
dfbe929
fmt
Akirathan Aug 23, 2023
c8d26ff
Fix typo
Akirathan Aug 28, 2023
8484e6e
Replace asyncio.TaskGroup with task list
Akirathan Sep 4, 2023
a84ab49
Revert "[TMP] LibBenchRunner generates just a single JMH benchmark"
Akirathan Sep 5, 2023
f081b8d
Fix typo
Akirathan Sep 5, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,7 @@ node_modules/
*.iml
.enso-sources*
.metals
tools/performance/engine-benchmarks/generated_site

############################
## Rendered Documentation ##
Expand Down
8 changes: 5 additions & 3 deletions tools/performance/engine-benchmarks/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
# Engine benchmarks

This directory contains a python script `bench_download.py` for downloading
Engine benchmark results from GitHub and `Engine_Benchs` Enso project for
analysing the downloaded data.
Engine and stdlib benchmark results from GitHub, and `Engine_Benchs` Enso
project for analysing the downloaded data.

Dependencies for `bench_download.py`:

Expand All @@ -14,7 +14,9 @@ Dependencies for `bench_download.py`:
`sudo apt-get install gh`

Check `bench_download -h` for documentation and usage. Ensure that your
`/usr/bin/env python` links to Python version at least 3.7.
`/usr/bin/env python` links to Python version at least 3.7. `bench_download.py`
creates `generated_site` directory with HTML files for visualizing the benchmark
results.

One can also analyze the benchmarks in Enso IDE by running
`bench_download.py --create-csv` and then running `Engine_Benchs` project. The
Expand Down
Loading