-
-
Notifications
You must be signed in to change notification settings - Fork 235
[BUG] Problem with HyperBand setup given a total budget #1179
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
Hi @becktepe total_budget = 0
for stage in _n_configs_in_stage.keys():
for b, c in zip(_budgets_in_stage[stage], _n_configs_in_stage[stage]):
total_budget += b * c |
Hi, yes, that's the fix :) |
daphne12345
added a commit
that referenced
this issue
Jan 13, 2025
Merged
Merged
benjamc
added a commit
that referenced
this issue
Feb 26, 2025
* Fix for "Problem with HyperBand setup given a total budget #1179" * Update CHANGELOG.md * Fix tests for correct hyperband budegt calculation --------- Co-authored-by: C. Benjamins <[email protected]>
Closed by #1186 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Description
I wanted to use HyperBand and define a total budget as shown in the documentation. However, the actual budget that is used by SMAC does not match the requested budget.
The bug is caused by this line:
SMAC3/smac/intensifier/hyperband_utils.py
Line 47 in 9d19475
When computing the total budget of a HyperBand bracket we need to multiply the number of configs per budget by the respective budget:
After fixing this, the actual budget is
9_999.99
.Steps/Code to Reproduce
This is basically the example mentioned above:
Expected Results
After calling
get_n_trials_for_hyperband_multifidelity
with a total budget of10_000
I would expect the actual used budget to be less than or equal to10_000
.Actual Results
The actual used budget is
25_611.11
.Versions
2.2.0
The text was updated successfully, but these errors were encountered: