Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Solve ref issues in docstrings #2776

Merged
merged 27 commits into from
Feb 11, 2025
Merged

[Doc] Solve ref issues in docstrings #2776

merged 27 commits into from
Feb 11, 2025

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Feb 10, 2025 •
edited
Loading

Stack from ghstack (oldest at bottom):

@vmoens
Update
4df4c8e 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
1c3d6e4 
ghstack-source-id: 4b0de4f1db5985befd7cbb1d9cae4b55b92eb189
Pull Request resolved: #2776
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Feb 10, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2776

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 10, 2025
@vmoens
Update
43c333e 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
e4881f6 
ghstack-source-id: 367be18eb407e8d5b56c571f820b356e4e92444a
Pull Request resolved: #2776
@vmoens
Update
4a3f383 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
6cf56e4 
ghstack-source-id: a39dacba3ce04534fdb0c2f2753caa9a67eeee23
Pull Request resolved: #2776
@vmoens
Update
b5a9a06 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
a7c014b 
ghstack-source-id: 1f79445c5c337cfc31326f70b58cbf5e1e7c74a3
Pull Request resolved: #2776
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}10$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.6046s 0.5134s 1.9477 Ops/s 1.9433 Ops/s $\color{#35bf28}+0.23\%$
test_transformed 1.0896s 0.9974s 1.0026 Ops/s 1.0193 Ops/s $\color{#d91a1a}-1.64\%$
test_serial 1.6271s 1.5357s 0.6512 Ops/s 0.6619 Ops/s $\color{#d91a1a}-1.62\%$
test_parallel 1.4133s 1.3046s 0.7665 Ops/s 0.7749 Ops/s $\color{#d91a1a}-1.09\%$
test_step_mdp_speed[True-True-True-True-True] 0.1899ms 30.0609μs 33.2658 KOps/s 32.2651 KOps/s $\color{#35bf28}+3.10\%$
test_step_mdp_speed[True-True-True-True-False] 59.2110μs 17.7880μs 56.2178 KOps/s 54.9484 KOps/s $\color{#35bf28}+2.31\%$
test_step_mdp_speed[True-True-True-False-True] 69.3690μs 16.8972μs 59.1814 KOps/s 57.6035 KOps/s $\color{#35bf28}+2.74\%$
test_step_mdp_speed[True-True-True-False-False] 49.6230μs 9.9196μs 100.8105 KOps/s 97.4747 KOps/s $\color{#35bf28}+3.42\%$
test_step_mdp_speed[True-True-False-True-True] 84.8980μs 32.3998μs 30.8644 KOps/s 30.5594 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-True-False-True-False] 43.0100μs 19.6866μs 50.7959 KOps/s 49.8175 KOps/s $\color{#35bf28}+1.96\%$
test_step_mdp_speed[True-True-False-False-True] 0.5427ms 18.9488μs 52.7739 KOps/s 51.9704 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[True-True-False-False-False] 51.0660μs 11.7914μs 84.8073 KOps/s 82.1792 KOps/s $\color{#35bf28}+3.20\%$
test_step_mdp_speed[True-False-True-True-True] 67.7670μs 33.7465μs 29.6327 KOps/s 28.8724 KOps/s $\color{#35bf28}+2.63\%$
test_step_mdp_speed[True-False-True-True-False] 72.8860μs 21.7930μs 45.8863 KOps/s 45.5502 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[True-False-True-False-True] 47.3580μs 18.5987μs 53.7673 KOps/s 52.2522 KOps/s $\color{#35bf28}+2.90\%$
test_step_mdp_speed[True-False-True-False-False] 61.8460μs 11.9454μs 83.7142 KOps/s 81.7228 KOps/s $\color{#35bf28}+2.44\%$
test_step_mdp_speed[True-False-False-True-True] 85.7400μs 35.4675μs 28.1949 KOps/s 27.5872 KOps/s $\color{#35bf28}+2.20\%$
test_step_mdp_speed[True-False-False-True-False] 58.1780μs 23.2150μs 43.0755 KOps/s 41.8108 KOps/s $\color{#35bf28}+3.02\%$
test_step_mdp_speed[True-False-False-False-True] 62.2760μs 20.7611μs 48.1669 KOps/s 47.9987 KOps/s $\color{#35bf28}+0.35\%$
test_step_mdp_speed[True-False-False-False-False] 42.7400μs 13.6603μs 73.2050 KOps/s 71.5752 KOps/s $\color{#35bf28}+2.28\%$
test_step_mdp_speed[False-True-True-True-True] 93.5350μs 33.7685μs 29.6134 KOps/s 28.9373 KOps/s $\color{#35bf28}+2.34\%$
test_step_mdp_speed[False-True-True-True-False] 66.6350μs 21.4977μs 46.5167 KOps/s 45.2943 KOps/s $\color{#35bf28}+2.70\%$
test_step_mdp_speed[False-True-True-False-True] 62.5970μs 21.5429μs 46.4190 KOps/s 45.2721 KOps/s $\color{#35bf28}+2.53\%$
test_step_mdp_speed[False-True-True-False-False] 65.5830μs 13.3072μs 75.1471 KOps/s 73.7660 KOps/s $\color{#35bf28}+1.87\%$
test_step_mdp_speed[False-True-False-True-True] 80.3700μs 35.7716μs 27.9551 KOps/s 27.3980 KOps/s $\color{#35bf28}+2.03\%$
test_step_mdp_speed[False-True-False-True-False] 78.1160μs 23.4479μs 42.6477 KOps/s 41.9905 KOps/s $\color{#35bf28}+1.57\%$
test_step_mdp_speed[False-True-False-False-True] 2.6728ms 23.4143μs 42.7090 KOps/s 41.5709 KOps/s $\color{#35bf28}+2.74\%$
test_step_mdp_speed[False-True-False-False-False] 0.6476ms 15.1501μs 66.0063 KOps/s 65.4380 KOps/s $\color{#35bf28}+0.87\%$
test_step_mdp_speed[False-False-True-True-True] 96.9320μs 37.6393μs 26.5680 KOps/s 26.1788 KOps/s $\color{#35bf28}+1.49\%$
test_step_mdp_speed[False-False-True-True-False] 89.0170μs 25.2240μs 39.6448 KOps/s 38.9874 KOps/s $\color{#35bf28}+1.69\%$
test_step_mdp_speed[False-False-True-False-True] 60.0720μs 23.7620μs 42.0840 KOps/s 41.5686 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[False-False-True-False-False] 62.4170μs 15.0813μs 66.3073 KOps/s 64.9912 KOps/s $\color{#35bf28}+2.03\%$
test_step_mdp_speed[False-False-False-True-True] 71.6240μs 39.2767μs 25.4604 KOps/s 25.2411 KOps/s $\color{#35bf28}+0.87\%$
test_step_mdp_speed[False-False-False-True-False] 78.6570μs 26.8218μs 37.2830 KOps/s 36.8524 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[False-False-False-False-True] 58.1680μs 25.0695μs 39.8891 KOps/s 39.2355 KOps/s $\color{#35bf28}+1.67\%$
test_step_mdp_speed[False-False-False-False-False] 73.6580μs 16.7982μs 59.5303 KOps/s 59.2160 KOps/s $\color{#35bf28}+0.53\%$
test_values[generalized_advantage_estimate-True-True] 10.6517ms 10.3446ms 96.6684 Ops/s 99.6015 Ops/s $\color{#d91a1a}-2.94\%$
test_values[vec_generalized_advantage_estimate-True-True] 26.5121ms 24.3826ms 41.0128 Ops/s 41.2050 Ops/s $\color{#d91a1a}-0.47\%$
test_values[td0_return_estimate-False-False] 0.2673ms 0.1996ms 5.0111 KOps/s 4.9862 KOps/s $\color{#35bf28}+0.50\%$
test_values[td1_return_estimate-False-False] 28.4418ms 25.4579ms 39.2805 Ops/s 40.7197 Ops/s $\color{#d91a1a}-3.53\%$
test_values[vec_td1_return_estimate-False-False] 26.2772ms 24.4346ms 40.9255 Ops/s 41.0337 Ops/s $\color{#d91a1a}-0.26\%$
test_values[td_lambda_return_estimate-True-False] 38.7023ms 36.3407ms 27.5174 Ops/s 28.7491 Ops/s $\color{#d91a1a}-4.28\%$
test_values[vec_td_lambda_return_estimate-True-False] 26.3042ms 24.3126ms 41.1310 Ops/s 40.5788 Ops/s $\color{#35bf28}+1.36\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 12.0386ms 8.9566ms 111.6499 Ops/s 116.9442 Ops/s $\color{#d91a1a}-4.53\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3707ms 1.9301ms 518.1155 Ops/s 488.8094 Ops/s $\textbf{\color{#35bf28}+6.00\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5211ms 0.3710ms 2.6954 KOps/s 2.6884 KOps/s $\color{#35bf28}+0.26\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 37.9225ms 37.3701ms 26.7594 Ops/s 23.0987 Ops/s $\textbf{\color{#35bf28}+15.85\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.4421ms 3.4593ms 289.0759 Ops/s 289.2547 Ops/s $\color{#d91a1a}-0.06\%$
test_dqn_speed[False-None] 5.7215ms 1.4443ms 692.3620 Ops/s 705.6858 Ops/s $\color{#d91a1a}-1.89\%$
test_dqn_speed[False-backward] 2.0240ms 1.9158ms 521.9630 Ops/s 524.3661 Ops/s $\color{#d91a1a}-0.46\%$
test_dqn_speed[True-None] 0.8114ms 0.4825ms 2.0724 KOps/s 2.0579 KOps/s $\color{#35bf28}+0.70\%$
test_dqn_speed[True-backward] 0.9558ms 0.9105ms 1.0983 KOps/s 1.0930 KOps/s $\color{#35bf28}+0.49\%$
test_dqn_speed[reduce-overhead-None] 0.5873ms 0.4826ms 2.0721 KOps/s 2.0623 KOps/s $\color{#35bf28}+0.47\%$
test_dqn_speed[reduce-overhead-backward] 1.0039ms 0.9152ms 1.0927 KOps/s 1.0778 KOps/s $\color{#35bf28}+1.38\%$
test_ddpg_speed[False-None] 4.0388ms 3.0014ms 333.1742 Ops/s 343.0822 Ops/s $\color{#d91a1a}-2.89\%$
test_ddpg_speed[False-backward] 4.2520ms 4.1222ms 242.5917 Ops/s 248.3776 Ops/s $\color{#d91a1a}-2.33\%$
test_ddpg_speed[True-None] 1.5187ms 1.2466ms 802.1949 Ops/s 805.9908 Ops/s $\color{#d91a1a}-0.47\%$
test_ddpg_speed[True-backward] 2.4131ms 2.1964ms 455.2802 Ops/s 448.2056 Ops/s $\color{#35bf28}+1.58\%$
test_ddpg_speed[reduce-overhead-None] 1.8450ms 1.2525ms 798.3955 Ops/s 782.1131 Ops/s $\color{#35bf28}+2.08\%$
test_ddpg_speed[reduce-overhead-backward] 3.2661ms 2.2419ms 446.0543 Ops/s 461.9794 Ops/s $\color{#d91a1a}-3.45\%$
test_sac_speed[False-None] 10.0702ms 8.2021ms 121.9207 Ops/s 123.0881 Ops/s $\color{#d91a1a}-0.95\%$
test_sac_speed[False-backward] 11.2403ms 10.9077ms 91.6787 Ops/s 91.4726 Ops/s $\color{#35bf28}+0.23\%$
test_sac_speed[True-None] 2.5523ms 2.1034ms 475.4255 Ops/s 471.9222 Ops/s $\color{#35bf28}+0.74\%$
test_sac_speed[True-backward] 4.0544ms 3.9167ms 255.3162 Ops/s 261.1235 Ops/s $\color{#d91a1a}-2.22\%$
test_sac_speed[reduce-overhead-None] 2.5278ms 2.1049ms 475.0856 Ops/s 468.8510 Ops/s $\color{#35bf28}+1.33\%$
test_sac_speed[reduce-overhead-backward] 3.9735ms 3.8360ms 260.6904 Ops/s 258.7470 Ops/s $\color{#35bf28}+0.75\%$
test_redq_speed[False-None] 15.3326ms 13.3173ms 75.0905 Ops/s 51.8836 Ops/s $\textbf{\color{#35bf28}+44.73\%}$
test_redq_speed[False-backward] 23.8450ms 22.4815ms 44.4810 Ops/s 43.4381 Ops/s $\color{#35bf28}+2.40\%$
test_redq_speed[True-None] 6.8652ms 5.1333ms 194.8050 Ops/s 190.9209 Ops/s $\color{#35bf28}+2.03\%$
test_redq_speed[True-backward] 13.4887ms 12.7963ms 78.1478 Ops/s 77.4182 Ops/s $\color{#35bf28}+0.94\%$
test_redq_speed[reduce-overhead-None] 6.2235ms 5.1403ms 194.5403 Ops/s 172.5643 Ops/s $\textbf{\color{#35bf28}+12.73\%}$
test_redq_speed[reduce-overhead-backward] 13.3667ms 12.7635ms 78.3484 Ops/s 75.9822 Ops/s $\color{#35bf28}+3.11\%$
test_redq_deprec_speed[False-None] 14.5022ms 13.3005ms 75.1851 Ops/s 74.3505 Ops/s $\color{#35bf28}+1.12\%$
test_redq_deprec_speed[False-backward] 20.7859ms 19.4988ms 51.2852 Ops/s 51.6579 Ops/s $\color{#d91a1a}-0.72\%$
test_redq_deprec_speed[True-None] 4.4384ms 3.8947ms 256.7600 Ops/s 252.0301 Ops/s $\color{#35bf28}+1.88\%$
test_redq_deprec_speed[True-backward] 9.5661ms 8.5432ms 117.0518 Ops/s 116.1135 Ops/s $\color{#35bf28}+0.81\%$
test_redq_deprec_speed[reduce-overhead-None] 4.2372ms 3.8735ms 258.1672 Ops/s 253.9101 Ops/s $\color{#35bf28}+1.68\%$
test_redq_deprec_speed[reduce-overhead-backward] 9.0106ms 8.4885ms 117.8070 Ops/s 112.0522 Ops/s $\textbf{\color{#35bf28}+5.14\%}$
test_td3_speed[False-None] 8.4885ms 8.2235ms 121.6024 Ops/s 120.2022 Ops/s $\color{#35bf28}+1.16\%$
test_td3_speed[False-backward] 12.5254ms 10.7249ms 93.2410 Ops/s 93.1136 Ops/s $\color{#35bf28}+0.14\%$
test_td3_speed[True-None] 1.9406ms 1.7843ms 560.4339 Ops/s 546.1323 Ops/s $\color{#35bf28}+2.62\%$
test_td3_speed[True-backward] 3.6128ms 3.4757ms 287.7124 Ops/s 287.8020 Ops/s $\color{#d91a1a}-0.03\%$
test_td3_speed[reduce-overhead-None] 1.9786ms 1.7749ms 563.4074 Ops/s 545.2464 Ops/s $\color{#35bf28}+3.33\%$
test_td3_speed[reduce-overhead-backward] 3.5725ms 3.4320ms 291.3753 Ops/s 280.8083 Ops/s $\color{#35bf28}+3.76\%$
test_cql_speed[False-None] 41.8868ms 37.1814ms 26.8951 Ops/s 26.9594 Ops/s $\color{#d91a1a}-0.24\%$
test_cql_speed[False-backward] 49.4847ms 47.3529ms 21.1180 Ops/s 20.7275 Ops/s $\color{#35bf28}+1.88\%$
test_cql_speed[True-None] 17.0702ms 16.3017ms 61.3434 Ops/s 60.7152 Ops/s $\color{#35bf28}+1.03\%$
test_cql_speed[True-backward] 23.8736ms 23.2081ms 43.0884 Ops/s 42.1486 Ops/s $\color{#35bf28}+2.23\%$
test_cql_speed[reduce-overhead-None] 16.9750ms 16.3094ms 61.3142 Ops/s 60.6466 Ops/s $\color{#35bf28}+1.10\%$
test_cql_speed[reduce-overhead-backward] 24.6083ms 23.2988ms 42.9207 Ops/s 42.8507 Ops/s $\color{#35bf28}+0.16\%$
test_a2c_speed[False-None] 8.0977ms 7.3840ms 135.4282 Ops/s 137.1575 Ops/s $\color{#d91a1a}-1.26\%$
test_a2c_speed[False-backward] 16.7103ms 15.0994ms 66.2279 Ops/s 66.9758 Ops/s $\color{#d91a1a}-1.12\%$
test_a2c_speed[True-None] 3.9765ms 3.7400ms 267.3780 Ops/s 264.8013 Ops/s $\color{#35bf28}+0.97\%$
test_a2c_speed[True-backward] 11.1684ms 10.2850ms 97.2293 Ops/s 96.3668 Ops/s $\color{#35bf28}+0.90\%$
test_a2c_speed[reduce-overhead-None] 4.7264ms 3.7700ms 265.2523 Ops/s 264.6548 Ops/s $\color{#35bf28}+0.23\%$
test_a2c_speed[reduce-overhead-backward] 10.7923ms 10.2735ms 97.3375 Ops/s 95.5346 Ops/s $\color{#35bf28}+1.89\%$
test_ppo_speed[False-None] 9.0326ms 7.7710ms 128.6839 Ops/s 127.8356 Ops/s $\color{#35bf28}+0.66\%$
test_ppo_speed[False-backward] 17.1462ms 15.4159ms 64.8680 Ops/s 65.6883 Ops/s $\color{#d91a1a}-1.25\%$
test_ppo_speed[True-None] 4.6513ms 4.1424ms 241.4045 Ops/s 241.9585 Ops/s $\color{#d91a1a}-0.23\%$
test_ppo_speed[True-backward] 10.8722ms 10.4291ms 95.8856 Ops/s 99.4244 Ops/s $\color{#d91a1a}-3.56\%$
test_ppo_speed[reduce-overhead-None] 4.8984ms 4.1412ms 241.4734 Ops/s 241.0032 Ops/s $\color{#35bf28}+0.20\%$
test_ppo_speed[reduce-overhead-backward] 10.5484ms 9.9858ms 100.1419 Ops/s 98.5414 Ops/s $\color{#35bf28}+1.62\%$
test_reinforce_speed[False-None] 7.6733ms 6.6546ms 150.2713 Ops/s 143.6014 Ops/s $\color{#35bf28}+4.64\%$
test_reinforce_speed[False-backward] 10.5302ms 10.0750ms 99.2556 Ops/s 96.7545 Ops/s $\color{#35bf28}+2.58\%$
test_reinforce_speed[True-None] 3.7203ms 3.0723ms 325.4936 Ops/s 319.4791 Ops/s $\color{#35bf28}+1.88\%$
test_reinforce_speed[True-backward] 9.4444ms 9.1227ms 109.6171 Ops/s 110.8109 Ops/s $\color{#d91a1a}-1.08\%$
test_reinforce_speed[reduce-overhead-None] 3.4159ms 3.0650ms 326.2597 Ops/s 316.9018 Ops/s $\color{#35bf28}+2.95\%$
test_reinforce_speed[reduce-overhead-backward] 9.4032ms 9.0177ms 110.8926 Ops/s 109.2191 Ops/s $\color{#35bf28}+1.53\%$
test_iql_speed[False-None] 34.2368ms 32.5505ms 30.7215 Ops/s 30.6501 Ops/s $\color{#35bf28}+0.23\%$
test_iql_speed[False-backward] 49.8164ms 45.8335ms 21.8181 Ops/s 21.4761 Ops/s $\color{#35bf28}+1.59\%$
test_iql_speed[True-None] 12.4997ms 11.3741ms 87.9191 Ops/s 85.6419 Ops/s $\color{#35bf28}+2.66\%$
test_iql_speed[True-backward] 24.4726ms 22.8574ms 43.7496 Ops/s 43.5210 Ops/s $\color{#35bf28}+0.53\%$
test_iql_speed[reduce-overhead-None] 13.0604ms 11.5049ms 86.9196 Ops/s 86.0322 Ops/s $\color{#35bf28}+1.03\%$
test_iql_speed[reduce-overhead-backward] 24.5809ms 22.8965ms 43.6747 Ops/s 43.2472 Ops/s $\color{#35bf28}+0.99\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 0.4576s 7.2343ms 138.2309 Ops/s 196.0774 Ops/s $\textbf{\color{#d91a1a}-29.50\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7753ms 0.5205ms 1.9211 KOps/s 1.9041 KOps/s $\color{#35bf28}+0.89\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8833ms 0.5034ms 1.9866 KOps/s 2.0049 KOps/s $\color{#d91a1a}-0.91\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.1104ms 4.7176ms 211.9722 Ops/s 206.3232 Ops/s $\color{#35bf28}+2.74\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.3124ms 0.5061ms 1.9757 KOps/s 1.9054 KOps/s $\color{#35bf28}+3.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8280ms 0.4908ms 2.0373 KOps/s 2.0187 KOps/s $\color{#35bf28}+0.92\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.7129ms 1.6962ms 589.5503 Ops/s 600.0200 Ops/s $\color{#d91a1a}-1.74\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.3072ms 1.5987ms 625.4922 Ops/s 628.3629 Ops/s $\color{#d91a1a}-0.46\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.1240ms 4.8579ms 205.8506 Ops/s 195.0446 Ops/s $\textbf{\color{#35bf28}+5.54\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.3206ms 0.6588ms 1.5178 KOps/s 1.5031 KOps/s $\color{#35bf28}+0.98\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0104ms 0.6426ms 1.5563 KOps/s 1.5673 KOps/s $\color{#d91a1a}-0.70\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1470ms 4.8117ms 207.8283 Ops/s 203.8115 Ops/s $\color{#35bf28}+1.97\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.4457ms 0.5347ms 1.8702 KOps/s 1.8514 KOps/s $\color{#35bf28}+1.01\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7415ms 0.5091ms 1.9643 KOps/s 1.9734 KOps/s $\color{#d91a1a}-0.46\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.3775ms 4.7246ms 211.6586 Ops/s 201.5568 Ops/s $\textbf{\color{#35bf28}+5.01\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9170ms 0.5147ms 1.9429 KOps/s 1.9430 KOps/s $-0.00\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9668ms 0.4976ms 2.0096 KOps/s 1.8287 KOps/s $\textbf{\color{#35bf28}+9.90\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.6594ms 4.9131ms 203.5384 Ops/s 201.1313 Ops/s $\color{#35bf28}+1.20\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0270ms 0.6710ms 1.4902 KOps/s 1.4916 KOps/s $\color{#d91a1a}-0.09\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0157ms 0.6495ms 1.5396 KOps/s 1.5267 KOps/s $\color{#35bf28}+0.84\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.5076s 14.3708ms 69.5856 Ops/s 222.3245 Ops/s $\textbf{\color{#d91a1a}-68.70\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 8.4505ms 2.5089ms 398.5787 Ops/s 399.4006 Ops/s $\color{#d91a1a}-0.21\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.8812ms 1.2528ms 798.2264 Ops/s 739.1031 Ops/s $\textbf{\color{#35bf28}+8.00\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.1927ms 4.2792ms 233.6911 Ops/s 225.7378 Ops/s $\color{#35bf28}+3.52\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 5.9326ms 2.3052ms 433.8069 Ops/s 433.0598 Ops/s $\color{#35bf28}+0.17\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.3206ms 1.3570ms 736.9297 Ops/s 841.1213 Ops/s $\textbf{\color{#d91a1a}-12.39\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.4370s 13.1155ms 76.2456 Ops/s 219.5506 Ops/s $\textbf{\color{#d91a1a}-65.27\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.9097ms 2.5452ms 392.8999 Ops/s 367.2820 Ops/s $\textbf{\color{#35bf28}+6.98\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.1566ms 1.4747ms 678.1171 Ops/s 695.0708 Ops/s $\color{#d91a1a}-2.44\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 13.1828ms 11.7661ms 84.9896 Ops/s 81.5605 Ops/s $\color{#35bf28}+4.20\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.9556ms 14.5677ms 68.6452 Ops/s 69.9885 Ops/s $\color{#d91a1a}-1.92\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 21.8040ms 20.6142ms 48.5103 Ops/s 47.3752 Ops/s $\color{#35bf28}+2.40\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 16.1401ms 14.8010ms 67.5630 Ops/s 67.8766 Ops/s $\color{#d91a1a}-0.46\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 21.1041ms 20.6900ms 48.3325 Ops/s 48.1650 Ops/s $\color{#35bf28}+0.35\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 17.9051ms 15.9865ms 62.5528 Ops/s 63.0302 Ops/s $\color{#d91a1a}-0.76\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}25$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.8683s 0.7854s 1.2732 Ops/s 1.2138 Ops/s $\color{#35bf28}+4.89\%$
test_transformed 1.4307s 1.3518s 0.7398 Ops/s 0.6933 Ops/s $\textbf{\color{#35bf28}+6.70\%}$
test_serial 2.3467s 2.2573s 0.4430 Ops/s 0.4199 Ops/s $\textbf{\color{#35bf28}+5.52\%}$
test_parallel 1.9493s 1.8405s 0.5433 Ops/s 0.5343 Ops/s $\color{#35bf28}+1.69\%$
test_step_mdp_speed[True-True-True-True-True] 0.1817ms 40.3511μs 24.7825 KOps/s 24.7468 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-True-True-True-False] 56.5300μs 23.5595μs 42.4457 KOps/s 40.8932 KOps/s $\color{#35bf28}+3.80\%$
test_step_mdp_speed[True-True-True-False-True] 48.9700μs 22.0825μs 45.2848 KOps/s 43.0909 KOps/s $\textbf{\color{#35bf28}+5.09\%}$
test_step_mdp_speed[True-True-True-False-False] 59.1810μs 13.0938μs 76.3718 KOps/s 71.6536 KOps/s $\textbf{\color{#35bf28}+6.58\%}$
test_step_mdp_speed[True-True-False-True-True] 84.0300μs 42.4212μs 23.5731 KOps/s 22.8308 KOps/s $\color{#35bf28}+3.25\%$
test_step_mdp_speed[True-True-False-True-False] 74.8110μs 25.3646μs 39.4250 KOps/s 37.2063 KOps/s $\textbf{\color{#35bf28}+5.96\%}$
test_step_mdp_speed[True-True-False-False-True] 81.4400μs 24.4394μs 40.9175 KOps/s 39.4118 KOps/s $\color{#35bf28}+3.82\%$
test_step_mdp_speed[True-True-False-False-False] 63.8000μs 14.9188μs 67.0294 KOps/s 62.0803 KOps/s $\textbf{\color{#35bf28}+7.97\%}$
test_step_mdp_speed[True-False-True-True-True] 0.2003ms 43.6050μs 22.9332 KOps/s 22.6190 KOps/s $\color{#35bf28}+1.39\%$
test_step_mdp_speed[True-False-True-True-False] 67.4510μs 28.0120μs 35.6990 KOps/s 36.3068 KOps/s $\color{#d91a1a}-1.67\%$
test_step_mdp_speed[True-False-True-False-True] 49.3310μs 24.4132μs 40.9615 KOps/s 40.2725 KOps/s $\color{#35bf28}+1.71\%$
test_step_mdp_speed[True-False-True-False-False] 61.7810μs 15.1858μs 65.8508 KOps/s 63.8058 KOps/s $\color{#35bf28}+3.21\%$
test_step_mdp_speed[True-False-False-True-True] 99.8310μs 47.1862μs 21.1926 KOps/s 21.5905 KOps/s $\color{#d91a1a}-1.84\%$
test_step_mdp_speed[True-False-False-True-False] 70.0800μs 30.4884μs 32.7994 KOps/s 32.2352 KOps/s $\color{#35bf28}+1.75\%$
test_step_mdp_speed[True-False-False-False-True] 88.8710μs 25.9704μs 38.5054 KOps/s 38.3992 KOps/s $\color{#35bf28}+0.28\%$
test_step_mdp_speed[True-False-False-False-False] 42.3000μs 17.4392μs 57.3422 KOps/s 54.2966 KOps/s $\textbf{\color{#35bf28}+5.61\%}$
test_step_mdp_speed[False-True-True-True-True] 0.4252ms 45.0026μs 22.2209 KOps/s 22.8059 KOps/s $\color{#d91a1a}-2.57\%$
test_step_mdp_speed[False-True-True-True-False] 0.4285ms 28.4452μs 35.1553 KOps/s 35.9265 KOps/s $\color{#d91a1a}-2.15\%$
test_step_mdp_speed[False-True-True-False-True] 71.1310μs 28.2816μs 35.3587 KOps/s 34.8813 KOps/s $\color{#35bf28}+1.37\%$
test_step_mdp_speed[False-True-True-False-False] 0.4071ms 17.0671μs 58.5923 KOps/s 58.0442 KOps/s $\color{#35bf28}+0.94\%$
test_step_mdp_speed[False-True-False-True-True] 0.4597ms 46.9515μs 21.2986 KOps/s 21.2343 KOps/s $\color{#35bf28}+0.30\%$
test_step_mdp_speed[False-True-False-True-False] 0.4210ms 30.4108μs 32.8831 KOps/s 32.7089 KOps/s $\color{#35bf28}+0.53\%$
test_step_mdp_speed[False-True-False-False-True] 3.1856ms 31.2227μs 32.0280 KOps/s 31.6348 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[False-True-False-False-False] 0.4074ms 19.4910μs 51.3056 KOps/s 52.2984 KOps/s $\color{#d91a1a}-1.90\%$
test_step_mdp_speed[False-False-True-True-True] 0.4359ms 50.0795μs 19.9682 KOps/s 21.3964 KOps/s $\textbf{\color{#d91a1a}-6.67\%}$
test_step_mdp_speed[False-False-True-True-False] 0.4193ms 33.2668μs 30.0600 KOps/s 31.2997 KOps/s $\color{#d91a1a}-3.96\%$
test_step_mdp_speed[False-False-True-False-True] 67.5010μs 30.5637μs 32.7186 KOps/s 32.0485 KOps/s $\color{#35bf28}+2.09\%$
test_step_mdp_speed[False-False-True-False-False] 0.4054ms 19.4740μs 51.3506 KOps/s 50.4795 KOps/s $\color{#35bf28}+1.73\%$
test_step_mdp_speed[False-False-False-True-True] 0.4385ms 51.6966μs 19.3436 KOps/s 19.4161 KOps/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[False-False-False-True-False] 0.4205ms 35.0958μs 28.4934 KOps/s 28.9062 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[False-False-False-False-True] 74.0310μs 32.7520μs 30.5325 KOps/s 30.2287 KOps/s $\color{#35bf28}+1.01\%$
test_step_mdp_speed[False-False-False-False-False] 0.4082ms 21.7864μs 45.9003 KOps/s 45.1399 KOps/s $\color{#35bf28}+1.68\%$
test_values[generalized_advantage_estimate-True-True] 26.3799ms 25.4885ms 39.2334 Ops/s 36.9602 Ops/s $\textbf{\color{#35bf28}+6.15\%}$
test_values[vec_generalized_advantage_estimate-True-True] 0.1077s 3.0691ms 325.8258 Ops/s 325.0613 Ops/s $\color{#35bf28}+0.24\%$
test_values[td0_return_estimate-False-False] 0.1117ms 81.0155μs 12.3433 KOps/s 12.0147 KOps/s $\color{#35bf28}+2.74\%$
test_values[td1_return_estimate-False-False] 58.4010ms 57.0134ms 17.5397 Ops/s 16.8931 Ops/s $\color{#35bf28}+3.83\%$
test_values[vec_td1_return_estimate-False-False] 1.4063ms 1.0898ms 917.5908 Ops/s 905.0862 Ops/s $\color{#35bf28}+1.38\%$
test_values[td_lambda_return_estimate-True-False] 92.4645ms 89.7905ms 11.1370 Ops/s 10.8303 Ops/s $\color{#35bf28}+2.83\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4240ms 1.1069ms 903.3903 Ops/s 888.4103 Ops/s $\color{#35bf28}+1.69\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.3961ms 24.9453ms 40.0878 Ops/s 36.5408 Ops/s $\textbf{\color{#35bf28}+9.71\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0245ms 0.7529ms 1.3282 KOps/s 1.3045 KOps/s $\color{#35bf28}+1.81\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 1.0840ms 0.6839ms 1.4622 KOps/s 1.4595 KOps/s $\color{#35bf28}+0.18\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.6022ms 1.4867ms 672.6119 Ops/s 667.0974 Ops/s $\color{#35bf28}+0.83\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.0764ms 0.6917ms 1.4457 KOps/s 1.4295 KOps/s $\color{#35bf28}+1.13\%$
test_dqn_speed[False-None] 6.7442ms 1.5171ms 659.1508 Ops/s 623.2899 Ops/s $\textbf{\color{#35bf28}+5.75\%}$
test_dqn_speed[False-backward] 2.2202ms 2.1283ms 469.8609 Ops/s 456.9258 Ops/s $\color{#35bf28}+2.83\%$
test_dqn_speed[True-None] 0.6583ms 0.5514ms 1.8134 KOps/s 1.7328 KOps/s $\color{#35bf28}+4.65\%$
test_dqn_speed[True-backward] 1.2532ms 1.2138ms 823.8662 Ops/s 882.5976 Ops/s $\textbf{\color{#d91a1a}-6.65\%}$
test_dqn_speed[reduce-overhead-None] 0.6585ms 0.5678ms 1.7612 KOps/s 1.6843 KOps/s $\color{#35bf28}+4.57\%$
test_dqn_speed[reduce-overhead-backward] 1.1396ms 1.0762ms 929.2178 Ops/s 1.0321 KOps/s $\textbf{\color{#d91a1a}-9.97\%}$
test_ddpg_speed[False-None] 3.1614ms 2.8633ms 349.2446 Ops/s 335.4752 Ops/s $\color{#35bf28}+4.10\%$
test_ddpg_speed[False-backward] 4.6526ms 4.2468ms 235.4709 Ops/s 234.0208 Ops/s $\color{#35bf28}+0.62\%$
test_ddpg_speed[True-None] 1.5449ms 1.3378ms 747.4994 Ops/s 730.6763 Ops/s $\color{#35bf28}+2.30\%$
test_ddpg_speed[True-backward] 2.6106ms 2.5584ms 390.8732 Ops/s 381.7949 Ops/s $\color{#35bf28}+2.38\%$
test_ddpg_speed[reduce-overhead-None] 1.4624ms 1.3453ms 743.3205 Ops/s 690.5262 Ops/s $\textbf{\color{#35bf28}+7.65\%}$
test_ddpg_speed[reduce-overhead-backward] 2.0059ms 1.9391ms 515.6950 Ops/s 466.0163 Ops/s $\textbf{\color{#35bf28}+10.66\%}$
test_sac_speed[False-None] 8.4520ms 8.0241ms 124.6243 Ops/s 115.6990 Ops/s $\textbf{\color{#35bf28}+7.71\%}$
test_sac_speed[False-backward] 11.5284ms 10.9063ms 91.6903 Ops/s 86.3082 Ops/s $\textbf{\color{#35bf28}+6.24\%}$
test_sac_speed[True-None] 2.2204ms 1.8379ms 544.1121 Ops/s 517.6150 Ops/s $\textbf{\color{#35bf28}+5.12\%}$
test_sac_speed[True-backward] 4.2356ms 3.8010ms 263.0896 Ops/s 255.8862 Ops/s $\color{#35bf28}+2.82\%$
test_sac_speed[reduce-overhead-None] 21.1482ms 12.0423ms 83.0408 Ops/s 81.8176 Ops/s $\color{#35bf28}+1.50\%$
test_sac_speed[reduce-overhead-backward] 1.8450ms 1.7855ms 560.0792 Ops/s 590.5670 Ops/s $\textbf{\color{#d91a1a}-5.16\%}$
test_redq_speed[False-None] 7.9059ms 7.5229ms 132.9273 Ops/s 127.8974 Ops/s $\color{#35bf28}+3.93\%$
test_redq_speed[False-backward] 12.1723ms 11.6369ms 85.9333 Ops/s 84.6308 Ops/s $\color{#35bf28}+1.54\%$
test_redq_speed[True-None] 2.8116ms 2.3903ms 418.3624 Ops/s 419.2554 Ops/s $\color{#d91a1a}-0.21\%$
test_redq_speed[True-backward] 4.4992ms 4.1721ms 239.6884 Ops/s 233.3214 Ops/s $\color{#35bf28}+2.73\%$
test_redq_speed[reduce-overhead-None] 2.5805ms 2.3911ms 418.2144 Ops/s 417.7059 Ops/s $\color{#35bf28}+0.12\%$
test_redq_speed[reduce-overhead-backward] 4.5453ms 4.1998ms 238.1078 Ops/s 244.1085 Ops/s $\color{#d91a1a}-2.46\%$
test_redq_deprec_speed[False-None] 9.3242ms 9.0222ms 110.8374 Ops/s 106.8386 Ops/s $\color{#35bf28}+3.74\%$
test_redq_deprec_speed[False-backward] 12.7947ms 12.2827ms 81.4151 Ops/s 81.3667 Ops/s $\color{#35bf28}+0.06\%$
test_redq_deprec_speed[True-None] 2.7664ms 2.6280ms 380.5184 Ops/s 369.5242 Ops/s $\color{#35bf28}+2.98\%$
test_redq_deprec_speed[True-backward] 4.7756ms 4.4693ms 223.7471 Ops/s 216.9623 Ops/s $\color{#35bf28}+3.13\%$
test_redq_deprec_speed[reduce-overhead-None] 3.0645ms 2.6518ms 377.1013 Ops/s 361.6255 Ops/s $\color{#35bf28}+4.28\%$
test_redq_deprec_speed[reduce-overhead-backward] 4.5311ms 4.4673ms 223.8493 Ops/s 218.5310 Ops/s $\color{#35bf28}+2.43\%$
test_td3_speed[False-None] 8.2573ms 7.9606ms 125.6184 Ops/s 120.3123 Ops/s $\color{#35bf28}+4.41\%$
test_td3_speed[False-backward] 11.0618ms 10.4908ms 95.3218 Ops/s 92.8330 Ops/s $\color{#35bf28}+2.68\%$
test_td3_speed[True-None] 1.6769ms 1.6398ms 609.8375 Ops/s 585.5155 Ops/s $\color{#35bf28}+4.15\%$
test_td3_speed[True-backward] 3.4656ms 3.3464ms 298.8329 Ops/s 307.2128 Ops/s $\color{#d91a1a}-2.73\%$
test_td3_speed[reduce-overhead-None] 49.9900ms 25.7157ms 38.8868 Ops/s 38.6406 Ops/s $\color{#35bf28}+0.64\%$
test_td3_speed[reduce-overhead-backward] 1.5402ms 1.4858ms 673.0536 Ops/s 724.7661 Ops/s $\textbf{\color{#d91a1a}-7.14\%}$
test_cql_speed[False-None] 17.0066ms 16.6784ms 59.9578 Ops/s 57.8297 Ops/s $\color{#35bf28}+3.68\%$
test_cql_speed[False-backward] 23.1550ms 22.2629ms 44.9178 Ops/s 44.5253 Ops/s $\color{#35bf28}+0.88\%$
test_cql_speed[True-None] 3.6758ms 3.2705ms 305.7595 Ops/s 300.9377 Ops/s $\color{#35bf28}+1.60\%$
test_cql_speed[True-backward] 5.9812ms 5.6858ms 175.8768 Ops/s 169.5438 Ops/s $\color{#35bf28}+3.74\%$
test_cql_speed[reduce-overhead-None] 20.3930ms 12.8774ms 77.6555 Ops/s 75.5758 Ops/s $\color{#35bf28}+2.75\%$
test_cql_speed[reduce-overhead-backward] 2.1577ms 2.0048ms 498.8089 Ops/s 487.7160 Ops/s $\color{#35bf28}+2.27\%$
test_a2c_speed[False-None] 3.5870ms 3.2237ms 310.1984 Ops/s 301.4859 Ops/s $\color{#35bf28}+2.89\%$
test_a2c_speed[False-backward] 6.9971ms 6.3007ms 158.7114 Ops/s 152.5626 Ops/s $\color{#35bf28}+4.03\%$
test_a2c_speed[True-None] 1.5337ms 1.3528ms 739.1927 Ops/s 720.8747 Ops/s $\color{#35bf28}+2.54\%$
test_a2c_speed[True-backward] 3.1126ms 3.0495ms 327.9188 Ops/s 332.0593 Ops/s $\color{#d91a1a}-1.25\%$
test_a2c_speed[reduce-overhead-None] 15.9956ms 8.9858ms 111.2868 Ops/s 111.0730 Ops/s $\color{#35bf28}+0.19\%$
test_a2c_speed[reduce-overhead-backward] 1.7426ms 1.6099ms 621.1468 Ops/s 670.8562 Ops/s $\textbf{\color{#d91a1a}-7.41\%}$
test_ppo_speed[False-None] 3.9094ms 3.7122ms 269.3823 Ops/s 259.7211 Ops/s $\color{#35bf28}+3.72\%$
test_ppo_speed[False-backward] 7.4722ms 7.0329ms 142.1888 Ops/s 142.9387 Ops/s $\color{#d91a1a}-0.52\%$
test_ppo_speed[True-None] 1.7967ms 1.4124ms 708.0356 Ops/s 689.6013 Ops/s $\color{#35bf28}+2.67\%$
test_ppo_speed[True-backward] 3.2934ms 3.2104ms 311.4846 Ops/s 302.5972 Ops/s $\color{#35bf28}+2.94\%$
test_ppo_speed[reduce-overhead-None] 1.1430ms 0.9705ms 1.0304 KOps/s 1.0278 KOps/s $\color{#35bf28}+0.25\%$
test_ppo_speed[reduce-overhead-backward] 1.7108ms 1.5618ms 640.2910 Ops/s 615.7516 Ops/s $\color{#35bf28}+3.99\%$
test_reinforce_speed[False-None] 2.4425ms 2.2654ms 441.4216 Ops/s 423.9179 Ops/s $\color{#35bf28}+4.13\%$
test_reinforce_speed[False-backward] 3.4309ms 3.3676ms 296.9515 Ops/s 285.0354 Ops/s $\color{#35bf28}+4.18\%$
test_reinforce_speed[True-None] 1.7354ms 1.2967ms 771.2043 Ops/s 746.3045 Ops/s $\color{#35bf28}+3.34\%$
test_reinforce_speed[True-backward] 3.1330ms 3.0645ms 326.3173 Ops/s 322.8340 Ops/s $\color{#35bf28}+1.08\%$
test_reinforce_speed[reduce-overhead-None] 17.9848ms 9.9748ms 100.2529 Ops/s 100.2096 Ops/s $\color{#35bf28}+0.04\%$
test_reinforce_speed[reduce-overhead-backward] 1.7687ms 1.6419ms 609.0589 Ops/s 606.9330 Ops/s $\color{#35bf28}+0.35\%$
test_iql_speed[False-None] 10.2255ms 9.2244ms 108.4080 Ops/s 104.0409 Ops/s $\color{#35bf28}+4.20\%$
test_iql_speed[False-backward] 13.5957ms 13.0790ms 76.4586 Ops/s 72.8301 Ops/s $\color{#35bf28}+4.98\%$
test_iql_speed[True-None] 2.3360ms 2.2041ms 453.7093 Ops/s 432.0667 Ops/s $\textbf{\color{#35bf28}+5.01\%}$
test_iql_speed[True-backward] 5.0235ms 4.9002ms 204.0714 Ops/s 197.4032 Ops/s $\color{#35bf28}+3.38\%$
test_iql_speed[reduce-overhead-None] 20.2832ms 11.1457ms 89.7210 Ops/s 89.0914 Ops/s $\color{#35bf28}+0.71\%$
test_iql_speed[reduce-overhead-backward] 2.0309ms 1.9102ms 523.4998 Ops/s 463.5429 Ops/s $\textbf{\color{#35bf28}+12.93\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.8866ms 6.3644ms 157.1246 Ops/s 154.2853 Ops/s $\color{#35bf28}+1.84\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6011ms 0.3587ms 2.7882 KOps/s 2.9075 KOps/s $\color{#d91a1a}-4.10\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6651ms 0.2956ms 3.3828 KOps/s 3.1600 KOps/s $\textbf{\color{#35bf28}+7.05\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.3455ms 6.0604ms 165.0058 Ops/s 161.6098 Ops/s $\color{#35bf28}+2.10\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.8208ms 0.3307ms 3.0236 KOps/s 3.2866 KOps/s $\textbf{\color{#d91a1a}-8.00\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5142ms 0.3193ms 3.1321 KOps/s 3.4060 KOps/s $\textbf{\color{#d91a1a}-8.04\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7518ms 1.4233ms 702.5853 Ops/s 664.3287 Ops/s $\textbf{\color{#35bf28}+5.76\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4327ms 1.1774ms 849.3461 Ops/s 801.7861 Ops/s $\textbf{\color{#35bf28}+5.93\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.4140ms 6.2658ms 159.5957 Ops/s 155.9717 Ops/s $\color{#35bf28}+2.32\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1404ms 0.4510ms 2.2174 KOps/s 2.3191 KOps/s $\color{#d91a1a}-4.39\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6929ms 0.4114ms 2.4305 KOps/s 2.3589 KOps/s $\color{#35bf28}+3.03\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.2526ms 6.1160ms 163.5069 Ops/s 159.8513 Ops/s $\color{#35bf28}+2.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.2849ms 0.3854ms 2.5946 KOps/s 2.9116 KOps/s $\textbf{\color{#d91a1a}-10.89\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5401ms 0.3242ms 3.0848 KOps/s 3.0727 KOps/s $\color{#35bf28}+0.39\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9994ms 6.0756ms 164.5922 Ops/s 161.2213 Ops/s $\color{#35bf28}+2.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.6892ms 0.2829ms 3.5353 KOps/s 3.5599 KOps/s $\color{#d91a1a}-0.69\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5140ms 0.2864ms 3.4912 KOps/s 3.7616 KOps/s $\textbf{\color{#d91a1a}-7.19\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.4687ms 6.2714ms 159.4531 Ops/s 158.0133 Ops/s $\color{#35bf28}+0.91\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7756ms 0.4926ms 2.0298 KOps/s 2.0340 KOps/s $\color{#d91a1a}-0.20\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7669ms 0.4315ms 2.3176 KOps/s 2.0325 KOps/s $\textbf{\color{#35bf28}+14.03\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 7.0019ms 5.4554ms 183.3032 Ops/s 178.1944 Ops/s $\color{#35bf28}+2.87\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 3.9153ms 1.9213ms 520.4933 Ops/s 422.2741 Ops/s $\textbf{\color{#35bf28}+23.26\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 8.7169ms 1.2428ms 804.6093 Ops/s 829.7931 Ops/s $\color{#d91a1a}-3.03\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.7828ms 5.5947ms 178.7396 Ops/s 176.9458 Ops/s $\color{#35bf28}+1.01\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.3259ms 2.0371ms 490.8882 Ops/s 455.2779 Ops/s $\textbf{\color{#35bf28}+7.82\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.8135ms 1.2642ms 791.0173 Ops/s 774.7430 Ops/s $\color{#35bf28}+2.10\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.5123s 15.8912ms 62.9278 Ops/s 30.9589 Ops/s $\textbf{\color{#35bf28}+103.26\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 10.0622ms 2.2010ms 454.3310 Ops/s 445.3132 Ops/s $\color{#35bf28}+2.03\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.2827ms 1.3446ms 743.7362 Ops/s 850.7331 Ops/s $\textbf{\color{#d91a1a}-12.58\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 13.8995ms 13.3665ms 74.8139 Ops/s 72.9212 Ops/s $\color{#35bf28}+2.60\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 18.7413ms 17.0379ms 58.6928 Ops/s 56.5861 Ops/s $\color{#35bf28}+3.72\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 18.4382ms 18.0494ms 55.4035 Ops/s 52.5889 Ops/s $\textbf{\color{#35bf28}+5.35\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.1238ms 17.4761ms 57.2211 Ops/s 56.1020 Ops/s $\color{#35bf28}+1.99\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 18.8752ms 18.1313ms 55.1534 Ops/s 52.5998 Ops/s $\color{#35bf28}+4.85\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.5154ms 18.7841ms 53.2364 Ops/s 51.1403 Ops/s $\color{#35bf28}+4.10\%$

@vmoens
Update
c95fdc1 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
2231b24 
ghstack-source-id: 8121a3b4bf03c41866d72d23f7dfde5a2287bb5e
Pull Request resolved: #2776
@vmoens
Update
7c8787a 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
4245614 
ghstack-source-id: b85382662fd2610bc7a09d0023aaaae5fba1b73b
Pull Request resolved: #2776
@vmoens
Update
64d0d81 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
bfacf6f 
ghstack-source-id: c0ca881bcf84c84e773bca18ee1c80a4d767e7db
Pull Request resolved: #2776
@vmoens vmoens added the documentation Improvements or additions to documentation label Feb 10, 2025
@vmoens
Update
e438a53 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
4504830 
ghstack-source-id: 438929bfc3bff494afbcf217baafa03cd5c78a3c
Pull Request resolved: #2776
@vmoens
Update
9cd51e3 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
a8efef8 
ghstack-source-id: f37d83203a26f3b4f85fb95b7cbd3cc8838dd3ee
Pull Request resolved: #2776
@vmoens
Update
d87ae1d 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
da67dcf 
ghstack-source-id: 2f81b7a0357bcd97659ba5a338f089cef1413589
Pull Request resolved: #2776
@vmoens
Update
b4288a2 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
3f00e8c 
ghstack-source-id: f4f6b6c5b484292cf631258b2803069e42028780
Pull Request resolved: #2776
@vmoens
Update
70a82ec 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 10, 2025
@vmoens
[Doc] Solve ref issues in docstrings
8a2da38 
ghstack-source-id: bda4a18860612db78974df3c52078a81927d4a1c
Pull Request resolved: #2776
@vmoens
Update
dac6854 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
db65778 
ghstack-source-id: 8d81baca1ce572055ff7ced565605a45b7054c47
Pull Request resolved: #2776
@vmoens
Update
c93b9d2 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
2e9ed8b 
ghstack-source-id: 4c382f518b69d60158e63dd109db84f7a395d42a
Pull Request resolved: #2776
@vmoens
Update
6d13fb6 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
6a62a25 
ghstack-source-id: a3ff9e5e4fbe6f50b194d8a3a262c83af8e2451b
Pull Request resolved: #2776
@vmoens
Update
425ad4e 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
ebdb943 
ghstack-source-id: 286064b7123282ab28127426bce9e845eca44ea2
Pull Request resolved: #2776
@vmoens
Update
0a5ae24 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
8adee19 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776
@vmoens vmoens merged commit 0a5ae24 into gh/vmoens/86/base Feb 11, 2025
1 check passed
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
f5445a4 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776
@vmoens vmoens deleted the gh/vmoens/86/head branch February 11, 2025 22:08
vmoens added a commit that referenced this pull request Feb 11, 2025
@vmoens
[Doc] Solve ref issues in docstrings
44fd0b2 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
d0e5676 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
2878284 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
2c55829 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
7652675 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
93f1106 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
558348e 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
14f8bf8 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
53a0b02 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
abd575f 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
bd17a3a 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
355fc57 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
f1eadff 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
c06d088 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
5b73bf8 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
6fea6c4 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
efd2351 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
vmoens added a commit that referenced this pull request Feb 12, 2025
@vmoens
[Doc] Solve ref issues in docstrings
36d260c 
ghstack-source-id: 09823fa85a94115291e7434478776fb0834f9b39
Pull Request resolved: #2776

(cherry picked from commit f5445a4)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot