Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Test] Add PEnv tests for devices #2843

Open
wants to merge 1 commit into
base: gh/vmoens/110/base
Choose a base branch
from
Open

[Test] Add PEnv tests for devices #2843

wants to merge 1 commit into from

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Mar 10, 2025 •
edited
Loading

Stack from ghstack (oldest at bottom):

@vmoens
Update
75de0c2 
[ghstack-poisoned]
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 10, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2843

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 1 Unrelated Failure

As of commit 75de0c2 with merge base 6e40548 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 10, 2025
vmoens added a commit that referenced this pull request Mar 10, 2025
@vmoens
[Test] Add PEnv tests for devices
ce3e5ad 
ghstack-source-id: ad6dcce87bcde2a22f619b9742324073eb67cd5b
Pull Request resolved: #2843
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}7$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.5166s 0.5124s 1.9516 Ops/s 1.8887 Ops/s $\color{#35bf28}+3.33\%$
test_transformed 1.1578s 1.0602s 0.9432 Ops/s 0.9897 Ops/s $\color{#d91a1a}-4.70\%$
test_serial 1.6677s 1.5753s 0.6348 Ops/s 0.6541 Ops/s $\color{#d91a1a}-2.94\%$
test_parallel 1.4236s 1.3175s 0.7590 Ops/s 0.7487 Ops/s $\color{#35bf28}+1.38\%$
test_step_mdp_speed[True-True-True-True-True] 0.1778ms 29.8960μs 33.4493 KOps/s 33.4561 KOps/s $\color{#d91a1a}-0.02\%$
test_step_mdp_speed[True-True-True-True-False] 52.8790μs 17.8605μs 55.9896 KOps/s 56.1451 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[True-True-True-False-True] 56.7960μs 16.9323μs 59.0586 KOps/s 59.0798 KOps/s $\color{#d91a1a}-0.04\%$
test_step_mdp_speed[True-True-True-False-False] 38.1220μs 9.9324μs 100.6808 KOps/s 100.7379 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-True-False-True-True] 0.5293ms 32.1908μs 31.0648 KOps/s 31.4759 KOps/s $\color{#d91a1a}-1.31\%$
test_step_mdp_speed[True-True-False-True-False] 58.6800μs 19.7796μs 50.5571 KOps/s 50.9422 KOps/s $\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-True-False-False-True] 49.2220μs 18.8084μs 53.1677 KOps/s 52.9665 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[True-True-False-False-False] 41.5980μs 11.8332μs 84.5082 KOps/s 84.6111 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[True-False-True-True-True] 87.0030μs 34.3719μs 29.0935 KOps/s 29.4826 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-False-True-True-False] 52.8300μs 21.3933μs 46.7437 KOps/s 46.7279 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[True-False-True-False-True] 48.9920μs 18.9550μs 52.7565 KOps/s 53.2136 KOps/s $\color{#d91a1a}-0.86\%$
test_step_mdp_speed[True-False-True-False-False] 56.2460μs 11.9244μs 83.8618 KOps/s 84.4939 KOps/s $\color{#d91a1a}-0.75\%$
test_step_mdp_speed[True-False-False-True-True] 74.1890μs 35.7432μs 27.9774 KOps/s 28.0588 KOps/s $\color{#d91a1a}-0.29\%$
test_step_mdp_speed[True-False-False-True-False] 51.7170μs 23.2461μs 43.0180 KOps/s 42.8901 KOps/s $\color{#35bf28}+0.30\%$
test_step_mdp_speed[True-False-False-False-True] 55.2240μs 20.7485μs 48.1962 KOps/s 49.0452 KOps/s $\color{#d91a1a}-1.73\%$
test_step_mdp_speed[True-False-False-False-False] 41.3670μs 13.6460μs 73.2817 KOps/s 74.0856 KOps/s $\color{#d91a1a}-1.09\%$
test_step_mdp_speed[False-True-True-True-True] 0.1063ms 34.1527μs 29.2803 KOps/s 29.4907 KOps/s $\color{#d91a1a}-0.71\%$
test_step_mdp_speed[False-True-True-True-False] 53.3800μs 21.6540μs 46.1808 KOps/s 46.6404 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-True-True-False-True] 47.6990μs 21.6468μs 46.1962 KOps/s 46.7753 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[False-True-True-False-False] 53.8410μs 13.2611μs 75.4088 KOps/s 75.5047 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[False-True-False-True-True] 80.6110μs 35.7941μs 27.9376 KOps/s 28.0496 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[False-True-False-True-False] 2.6612ms 23.4932μs 42.5655 KOps/s 42.5148 KOps/s $\color{#35bf28}+0.12\%$
test_step_mdp_speed[False-True-False-False-True] 50.8450μs 23.1244μs 43.2445 KOps/s 42.8394 KOps/s $\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-True-False-False-False] 75.5920μs 14.8770μs 67.2178 KOps/s 66.6429 KOps/s $\color{#35bf28}+0.86\%$
test_step_mdp_speed[False-False-True-True-True] 88.5260μs 37.3359μs 26.7838 KOps/s 26.7580 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-False-True-True-False] 79.3660μs 25.2311μs 39.6336 KOps/s 40.0279 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[False-False-True-False-True] 72.7060μs 23.0492μs 43.3855 KOps/s 43.1380 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[False-False-True-False-False] 47.9300μs 14.8187μs 67.4824 KOps/s 66.5325 KOps/s $\color{#35bf28}+1.43\%$
test_step_mdp_speed[False-False-False-True-True] 73.3970μs 38.9059μs 25.7031 KOps/s 25.5007 KOps/s $\color{#35bf28}+0.79\%$
test_step_mdp_speed[False-False-False-True-False] 58.8600μs 26.7636μs 37.3641 KOps/s 37.0770 KOps/s $\color{#35bf28}+0.77\%$
test_step_mdp_speed[False-False-False-False-True] 60.4730μs 24.8419μs 40.2546 KOps/s 40.5911 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[False-False-False-False-False] 48.6110μs 16.6985μs 59.8855 KOps/s 59.9749 KOps/s $\color{#d91a1a}-0.15\%$
test_values[generalized_advantage_estimate-True-True] 11.1449ms 10.0880ms 99.1277 Ops/s 102.3907 Ops/s $\color{#d91a1a}-3.19\%$
test_values[vec_generalized_advantage_estimate-True-True] 28.3078ms 24.6350ms 40.5926 Ops/s 40.9865 Ops/s $\color{#d91a1a}-0.96\%$
test_values[td0_return_estimate-False-False] 0.3095ms 0.2168ms 4.6128 KOps/s 4.9882 KOps/s $\textbf{\color{#d91a1a}-7.53\%}$
test_values[td1_return_estimate-False-False] 25.2168ms 24.6860ms 40.5088 Ops/s 40.6704 Ops/s $\color{#d91a1a}-0.40\%$
test_values[vec_td1_return_estimate-False-False] 35.0415ms 25.2218ms 39.6483 Ops/s 40.5483 Ops/s $\color{#d91a1a}-2.22\%$
test_values[td_lambda_return_estimate-True-False] 35.3204ms 34.8172ms 28.7214 Ops/s 28.4853 Ops/s $\color{#35bf28}+0.83\%$
test_values[vec_td_lambda_return_estimate-True-False] 26.0536ms 24.5209ms 40.7815 Ops/s 40.0749 Ops/s $\color{#35bf28}+1.76\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.4796ms 8.3778ms 119.3624 Ops/s 117.2134 Ops/s $\color{#35bf28}+1.83\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.1246ms 1.8351ms 544.9170 Ops/s 502.4941 Ops/s $\textbf{\color{#35bf28}+8.44\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5578ms 0.3692ms 2.7084 KOps/s 2.5886 KOps/s $\color{#35bf28}+4.63\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.3866ms 44.9613ms 22.2414 Ops/s 23.5654 Ops/s $\textbf{\color{#d91a1a}-5.62\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.5309ms 3.4926ms 286.3179 Ops/s 287.2142 Ops/s $\color{#d91a1a}-0.31\%$
test_dqn_speed[False-None] 6.8782ms 1.4719ms 679.4159 Ops/s 670.9875 Ops/s $\color{#35bf28}+1.26\%$
test_dqn_speed[False-backward] 2.0844ms 1.9530ms 512.0278 Ops/s 506.9438 Ops/s $\color{#35bf28}+1.00\%$
test_dqn_speed[True-None] 0.8417ms 0.5896ms 1.6962 KOps/s 1.7275 KOps/s $\color{#d91a1a}-1.81\%$
test_dqn_speed[True-backward] 1.3585ms 1.0655ms 938.5247 Ops/s 945.8604 Ops/s $\color{#d91a1a}-0.78\%$
test_dqn_speed[reduce-overhead-None] 0.7791ms 0.5690ms 1.7576 KOps/s 1.7377 KOps/s $\color{#35bf28}+1.15\%$
test_dqn_speed[reduce-overhead-backward] 1.0984ms 1.0373ms 964.0026 Ops/s 967.4005 Ops/s $\color{#d91a1a}-0.35\%$
test_ddpg_speed[False-None] 3.6600ms 2.9424ms 339.8638 Ops/s 337.9341 Ops/s $\color{#35bf28}+0.57\%$
test_ddpg_speed[False-backward] 4.1675ms 4.0374ms 247.6857 Ops/s 243.5098 Ops/s $\color{#35bf28}+1.71\%$
test_ddpg_speed[True-None] 2.0072ms 1.4460ms 691.5428 Ops/s 680.0673 Ops/s $\color{#35bf28}+1.69\%$
test_ddpg_speed[True-backward] 2.5018ms 2.3551ms 424.6126 Ops/s 409.4713 Ops/s $\color{#35bf28}+3.70\%$
test_ddpg_speed[reduce-overhead-None] 1.6338ms 1.4404ms 694.2315 Ops/s 682.4696 Ops/s $\color{#35bf28}+1.72\%$
test_ddpg_speed[reduce-overhead-backward] 2.5181ms 2.3857ms 419.1588 Ops/s 420.4789 Ops/s $\color{#d91a1a}-0.31\%$
test_sac_speed[False-None] 9.2363ms 8.4465ms 118.3917 Ops/s 121.1183 Ops/s $\color{#d91a1a}-2.25\%$
test_sac_speed[False-backward] 13.2360ms 11.0622ms 90.3980 Ops/s 91.1302 Ops/s $\color{#d91a1a}-0.80\%$
test_sac_speed[True-None] 3.1455ms 2.6282ms 380.4943 Ops/s 379.9692 Ops/s $\color{#35bf28}+0.14\%$
test_sac_speed[True-backward] 4.5591ms 4.3960ms 227.4772 Ops/s 217.9535 Ops/s $\color{#35bf28}+4.37\%$
test_sac_speed[reduce-overhead-None] 3.8373ms 2.7352ms 365.6082 Ops/s 378.3681 Ops/s $\color{#d91a1a}-3.37\%$
test_sac_speed[reduce-overhead-backward] 4.8208ms 4.4014ms 227.1989 Ops/s 225.6773 Ops/s $\color{#35bf28}+0.67\%$
test_redq_speed[False-None] 15.7824ms 13.7291ms 72.8378 Ops/s 71.8420 Ops/s $\color{#35bf28}+1.39\%$
test_redq_speed[False-backward] 26.1020ms 22.8564ms 43.7514 Ops/s 41.8468 Ops/s $\color{#35bf28}+4.55\%$
test_redq_speed[True-None] 8.1246ms 6.8280ms 146.4560 Ops/s 137.5419 Ops/s $\textbf{\color{#35bf28}+6.48\%}$
test_redq_speed[True-backward] 16.2738ms 15.3100ms 65.3167 Ops/s 63.0835 Ops/s $\color{#35bf28}+3.54\%$
test_redq_speed[reduce-overhead-None] 9.1180ms 8.0050ms 124.9223 Ops/s 133.1962 Ops/s $\textbf{\color{#d91a1a}-6.21\%}$
test_redq_speed[reduce-overhead-backward] 16.2801ms 15.3503ms 65.1452 Ops/s 65.0336 Ops/s $\color{#35bf28}+0.17\%$
test_redq_deprec_speed[False-None] 15.2485ms 14.0732ms 71.0571 Ops/s 72.8986 Ops/s $\color{#d91a1a}-2.53\%$
test_redq_deprec_speed[False-backward] 20.9382ms 20.0152ms 49.9620 Ops/s 49.4055 Ops/s $\color{#35bf28}+1.13\%$
test_redq_deprec_speed[True-None] 6.2021ms 5.4382ms 183.8846 Ops/s 186.0929 Ops/s $\color{#d91a1a}-1.19\%$
test_redq_deprec_speed[True-backward] 10.8705ms 10.0908ms 99.0998 Ops/s 92.6794 Ops/s $\textbf{\color{#35bf28}+6.93\%}$
test_redq_deprec_speed[reduce-overhead-None] 6.5907ms 5.8457ms 171.0655 Ops/s 186.9086 Ops/s $\textbf{\color{#d91a1a}-8.48\%}$
test_redq_deprec_speed[reduce-overhead-backward] 11.1391ms 10.5055ms 95.1881 Ops/s 97.1478 Ops/s $\color{#d91a1a}-2.02\%$
test_td3_speed[False-None] 8.7994ms 8.1928ms 122.0579 Ops/s 120.9756 Ops/s $\color{#35bf28}+0.89\%$
test_td3_speed[False-backward] 11.6666ms 10.4675ms 95.5337 Ops/s 93.7177 Ops/s $\color{#35bf28}+1.94\%$
test_td3_speed[True-None] 2.4195ms 2.2693ms 440.6736 Ops/s 432.4295 Ops/s $\color{#35bf28}+1.91\%$
test_td3_speed[True-backward] 4.0904ms 3.9668ms 252.0921 Ops/s 250.9480 Ops/s $\color{#35bf28}+0.46\%$
test_td3_speed[reduce-overhead-None] 2.4532ms 2.2864ms 437.3612 Ops/s 430.2174 Ops/s $\color{#35bf28}+1.66\%$
test_td3_speed[reduce-overhead-backward] 4.1607ms 3.9493ms 253.2077 Ops/s 246.7716 Ops/s $\color{#35bf28}+2.61\%$
test_cql_speed[False-None] 39.4077ms 36.8753ms 27.1184 Ops/s 26.7877 Ops/s $\color{#35bf28}+1.23\%$
test_cql_speed[False-backward] 48.2568ms 46.2952ms 21.6005 Ops/s 20.9072 Ops/s $\color{#35bf28}+3.32\%$
test_cql_speed[True-None] 23.2844ms 22.4019ms 44.6391 Ops/s 44.1569 Ops/s $\color{#35bf28}+1.09\%$
test_cql_speed[True-backward] 31.4596ms 29.5128ms 33.8836 Ops/s 33.7986 Ops/s $\color{#35bf28}+0.25\%$
test_cql_speed[reduce-overhead-None] 23.5053ms 22.4093ms 44.6242 Ops/s 44.8841 Ops/s $\color{#d91a1a}-0.58\%$
test_cql_speed[reduce-overhead-backward] 31.7341ms 29.1589ms 34.2948 Ops/s 33.2205 Ops/s $\color{#35bf28}+3.23\%$
test_a2c_speed[False-None] 8.4271ms 7.2267ms 138.3756 Ops/s 139.3291 Ops/s $\color{#d91a1a}-0.68\%$
test_a2c_speed[False-backward] 14.9214ms 14.0615ms 71.1162 Ops/s 69.8207 Ops/s $\color{#35bf28}+1.86\%$
test_a2c_speed[True-None] 5.4870ms 4.6869ms 213.3629 Ops/s 214.6169 Ops/s $\color{#d91a1a}-0.58\%$
test_a2c_speed[True-backward] 12.4493ms 11.3980ms 87.7348 Ops/s 87.7067 Ops/s $\color{#35bf28}+0.03\%$
test_a2c_speed[reduce-overhead-None] 5.4627ms 4.6818ms 213.5940 Ops/s 212.5113 Ops/s $\color{#35bf28}+0.51\%$
test_a2c_speed[reduce-overhead-backward] 12.8189ms 11.3688ms 87.9600 Ops/s 89.3302 Ops/s $\color{#d91a1a}-1.53\%$
test_ppo_speed[False-None] 8.9393ms 7.5743ms 132.0250 Ops/s 134.4834 Ops/s $\color{#d91a1a}-1.83\%$
test_ppo_speed[False-backward] 15.7463ms 15.0837ms 66.2965 Ops/s 68.8574 Ops/s $\color{#d91a1a}-3.72\%$
test_ppo_speed[True-None] 6.0764ms 5.0884ms 196.5255 Ops/s 192.6604 Ops/s $\color{#35bf28}+2.01\%$
test_ppo_speed[True-backward] 11.9341ms 10.9893ms 90.9980 Ops/s 90.6590 Ops/s $\color{#35bf28}+0.37\%$
test_ppo_speed[reduce-overhead-None] 5.8440ms 5.0283ms 198.8752 Ops/s 196.0837 Ops/s $\color{#35bf28}+1.42\%$
test_ppo_speed[reduce-overhead-backward] 11.8447ms 11.0244ms 90.7081 Ops/s 90.9150 Ops/s $\color{#d91a1a}-0.23\%$
test_reinforce_speed[False-None] 7.4972ms 6.5847ms 151.8667 Ops/s 152.6102 Ops/s $\color{#d91a1a}-0.49\%$
test_reinforce_speed[False-backward] 11.2627ms 9.8557ms 101.4643 Ops/s 102.0392 Ops/s $\color{#d91a1a}-0.56\%$
test_reinforce_speed[True-None] 4.8516ms 4.0398ms 247.5366 Ops/s 246.7616 Ops/s $\color{#35bf28}+0.31\%$
test_reinforce_speed[True-backward] 10.7963ms 10.0838ms 99.1690 Ops/s 99.9163 Ops/s $\color{#d91a1a}-0.75\%$
test_reinforce_speed[reduce-overhead-None] 4.4934ms 4.0442ms 247.2696 Ops/s 247.1914 Ops/s $\color{#35bf28}+0.03\%$
test_reinforce_speed[reduce-overhead-backward] 12.0341ms 10.3031ms 97.0580 Ops/s 95.8617 Ops/s $\color{#35bf28}+1.25\%$
test_iql_speed[False-None] 38.1477ms 33.2196ms 30.1027 Ops/s 30.1423 Ops/s $\color{#d91a1a}-0.13\%$
test_iql_speed[False-backward] 51.5626ms 45.8666ms 21.8023 Ops/s 21.8174 Ops/s $\color{#d91a1a}-0.07\%$
test_iql_speed[True-None] 16.2429ms 15.6979ms 63.7028 Ops/s 63.0586 Ops/s $\color{#35bf28}+1.02\%$
test_iql_speed[True-backward] 28.4575ms 26.7947ms 37.3208 Ops/s 36.7582 Ops/s $\color{#35bf28}+1.53\%$
test_iql_speed[reduce-overhead-None] 16.8882ms 15.9230ms 62.8024 Ops/s 62.2967 Ops/s $\color{#35bf28}+0.81\%$
test_iql_speed[reduce-overhead-backward] 29.2308ms 27.8087ms 35.9600 Ops/s 37.0694 Ops/s $\color{#d91a1a}-2.99\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1451ms 4.8651ms 205.5452 Ops/s 207.0075 Ops/s $\color{#d91a1a}-0.71\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.4504ms 0.5523ms 1.8105 KOps/s 1.8584 KOps/s $\color{#d91a1a}-2.58\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9035ms 0.5183ms 1.9293 KOps/s 1.9206 KOps/s $\color{#35bf28}+0.45\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.3411ms 4.5962ms 217.5706 Ops/s 218.2186 Ops/s $\color{#d91a1a}-0.30\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0394ms 0.5452ms 1.8342 KOps/s 1.8071 KOps/s $\color{#35bf28}+1.50\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9434ms 0.5551ms 1.8015 KOps/s 1.8852 KOps/s $\color{#d91a1a}-4.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.3241ms 1.7738ms 563.7672 Ops/s 559.3198 Ops/s $\color{#35bf28}+0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.1757ms 1.6816ms 594.6667 Ops/s 590.7194 Ops/s $\color{#35bf28}+0.67\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.2391ms 4.7895ms 208.7907 Ops/s 203.5819 Ops/s $\color{#35bf28}+2.56\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.5938ms 0.6993ms 1.4300 KOps/s 1.3276 KOps/s $\textbf{\color{#35bf28}+7.71\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0224ms 0.6816ms 1.4672 KOps/s 1.4738 KOps/s $\color{#d91a1a}-0.45\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.8670ms 4.4910ms 222.6675 Ops/s 217.2816 Ops/s $\color{#35bf28}+2.48\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.2647ms 0.5514ms 1.8137 KOps/s 1.8135 KOps/s $\color{#35bf28}+0.01\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7441ms 0.5215ms 1.9175 KOps/s 1.9166 KOps/s $\color{#35bf28}+0.05\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.3000ms 4.4726ms 223.5832 Ops/s 220.8924 Ops/s $\color{#35bf28}+1.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.3816ms 0.5463ms 1.8304 KOps/s 1.8371 KOps/s $\color{#d91a1a}-0.37\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7599ms 0.5104ms 1.9594 KOps/s 1.9957 KOps/s $\color{#d91a1a}-1.82\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.9249ms 4.6047ms 217.1701 Ops/s 214.4863 Ops/s $\color{#35bf28}+1.25\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.0358ms 0.6968ms 1.4352 KOps/s 1.4172 KOps/s $\color{#35bf28}+1.27\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9232ms 0.6664ms 1.5005 KOps/s 1.5161 KOps/s $\color{#d91a1a}-1.03\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.0732ms 4.2539ms 235.0807 Ops/s 244.6528 Ops/s $\color{#d91a1a}-3.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 7.8978ms 2.5204ms 396.7547 Ops/s 440.7648 Ops/s $\textbf{\color{#d91a1a}-9.98\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.5097ms 1.5056ms 664.2005 Ops/s 687.8302 Ops/s $\color{#d91a1a}-3.44\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.4507s 13.1435ms 76.0835 Ops/s 33.4960 Ops/s $\textbf{\color{#35bf28}+127.14\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.2345ms 2.4133ms 414.3774 Ops/s 389.7175 Ops/s $\textbf{\color{#35bf28}+6.33\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 4.4530ms 1.3724ms 728.6260 Ops/s 732.5247 Ops/s $\color{#d91a1a}-0.53\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 5.5989ms 4.4055ms 226.9914 Ops/s 218.3731 Ops/s $\color{#35bf28}+3.95\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.8574ms 2.5908ms 385.9803 Ops/s 370.1912 Ops/s $\color{#35bf28}+4.27\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.9305ms 1.5349ms 651.5062 Ops/s 585.7966 Ops/s $\textbf{\color{#35bf28}+11.22\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 13.2046ms 11.8747ms 84.2130 Ops/s 81.8380 Ops/s $\color{#35bf28}+2.90\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 15.4508ms 14.4886ms 69.0198 Ops/s 68.7930 Ops/s $\color{#35bf28}+0.33\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 22.3827ms 20.8286ms 48.0108 Ops/s 47.4101 Ops/s $\color{#35bf28}+1.27\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 15.8362ms 14.6850ms 68.0965 Ops/s 67.6138 Ops/s $\color{#35bf28}+0.71\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 22.3607ms 20.7656ms 48.1565 Ops/s 47.5546 Ops/s $\color{#35bf28}+1.27\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 18.4114ms 16.0047ms 62.4816 Ops/s 62.1844 Ops/s $\color{#35bf28}+0.48\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot