Detect and report invalid workflow lists by iarspider · Pull Request #2547 · cms-sw/cms-bot

iarspider · 2025-08-12T08:14:55Z

Replaces #2507

cmsbuild · 2025-08-12T08:15:31Z

A new Pull Request was created by @iarspider for branch master.

@akritkbehera, @cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2025-08-12T08:15:32Z

cms-bot internal usage

smuzaffar · 2025-08-12T13:11:02Z

test parameters:

baseline = self
enable = nano,gpu,hlt_p2_timing,threading

smuzaffar · 2025-08-12T13:11:51Z

please test workflows invalidlist,1.0,2.0,3.0

cmsbuild · 2025-08-12T13:30:02Z

Pull request #2547 was updated.

smuzaffar · 2025-08-12T13:30:54Z

please test workflows invalidlist,1.0,2.0,3.0

cmsbuild · 2025-08-12T15:34:03Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488a66/47697/summary.html
COMMIT: 8e9cff8
CMSSW: CMSSW_15_1_X_2025-08-12-1100/el8_amd64_gcc12
Additional Tests: CUDA,HLT_P2_TIMING,NANO,ROCM,THREADING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2547/47697/install.sh to create a dev area with all the needed externals and cmssw changes.

Invalid workflow lists

The following workflow names were not recognized and not ran:

invalidlist

HLT P2 Timing: chart

Comparison Summary

Summary:

You potentially removed 3 lines from the logs
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 50
DQMHistoTests: Total histograms compared: 4076122
DQMHistoTests: Total failures: 82
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4076020
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
Checked 224 log files, 196 edm output root files, 50 DQM output files
TriggerResults: no differences found

CUDA Comparison Summary

Summary:

You potentially added 2 lines to the logs
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 53444
DQMHistoTests: Total failures: 8589
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 44855
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 24 log files, 30 edm output root files, 7 DQM output files
TriggerResults: no differences found

NANO Comparison Summary

Summary:

You potentially added 415 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 22
DQMHistoTests: Total histograms compared: 89100
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 89100
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 21 files compared)
Checked 138 log files, 82 edm output root files, 22 DQM output files
TriggerResults: no differences found

ROCM Comparison Summary

Summary:

You potentially removed 1 lines from the logs
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 53444
DQMHistoTests: Total failures: 9812
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 43632
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 24 log files, 30 edm output root files, 7 DQM output files
TriggerResults: no differences found

Nano size comparison Summary:

workflow	id	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
NANOmc106Xul16v2	2500.0001	3.085	3.085	0.000 ( +0.0% )	3.69	3.74	-1.4%	2.647	2.782
NANOmc106Xul17v2	2500.0002	3.144	3.144	0.000 ( +0.0% )	3.40	3.49	-2.3%	3.069	3.273
NANOmc106Xul18v2	2500.0003	3.097	3.097	0.000 ( +0.0% )	3.48	3.57	-2.5%	3.043	3.232
NANOdata106Xul16v2	2500.0101	1.539	1.539	0.000 ( +0.0% )	5.98	6.13	-2.5%	2.635	2.838
NANOdata106Xul17v2	2500.0102	1.925	1.925	0.000 ( +0.0% )	4.03	4.11	-2.1%	2.784	3.020
NANOdata106Xul18v2	2500.0103	1.890	1.890	0.000 ( +0.0% )	4.84	4.90	-1.2%	2.761	2.978
NANOmcUL16APVreMINI	2500.0201	0.022	0.022	0.000 ( +0.0% )	1.69	1.68	+0.7%	2.568	2.982
NANOmcUL16reMINI	2500.0202	0.022	0.022	0.000 ( +0.0% )	1.60	1.65	-2.9%	2.563	2.979
NANOmcUL17reMINI	2500.0203	0.022	0.022	0.000 ( +0.0% )	1.52	1.56	-2.2%	2.519	2.696
NANOmcUL18reMINI	2500.0204	0.022	0.022	0.000 ( +0.0% )	1.29	1.30	-1.0%	2.720	3.126
NANOdataUL16APVreMINI	2500.0301	0.035	0.035	0.000 ( +0.0% )	1.27	1.35	-5.7%	2.644	2.920
NANOdataUL16reMINI	2500.0302	0.036	0.036	0.000 ( +0.0% )	1.46	1.48	-1.5%	2.582	2.936
NANOdataUL17reMINI	2500.0303	0.037	0.037	0.000 ( +0.0% )	1.26	1.29	-2.8%	2.674	2.936
NANOdataUL18reMINI	2500.0304	0.036	0.036	0.000 ( +0.0% )	1.21	1.29	-6.3%	2.670	2.933
NANOmc130X	2500.1001	3.220	3.220	0.000 ( +0.0% )	4.19	4.31	-2.8%	3.030	3.239
NANOdata130Xrun3	2500.1101	1.799	1.799	0.000 ( +0.0% )	6.19	6.36	-2.6%	2.669	2.828
ScoutingNANOdata130Xrun3	2500.1301	0.771	0.771	0.000 ( +0.0% )	32.77	33.08	-0.9%	1.562	1.693
muPOGNANOmc140X	2500.2201	2.065	2.065	0.000 ( +0.0% )	5.39	5.51	-2.1%	2.149	2.361
EGMNANOmc140X	2500.2202	3.876	3.876	0.000 ( +0.0% )	3.86	3.91	-1.3%	2.440	2.729
BTVNANOmc140X	2500.2203	10.607	10.607	0.000 ( +0.0% )	2.47	2.53	-2.6%	2.633	2.956
jmeNANOmc140X	2500.2204	6.666	6.666	0.000 ( +0.0% )	1.11	1.13	-2.4%	2.447	2.791
lepTrackInfoNANOmc140X	2500.2206	3.570	3.570	0.000 ( +0.0% )	3.87	3.98	-2.9%	2.443	2.717
ScoutingNANOmc140X	2500.2207	1.486	1.486	0.000 ( +0.0% )	15.06	14.84	+1.5%	1.909	2.037
ScoutingNANOwithPromptmc140X	2500.2208	4.474	4.474	0.000 ( +0.0% )	3.27	3.37	-2.8%	2.651	2.941
muPOGNANO140Xrun3	2500.2301	1.469	1.469	0.000 ( +0.0% )	7.44	7.57	-1.8%	2.382	2.669
EGMNANOdata140Xrun3	2500.2302	2.623	2.623	0.000 ( +0.0% )	5.45	5.68	-3.9%	2.724	3.014
BTVNANOdata140Xrun3	2500.2303	5.612	5.612	0.000 ( +0.0% )	3.50	3.63	-3.6%	2.496	3.220
jmeNANOdata140Xrun3	2500.2304	3.976	3.976	0.000 ( +0.0% )	1.42	1.46	-2.4%	2.371	2.727
lepTrackInfoNANOdata140Xrun3	2500.2306	2.413	2.413	0.000 ( +0.0% )	5.42	5.66	-4.3%	2.311	3.008
ScoutingNANOdata140Xrun3	2500.2307	1.101	1.101	0.000 ( +0.0% )	28.82	29.12	-1.0%	1.366	1.676
ScoutingNANOwithPromptdata140Xrun3	2500.2308	2.783	2.783	0.000 ( +0.0% )	4.98	5.09	-2.1%	3.019	3.153
L1ScoutingNANOdata140Xrun3	2500.2309	0.082	0.082	0.000 ( +0.0% )	3.84	3.90	-1.3%	0.866	0.984
L1ScoutingSelectionNANOdata140Xrun3	2500.231	0.081	0.081	0.000 ( +0.0% )	37.17	40.20	-7.5%	0.717	0.868
l1DPGNANO140Xrun3	2500.2401	9.404	9.404	0.000 ( +0.0% )	6.74	7.38	-8.7%	1.787	1.931
muDPGNANO140Xrun3	2500.2402	10.331	10.331	0.000 ( +0.0% )	1.63	1.64	-0.8%	1.625	1.734
muDPGNANOBkg140Xrun3	2500.2403	2.712	2.712	0.000 ( +0.0% )	15.25	16.01	-4.8%	1.002	1.065
hcalDPGNANO140Xrun3	2500.2404	486.016	486.016	0.000 ( +0.0% )	1.13	1.14	-1.5%	1.585	1.724
hcalDPGCalibNANO140Xrun3	2500.2405	826.413	826.413	0.000 ( +0.0% )	1.51	1.53	-0.7%	1.578	1.711
hcalDPGMCNANO140Xrun3	2500.2501	645.333	645.333	0.000 ( +0.0% )	1.63	1.64	-0.6%	1.676	1.806
NANOmc2024reMINI	2500.2601	0.021	0.021	0.000 ( +0.0% )	1.45	1.50	-3.8%	2.719	3.153
NANOdata2024reMINI	2500.2701	0.036	0.036	0.000 ( +0.0% )	1.26	1.29	-2.2%	2.620	2.911
NANOmc150X	2500.3001	3.217	3.217	0.000 ( +0.0% )	17.58	17.81	-1.3%	2.578	2.773
NANOdata150X	2500.3101	2.144	2.144	0.000 ( +0.0% )	33.83	34.56	-2.1%	2.230	2.483
NANOdata150X	2500.3102	2.630	2.630	0.000 ( +0.0% )	22.95	23.72	-3.2%	2.254	2.584
muPOGNANOmc150X	2500.3201	2.255	2.255	0.000 ( +0.0% )	14.41	15.08	-4.4%	2.389	2.644
EGMNANOmc150X	2500.3202	4.111	4.111	0.000 ( +0.0% )	13.47	14.03	-4.0%	2.460	2.746
BTVNANOmc150X	2500.3203	10.552	10.552	0.000 ( +0.0% )	4.70	4.85	-3.1%	2.672	2.972
jmeNANOmc150X	2500.3204	6.760	6.760	0.000 ( +0.0% )	1.30	1.36	-3.9%	2.631	2.320
jmeNANOrePuppimc150X	2500.3205	6.763	6.763	0.000 ( +0.0% )	1.22	1.27	-3.5%	2.362	2.578
lepTrackInfoNANOmc150X	2500.3206	3.721	3.721	0.000 ( +0.0% )	14.38	14.74	-2.4%	2.460	2.743
ScoutingNANOmc150X	2500.3207	1.562	1.562	0.000 ( +0.0% )	18.66	18.81	-0.8%	2.362	2.529
ScoutingNANOwithPromptmc150X	2500.3208	4.774	4.774	0.000 ( +0.0% )	10.30	10.44	-1.3%	2.763	2.399
BPHNANOmc150X	2500.3209	4.109	4.109	0.000 ( +0.0% )	16.63	16.89	-1.5%	2.592	2.814
muPOGNANO150Xrun3	2500.3301	1.125	1.125	0.000 ( +0.0% )	23.84	24.80	-3.9%	2.107	2.401
EGMNANOdata150Xrun3	2500.3302	2.985	2.985	0.000 ( +0.0% )	21.16	22.56	-6.2%	2.169	2.490
BTVNANOdata150Xrun3	2500.3303	7.971	7.971	0.000 ( +0.0% )	5.61	5.86	-4.3%	2.356	2.417
jmeNANOdata150Xrun3	2500.3304	4.349	4.349	0.000 ( +0.0% )	1.60	1.66	-3.7%	2.027	2.357
jmeNANOrePuppidata150Xrun3	2500.3305	4.332	4.332	0.000 ( +0.0% )	1.39	1.43	-3.0%	2.285	2.704
lepTrackInfoNANOdata150Xrun3	2500.3306	2.625	2.625	0.000 ( +0.0% )	23.59	24.71	-4.5%	2.175	2.486
ScoutingNANOdata150Xrun3	2500.3307	1.737	1.737	0.000 ( +0.0% )	30.45	30.84	-1.3%	1.496	1.692
ScoutingNANOwithPromptdata150Xrun3	2500.3308	2.601	2.601	0.000 ( +0.0% )	16.91	17.26	-2.1%	2.480	2.807
BPHNANOdata150Xrun3	2500.3309	2.604	2.604	0.000 ( +0.0% )	32.23	32.49	-0.8%	2.212	2.535
TTbarMINIAOD10.6_UL18v2	2500.9001	1.819	1.819	0.000 ( +0.0% )	28.63	30.36	-5.7%	1.856	1.942
TTbarMINIAOD14.0	2500.9002	1.665	1.665	0.000 ( +0.0% )	28.61	27.16	+5.3%	1.520	1.578
DYToLL_M-50_13TeV_pythia8	2500.9101	14.345	14.345	0.000 ( +0.0% )	8.31	8.38	-0.9%	1.052	1.096
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV	2500.9102	0.310	0.171	0.139 ( +81.2% )	2.72	2.74	-0.8%	0.847	0.853
TTbar_Pow_LHE_13TeV	2500.9103	0.110	0.110	0.000 ( +0.0% )	2.63	2.64	-0.3%	0.828	0.854

cmsbuild · 2025-08-13T05:40:54Z

Pull request #2547 was updated.

cmsbuild · 2025-08-13T05:56:11Z

Pull request #2547 was updated.

smuzaffar · 2025-08-13T05:56:47Z

please test workflows invalidlist1,1.0,2.0,invalidlist2

smuzaffar · 2025-08-13T06:08:52Z

abort

smuzaffar · 2025-08-13T06:09:53Z

please test workflows invalidlist1,1.0,2.0,invalidlist2 for CMSSW_15_0_X

cmsbuild · 2025-08-13T08:20:24Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488a66/47710/summary.html
COMMIT: b199f4d
CMSSW: CMSSW_15_0_X_2025-08-12-2300/el8_amd64_gcc12
Additional Tests: CUDA,HLT_P2_TIMING,NANO,ROCM,THREADING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2547/47710/install.sh to create a dev area with all the needed externals and cmssw changes.

Invalid workflow lists: ${\color{red}\Huge{\textsf{invalidlist1,invalidlist2}}}$
HLT P2 Timing: chart

Comparison Summary

Summary:

You potentially added 4 lines to the logs
Reco comparison results: 3 differences found in the comparisons
DQMHistoTests: Total files compared: 50
DQMHistoTests: Total histograms compared: 4020902
DQMHistoTests: Total failures: 37
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4020845
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
Checked 224 log files, 197 edm output root files, 50 DQM output files
TriggerResults: no differences found

CUDA Comparison Summary

Summary:

You potentially added 31 lines to the logs
Reco comparison results: 69 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 53444
DQMHistoTests: Total failures: 6259
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 47185
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 24 log files, 30 edm output root files, 7 DQM output files
TriggerResults: found differences in 5 / 6 workflows

NANO Comparison Summary

Summary:

You potentially added 64 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 22
DQMHistoTests: Total histograms compared: 88860
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 88860
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 21 files compared)
Checked 134 log files, 80 edm output root files, 22 DQM output files
TriggerResults: no differences found

ROCM Comparison Summary

Summary:

You potentially removed 1 lines from the logs
Reco comparison results: 56 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 53444
DQMHistoTests: Total failures: 3707
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 49737
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 24 log files, 30 edm output root files, 7 DQM output files
TriggerResults: found differences in 1 / 6 workflows

Nano size comparison Summary:

Sample	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
2500.001_NANOmc106Xul16v2	3.085	3.085	0.000 ( +0.0% )	3.80	3.87	-1.8%	2.708	2.594
2500.002_NANOmc106Xul17v2	3.144	3.144	0.000 ( +0.0% )	3.56	3.64	-2.4%	3.169	3.018
2500.003_NANOmc106Xul18v2	3.097	3.097	0.000 ( +0.0% )	3.62	3.70	-2.2%	3.141	2.998
2500.011_NANOdata106Xul16v2	1.539	1.539	0.000 ( +0.0% )	6.32	6.30	+0.2%	2.721	2.647
2500.012_NANOdata106Xul17v2	1.925	1.925	0.000 ( +0.0% )	4.22	4.26	-0.9%	2.879	2.790
2500.013_NANOdata106Xul18v2	1.890	1.890	0.000 ( +0.0% )	4.99	5.06	-1.4%	2.771	2.726
2500.021_NANOmcUL16APVreMINI	0.022	0.022	0.000 ( +0.0% )	1.88	1.85	+1.9%	2.904	2.563
2500.022_NANOmcUL16reMINI	0.022	0.022	0.000 ( +0.0% )	1.82	1.78	+2.2%	2.905	2.554
2500.023_NANOmcUL17reMINI	0.022	0.022	0.000 ( +0.0% )	1.60	1.60	-0.1%	2.616	2.517
2500.024_NANOmcUL18reMINI	0.022	0.022	0.000 ( +0.0% )	1.41	1.43	-1.2%	2.753	2.686
2500.031_NANOdataUL16APVreMINI	0.035	0.035	0.000 ( +0.0% )	1.62	1.62	-0.3%	2.853	2.659
2500.032_NANOdataUL16reMINI	0.036	0.036	0.000 ( +0.0% )	1.63	1.63	-0.1%	2.850	2.584
2500.033_NANOdataUL17reMINI	0.037	0.037	0.000 ( +0.0% )	1.53	1.54	-0.4%	2.746	2.683
2500.034_NANOdataUL18reMINI	0.036	0.036	0.000 ( +0.0% )	1.53	1.56	-1.7%	2.760	2.674
2500.101_NANOmc130X	3.220	3.220	0.000 ( +0.0% )	4.36	4.43	-1.5%	3.075	2.937
2500.111_NANOdata130Xrun3	1.799	1.799	0.000 ( +0.0% )	6.40	6.59	-2.8%	2.813	2.690
2500.131_ScoutingNANOdata130Xrun3	0.771	0.771	0.000 ( +0.0% )	33.57	34.41	-2.4%	1.662	1.638
2500.221_muPOGNANOmc140X	2.065	2.065	0.000 ( +0.0% )	5.72	5.70	+0.3%	2.235	2.039
2500.222_EGMNANOmc140X	3.876	3.876	0.000 ( +0.0% )	4.10	4.10	+0.1%	2.593	2.337
2500.223_BTVNANOmc140X	10.607	10.607	0.000 ( +0.0% )	2.61	2.60	+0.2%	2.805	2.517
2500.224_jmeNANOmc140X	6.666	6.666	0.000 ( +0.0% )	1.15	1.17	-1.1%	2.494	2.400
2500.226_lepTrackInfoNANOmc140X	3.570	3.570	0.000 ( +0.0% )	4.11	4.10	+0.1%	2.595	2.334
2500.227_ScoutingNANOmc140X	1.486	1.486	0.000 ( +0.0% )	15.82	15.98	-1.0%	1.924	1.860
2500.228_ScoutingNANOwithPromptmc140X	4.474	4.474	0.000 ( +0.0% )	3.40	3.44	-1.0%	2.810	2.636
2500.231_muPOGNANO140Xrun3	1.469	1.469	0.000 ( +0.0% )	7.93	8.02	-1.1%	2.543	2.290
2500.232_EGMNANOdata140Xrun3	2.623	2.623	0.000 ( +0.0% )	5.84	5.87	-0.5%	2.594	2.646
2500.233_BTVNANOdata140Xrun3	5.612	5.612	0.000 ( +0.0% )	3.78	3.78	+0.1%	2.798	2.801
2500.234_jmeNANOdata140Xrun3	3.976	3.976	0.000 ( +0.0% )	1.46	1.51	-3.3%	2.351	2.328
2500.236_lepTrackInfoNANOdata140Xrun3	2.413	2.413	0.000 ( +0.0% )	5.88	5.91	-0.5%	2.570	2.610
2500.237_ScoutingNANOdata140Xrun3	1.101	1.101	0.000 ( +0.0% )	29.02	30.10	-3.6%	1.446	1.468
2500.238_ScoutingNANOwithPromptdata140Xrun3	2.783	2.783	0.000 ( +0.0% )	5.14	5.19	-0.9%	2.867	2.522
2500.241_l1DPGNANO140Xrun3	9.404	9.404	0.000 ( +0.0% )	7.25	6.90	+5.2%	1.927	1.845
2500.242_muDPGNANO140Xrun3	10.331	10.331	0.000 ( +0.0% )	1.68	1.69	-0.5%	1.721	1.707
2500.243_muDPGNANOBkg140Xrun3	2.712	2.712	0.000 ( +0.0% )	15.96	16.08	-0.7%	1.059	1.022
2500.244_hcalDPGNANO140Xrun3	486.016	486.016	0.000 ( +0.0% )	1.14	1.15	-0.6%	1.690	1.603
2500.245_hcalDPGCalibNANO140Xrun3	826.413	826.413	0.000 ( +0.0% )	1.52	1.53	-0.6%	1.740	1.559
2500.251_hcalDPGMCNANO140Xrun3	645.333	645.333	0.000 ( +0.0% )	1.66	1.66	-0.5%	1.774	1.137
2500.261_NANOmc2024reMINI	0.021	0.021	0.000 ( +0.0% )	1.61	1.64	-2.1%	3.075	2.701
2500.271_NANOdata2024reMINI	0.036	0.036	0.000 ( +0.0% )	1.64	1.68	-2.0%	2.873	2.638
2500.301_NANOmc150X	3.217	3.217	0.000 ( +0.0% )	18.28	18.63	-1.9%	2.709	2.534
2500.311_NANOdata150X	2.144	2.144	0.000 ( +0.0% )	35.72	37.13	-3.8%	2.436	2.203
2500.312_NANOdata150X	2.630	2.630	0.000 ( +0.0% )	28.09	27.88	+0.7%	2.246	1.951
2500.321_muPOGNANOmc150X	2.255	2.255	0.000 ( +0.0% )	16.75	16.84	-0.5%	2.587	2.338
2500.322_EGMNANOmc150X	4.111	4.111	0.000 ( +0.0% )	15.24	15.34	-0.7%	2.700	2.415
2500.323_BTVNANOmc150X	10.552	10.552	0.000 ( +0.0% )	5.00	5.07	-1.3%	2.913	2.632
2500.324_jmeNANOmc150X	6.760	6.760	0.000 ( +0.0% )	1.37	1.39	-1.1%	2.822	2.591
2500.325_jmeNANOrePuppimc150X	6.763	6.763	0.000 ( +0.0% )	1.29	1.32	-2.3%	3.152	2.925
2500.326_lepTrackInfoNANOmc150X	3.721	3.721	0.000 ( +0.0% )	15.81	16.20	-2.4%	2.682	2.486
2500.327_ScoutingNANOmc150X	1.562	1.562	0.000 ( +0.0% )	19.49	19.64	-0.8%	2.457	2.328
2500.328_ScoutingNANOwithPromptmc150X	4.774	4.774	0.000 ( +0.0% )	10.73	10.77	-0.4%	2.851	2.689
2500.329_BPHNANOmc150X	4.109	4.109	0.000 ( +0.0% )	17.32	17.69	-2.1%	2.529	2.537
2500.331_muPOGNANO150Xrun3	1.125	1.125	0.000 ( +0.0% )	31.20	31.23	-0.1%	2.359	2.065
2500.332_EGMNANOdata150Xrun3	2.985	2.985	0.000 ( +0.0% )	26.20	26.57	-1.4%	2.438	2.135
2500.333_BTVNANOdata150Xrun3	7.971	7.971	0.000 ( +0.0% )	6.10	6.07	+0.5%	2.629	2.315
2500.334_jmeNANOdata150Xrun3	4.349	4.349	0.000 ( +0.0% )	1.69	1.70	-0.3%	2.592	2.332
2500.335_jmeNANOrePuppidata150Xrun3	4.332	4.332	0.000 ( +0.0% )	1.45	1.46	-1.1%	2.864	2.571
2500.336_lepTrackInfoNANOdata150Xrun3	2.625	2.625	0.000 ( +0.0% )	28.03	28.75	-2.5%	2.242	2.104
2500.337_ScoutingNANOdata150Xrun3	1.737	1.737	0.000 ( +0.0% )	31.57	32.03	-1.5%	1.658	1.488
2500.338_ScoutingNANOwithPromptdata150Xrun3	2.601	2.601	0.000 ( +0.0% )	18.00	18.39	-2.1%	2.528	2.473
2500.339_BPHNANOdata150Xrun3	2.604	2.604	0.000 ( +0.0% )	35.44	36.22	-2.1%	2.481	2.337
2500.901_TTbarMINIAOD10.6_UL18v2	1.819	1.819	0.000 ( +0.0% )	33.99	34.06	-0.2%	1.876	1.838
2500.902_TTbarMINIAOD14.0	1.665	1.665	0.000 ( +0.0% )	33.11	33.11	-0.0%	1.458	1.382
2500.911_DYToLL_M-50_13TeV_pythia8	14.345	14.345	0.000 ( +0.0% )	8.36	7.46	+12.1%	1.092	1.094
2500.912_DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV	0.171	0.150	0.020 ( +13.6% )	2.73	2.13	+27.8%	0.849	0.848
2500.913_TTbar_Pow_LHE_13TeV	0.110	0.110	0.000 ( +0.0% )	2.71	2.73	-1.0%	0.850	0.848

iarspider · 2025-08-13T09:43:36Z

hold
So that I don't forget to remove https://github.com/cms-sw/cms-bot/pull/2547/files#diff-5e02a17340b02f75de80cf0d3a45e66970f1884b0a5cdf726ef1223846c95af3R355 or devise a better method of passing CMS_BOT_BRANCH to baseline jobs

cmsbuild · 2025-08-13T09:44:05Z

Pull request has been put on hold by @iarspider
They need to issue an unhold command to remove the hold state or L1 can unhold it for all

smuzaffar · 2025-08-13T10:36:30Z

unhold

this is now ready to go in

smuzaffar · 2025-08-13T10:36:35Z

+externals

cmsbuild · 2025-08-13T10:36:48Z

Pull request #2547 was updated.

smuzaffar · 2025-08-13T10:38:26Z

@iarspider , please unhold it. This can go in now. I will squash/merge these once unhold

iarspider · 2025-08-13T10:39:05Z

unhold

cmsbuild · 2025-08-13T10:39:40Z

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

Detect and report invalid workflow lists

d1baf7b

iarspider requested a review from smuzaffar August 12, 2025 08:15

cmsbuild added orp-pending pending-signatures externals-pending tests-pending labels Aug 12, 2025

cmsbuild added tests-started and removed tests-pending labels Aug 12, 2025

Update _helper_functions.sh

8e9cff8

cmsbuild added tests-pending and removed tests-started labels Aug 12, 2025

cmsbuild added tests-started and removed tests-pending labels Aug 12, 2025

smuzaffar mentioned this pull request Aug 12, 2025

Detect and report invalid predefined lists #2507

Closed

cmsbuild added tests-approved and removed tests-started labels Aug 12, 2025

avoid running runtheMatrix twice to get wf nums

2213351

cmsbuild added tests-pending and removed tests-approved labels Aug 13, 2025

invalid wf list msg format match the rest

20c60a3

cmsbuild added tests-started and removed tests-pending labels Aug 13, 2025

cmsbuild added tests-pending and removed tests-started labels Aug 13, 2025

cmsbuild added tests-started and removed tests-pending labels Aug 13, 2025

cmsbuild added tests-approved and removed tests-started labels Aug 13, 2025

cmsbuild added the hold label Aug 13, 2025

fix bad relvals message; remove CMS_BOT_BRANCH for baseline

6e8f898

cmsbuild added tests-pending externals-approved and removed tests-approved externals-pending labels Aug 13, 2025

cmsbuild added fully-signed and removed pending-signatures hold labels Aug 13, 2025

smuzaffar merged commit 76ddf36 into master Aug 13, 2025
2 of 3 checks passed

iarspider deleted the run-ib-pr-matrix-list-2 branch August 13, 2025 12:04

Conversation

iarspider commented Aug 12, 2025

Uh oh!

cmsbuild commented Aug 12, 2025

Uh oh!

cmsbuild commented Aug 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented Aug 12, 2025

Uh oh!

smuzaffar commented Aug 12, 2025

Uh oh!

cmsbuild commented Aug 12, 2025

Uh oh!

smuzaffar commented Aug 12, 2025

Uh oh!

cmsbuild commented Aug 12, 2025

Invalid workflow lists

Comparison Summary

CUDA Comparison Summary

NANO Comparison Summary

ROCM Comparison Summary

Uh oh!

cmsbuild commented Aug 13, 2025

Uh oh!

cmsbuild commented Aug 13, 2025

Uh oh!

smuzaffar commented Aug 13, 2025

Uh oh!

smuzaffar commented Aug 13, 2025

Uh oh!

smuzaffar commented Aug 13, 2025

Uh oh!

cmsbuild commented Aug 13, 2025 • edited by smuzaffar Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Comparison Summary

CUDA Comparison Summary

NANO Comparison Summary

ROCM Comparison Summary

Uh oh!

iarspider commented Aug 13, 2025

Uh oh!

cmsbuild commented Aug 13, 2025

Uh oh!

smuzaffar commented Aug 13, 2025

Uh oh!

smuzaffar commented Aug 13, 2025

Uh oh!

cmsbuild commented Aug 13, 2025

Uh oh!

smuzaffar commented Aug 13, 2025

Uh oh!

iarspider commented Aug 13, 2025

Uh oh!

cmsbuild commented Aug 13, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cmsbuild commented Aug 12, 2025 •

edited

Loading

cmsbuild commented Aug 13, 2025 •

edited by smuzaffar

Loading