CMS: CMSSW versions & GT for pPb and pp ref data & MC

[katilp]

From #129

Finding the information

CMSSW version:

Identifying the version to be used in the analysis:

• In https://github.com/CmsHI/cmssw check branches for "forest":

  

Question: would it make sense to provide a container with the CmsHI fork on top of a CMSSW version?

GT:

Look at the HIForest production configs (pPb, pp, PbPb, MC or DATA) in the respective branches under

• https://github.com/CmsHI/cmssw/tree/forest_CMSSW_5_3_20/HeavyIonsAnalysis/JetAnalysis/test
• https://github.com/CmsHI/cmssw/tree/forest_CMSSW_7_5_8_patch3/HeavyIonsAnalysis/JetAnalysis/test

2013 pPb 5.02 TeV data

(datasets see #136)

CMSSW for RECO production:

• Prompt: cmsdas gives 5 versions (?):

  CMSSW_5_3_8
  CMSSW_5_3_8_HI
  CMSSW_5_3_8_HI_patch2
  CMSSW_5_3_8_patch1
  CMSSW_5_3_8_patch2
  

• Rereco: cmsdas: CMSSW_5_3_8_HI_patch2

CMSSW for HIForest:

• CMSSW_5_3_20 (https://github.com/CmsHI/cmssw/tree/forest_CMSSW_5_3_20)

GT

• taken from JetAnalyzer as the JEC were not from the standard GT

• https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/JetAnalysis/test/runForest_pPb_DATA_53X.py#L63 shows GR_P_V43D::All with centrality and jec tags overidden

  from Configuration.AlCa.GlobalTag import GlobalTag
  process.GlobalTag = GlobalTag(process.GlobalTag, 'GR_P_V43D::All', '')
  
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideCentrality
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideJEC_pPb5020
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideJEC_Pbp5020
  overrideCentrality(process)
  if secondHalfpPbJEC:
      overrideJEC_Pbp5020(process)
  else :
      overrideJEC_pPb5020(process)
  

• Find overrides in

  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L525
  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L54

• Question: why such an old GT (43) for data processed with 53?

• Question: these are the modifications for JetAnalysis. For other objects under https://github.com/CmsHI/cmssw/tree/forest_CMSSW_5_3_20/HeavyIonsAnalysis (Photon, Muon) are there similar things to take into account?

2013 pp 2.76 TeV ref

(datasets see #140)

CMSSW for RECO production:

• Prompt: cmsdas: CMSSW_5_3_8_patch3
• Skims: cmsdas: CMSSW_5_3_8_patch3

CMSSW for HIForest

• CMSSW_5_3_20 (https://github.com/CmsHI/cmssw/tree/forest_CMSSW_5_3_20)

GT

• From https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/JetAnalysis/test/runForest_pp_DATA_53X.py#L61 GR_P_V43D::All

  from Configuration.AlCa.GlobalTag import GlobalTag
  process.GlobalTag = GlobalTag(process.GlobalTag, 'GR_P_V43D::All', '')
  
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import *
  overrideGT_pp2760(process)
  overrideJEC_pp2760(process)
  

• with overrides in

  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L1148

    def overrideGT_pp2760(process):
        overrideCentrality(process)
        overrideJEC_pp2760(process)
        return process
    

  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L54

  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L752

2015 pp 5.02 TeV ref

(datasets see #139)

CMSSW for RECO production:

• Prompt: cmsdas: shows two CMSSW_7_5_5_patch3, CMSSW_7_5_5_patch4

CMSSW for HIForest

• CMSSW_7_5_8_patch3 (https://github.com/CmsHI/cmssw/tree/forest_CMSSW_7_5_8_patch3)
  • Question: Why? Because the latest in this series of branches?

GT

• From https://github.com/CmsHI/cmssw/blob/forest_CMSSW_7_5_8_patch3/HeavyIonsAnalysis/JetAnalysis/test/runForestAOD_pp_DATA_75X.py#L49: 75X_dataRun2_v13

  from Configuration.AlCa.GlobalTag_condDBv2 import GlobalTag
  process.GlobalTag = GlobalTag(process.GlobalTag, 'auto:run2_data', '')
  process.HiForest.GlobalTagLabel = process.GlobalTag.globaltag
  
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideJEC_pp5020
  process = overrideJEC_pp5020(process)
  

• Find auto:run2_data (through from Configuration.AlCa.autoCond import * in GlobalTag_condDBv2) in https://github.com/cms-sw/cmssw/blob/CMSSW_7_5_8_patch3/Configuration/AlCa/python/autoCond.py#L23: 75X_dataRun2_v13

• Find what overrides in https://github.com/CmsHI/cmssw/blob/forest_CMSSW_7_5_8_patch3/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L752

HI MC

(datasets in #138 including 2.76TeV PbPb and 5.02TeV pPb)

CMSSW for GEN-SIM-RECO production

• ranging from CMSSW_5_3_8_patch3 to CMSSW_5_3_27

CMSSW for HIForest

• CMSSW_5_3_20 (https://github.com/CmsHI/cmssw/tree/forest_CMSSW_5_3_20)
• Question: even if production used a higher base CMSSW version?

GT

• PbPb: https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/JetAnalysis/test/runForest_PbPb_MC_53X.py#L55 STARTHI53_LV1::All

  from Configuration.AlCa.GlobalTag import GlobalTag
  process.GlobalTag = GlobalTag(process.GlobalTag, 'STARTHI53_LV1::All', '')
  
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import *
  overrideGT_PbPb2760(process)
  

  • with override in https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L1153

  def overrideGT_PbPb2760(process):
      overrideCentrality(process)
      overrideJEC_PbPb2760(process)
      return process
  

  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L54

  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L184

  • NB that the directory contains a db file STARTHI53_LV1.db

• pPb:
  https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/JetAnalysis/test/runForest_pPb_MC_53X.py#L63 STARTHI53_V27::All

  from Configuration.AlCa.GlobalTag import GlobalTag
  process.GlobalTag = GlobalTag(process.GlobalTag, 'STARTHI53_V27::All', '')
  
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideCentrality
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideJEC_pPb5020
  from HeavyIonsAnalysis.Configuration.CommonFunctions_cff import overrideJEC_Pbp5020
  overrideCentrality(process)
  if secondHalfpPbJEC:
      overrideJEC_MC_Pbp5020(process)
      #overrideJEC_Pbp5020(process)
  else :
      overrideJEC_pPb5020(process)
  

  • with override in https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L184
  • https://github.com/CmsHI/cmssw/blob/forest_CMSSW_5_3_20/HeavyIonsAnalysis/Configuration/python/CommonFunctions_cff.py#L54

[katilp]

Check the difference between STARTHI_V27 and STARTHI_V28

• On lxplus, go to slc6 singularity with cmssw-el6
• Create or use existing CMSSW area, e.g. CMSSW_5_3_32/src, exact version does not matter
• Get the condition db listings with:

  cmscond_tagtree_list -c frontier://FrontierProd/CMS_COND_31X_GLOBALTAG -T STARTHI53_V27 > STARTHI53_V27.list
  cmscond_tagtree_list -c frontier://FrontierProd/CMS_COND_31X_GLOBALTAG -T STARTHI53_V28 > STARTHI53_V28.list
  

• The dbs are in a different order, so sort them and compare with:

  $ diff <(sort STARTHI53_V27.list) <(sort STARTHI53_V28.list)
  5c5
  <    leafnode:BeamSpotObjects   parent:Calibration   tag:RealisticHICollisions2013_START53_V9_v1_mc record:BeamSpotObjectsRcd object:BeamSpotObjects label:None pfn:frontier://FrontierProd/CMS_COND_31X_BEAMSPOT
  ---
  >    leafnode:BeamSpotObjects   parent:Calibration   tag:Realistic2p76TeVCollisions2013_START53_V9_v1_mc record:BeamSpotObjectsRcd object:BeamSpotObjects label:None pfn:frontier://FrontierProd/CMS_COND_31X_BEAMSPOT
  

So the difference is in the beamspot.

Checking the actual values from the text dump:

sqlite3 RealisticHICollisions2013_START53_V9_v1_mc.db .dump > RealisticHICollisions2013_START53_V9_v1_mc.txt
sqlite3 Realistic2p76TeVCollisions2013_START53_V9_v1_mc.db .dump > Realistic2p76TeVCollisions2013_START53_V9_v1_mc.txt

$ diff RealisticHICollisions2013_START53_V9_v1_mc.txt Realistic2p76TeVCollisions2013_START53_V9_v1_mc.txt
[...]
83c83
< INSERT INTO "ORA_C_BEAMSPOTOBJECTS" VALUES(0,0.0050005,0.0,0.00499228,0.0,0.0,-2.8373e-06,9.11533e-06,0.0,0.0,0.243801,0.392822,0.462779,8.90928,2);
---
> INSERT INTO "ORA_C_BEAMSPOTOBJECTS" VALUES(0,0.00959171,0.0,0.00955925,0.0,0.0,-9.59487e-06,-9.86836e-06,0.0,0.0,0.244065,0.392906,0.42742,7.91168,2);
85,91c85,91
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,0,3.4736e-09,1.47792e-11,0.0,0.0,0.0,0.0,0.0);
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,1,1.47792e-11,3.48422e-09,0.0,0.0,0.0,0.0,0.0);
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,2,0.0,0.0,0.0119739,0.0,0.0,0.0,0.0);
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,3,0.0,0.0,0.0,0.00598691,0.0,0.0,0.0);
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,4,0.0,0.0,0.0,0.0,4.40224e-11,3.4355e-13,0.0);
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,5,0.0,0.0,0.0,0.0,3.4355e-13,4.35842e-11,0.0);
< INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,6,0.0,0.0,0.0,0.0,0.0,0.0,3.1986e-09);
---
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,0,3.80569e-09,6.77499e-12,0.0,0.0,0.0,0.0,0.0);
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,1,6.77499e-12,3.78769e-09,0.0,0.0,0.0,0.0,0.0);
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,2,0.0,0.0,0.00242419,0.0,0.0,0.0,0.0);
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,3,0.0,0.0,0.0,0.00121209,0.0,0.0,0.0);
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,4,0.0,0.0,0.0,0.0,6.45014e-11,-7.03752e-14,0.0);
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,5,0.0,0.0,0.0,0.0,-7.03752e-14,6.44679e-11,0.0);
> INSERT INTO "ORA_C_BEAMSPOTOBJE_A0" VALUES(0,6,0.0,0.0,0.0,0.0,0.0,0.0,3.8004e-09);

[katilp]

From the discussion on June 6, 2023:

• V27 and V28 correspond to 2.76 and 5.02 TeV, take both
• in general, always keep to the GT of the production unless otherwise stated

For differences btw V25/V27 and V26/V28 see https://twiki.cern.ch/twiki/bin/view/CMSPublic/SWGuideFrontierConditions?rev=609#HI_Simulation_AN4

Check the actual difference (instructions)

Singularity> diff <(sort STARTHI53_V27.list) <(sort STARTHI53_V25.list)
209c209
<    leafnode:L1MuCSCTFConfiguration   parent:Calibration   tag:L1MuCSCTFConfiguration_10412_mc record:L1MuCSCTFConfigurationRcd object:L1MuCSCTFConfiguration label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
---
>    leafnode:L1MuCSCTFConfiguration   parent:Calibration   tag:L1MuCSCTFConfiguration_90511_mc record:L1MuCSCTFConfigurationRcd object:L1MuCSCTFConfiguration label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
218c218
<    leafnode:L1MuGMTParameters   parent:Calibration   tag:L1MuGMTParameters_gmt2012_0_EarlyRPC_mc record:L1MuGMTParametersRcd object:L1MuGMTParameters label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
---
>    leafnode:L1MuGMTParameters   parent:Calibration   tag:L1MuGMTParameters_synctf_11_EarlyRPC_mc record:L1MuGMTParametersRcd object:L1MuGMTParameters label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
Singularity> diff <(sort STARTHI53_V28.list) <(sort STARTHI53_V26.list)
209c209
<    leafnode:L1MuCSCTFConfiguration   parent:Calibration   tag:L1MuCSCTFConfiguration_10412_mc record:L1MuCSCTFConfigurationRcd object:L1MuCSCTFConfiguration label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
---
>    leafnode:L1MuCSCTFConfiguration   parent:Calibration   tag:L1MuCSCTFConfiguration_90511_mc record:L1MuCSCTFConfigurationRcd object:L1MuCSCTFConfiguration label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
218c218
<    leafnode:L1MuGMTParameters   parent:Calibration   tag:L1MuGMTParameters_gmt2012_0_EarlyRPC_mc record:L1MuGMTParametersRcd object:L1MuGMTParameters label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T
---
>    leafnode:L1MuGMTParameters   parent:Calibration   tag:L1MuGMTParameters_synctf_11_EarlyRPC_mc record:L1MuGMTParametersRcd object:L1MuGMTParameters label:None pfn:frontier://FrontierProd/CMS_COND_31X_L1T