Difference between revisions of "MC analysis and IRF production"

From my_wiki
Jump to: navigation, search
Line 33: Line 33:
  
 
lstmcpipe: https://github.com/cta-observatory/lstmcpipe/
 
lstmcpipe: https://github.com/cta-observatory/lstmcpipe/
 +
 +
'''Since February 2022, and in particular for the AllSky production''' The list of productions can be found online, on lstmcpipe documentation:
 +
https://cta-observatory.github.io/lstmcpipe/productions.html
 +
  
 
=== lstmcpipe productions ===
 
=== lstmcpipe productions ===
Line 76: Line 80:
 
  |-
 
  |-
 
  |}
 
  |}
 
*Since February 2022, and in particular for the AllSky production* The list of productions can be found online, on lstmcpipe documentation:
 
https://cta-observatory.github.io/lstmcpipe/productions.html
 
 
  
  

Revision as of 14:30, 24 January 2023

Monte-Carlo analysis

The analysis of Monte-Carlo data is mostly done on the cluster in La Palma thanks to lstmcpipe (see below) and the results are accessible in /fefs/aswg/data/mc/

DL1 to IRF

DL1 MC production to use can be found under:

  • /fefs/aswg/data/mc/DL/prod/particle/

Replace particle with gamma, gamma_diffuse, proton or electron.

The dataset is already divided in training/testing for RF production and then IRF production.

Individual DL1 files are merged with parameters only.


RF models

The trained models to use for data analyse (MC or real data) can be found in /fefs/aswg/data/models/


--Thomas Vuillaume (talk) 16:23, 13 January 2020 (UTC)




lstmcpipe

lstmcpipe: https://github.com/cta-observatory/lstmcpipe/

Since February 2022, and in particular for the AllSky production The list of productions can be found online, on lstmcpipe documentation: https://cta-observatory.github.io/lstmcpipe/productions.html


lstmcpipe productions

You may request a new production through a lstmcpipe pull request: https://github.com/cta-observatory/lstmcpipe/#requesting-a-mc-analysis

lstmcpipe production source list
True source name Source ID in lstmcpipe Comments
RS Ophiuchi src1 https://github.com/cta-observatory/lstmcpipe/pull/185
Reprocess with lsthcain v0.9.9: https://github.com/cta-observatory/lstmcpipe/pull/370
LHAASO J2108+5157 src2 https://github.com/cta-observatory/lstmcpipe/pull/184
https://github.com/cta-observatory/lstmcpipe/pull/306
BL Lacertae src3 https://github.com/cta-observatory/lstmcpipe/pull/295
https://www.lst1.iac.es/wiki/index.php/All_sky_mc_bllac
G106.3+2.7 src4 Coming soon
PSR J2021+3651 src5 Coming soon


Older productions are either listed below or to be found directly on the cluster in /fefs/aswg/data/mc/...

Older productions

lschain-v0.6.3

  • MC Prod5, 80% nominal telescope transmission, zenith 40 deg.
- Cleaning 8-4, LocalPeakWindowSum integrator and no n_islands feature.

/fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/{particle}/zenith_40deg/south_pointing/20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4 /fefs/aswg/data/mc/DL2/20200629_prod5_trans_80/{particle}/zenith_40deg/south_pointing/20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4 /fefs/aswg/data/models/20200629_prod5_trans_80/zenith_40deg/south_pointing/20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4


  • MC Prod5 and with 80% nominal telescope transmission.
- Cleaning 10-5, LocalPeakWindowSum integrator and no n_islands feature.

/fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20210118_v0.6.3_prod5_local_tail_10_5_wo_n_islands /fefs/aswg/data/mc/DL2/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20210118_v0.6.3_prod5_local_tail_10_5_wo_n_islands /fefs/aswg/data/models/20200629_prod5_trans_80/zenith_20deg/south_pointing/20210118_v0.6.3_prod5_local_tail_10_5_wo_n_islands


  • MC Prod5 and with 80% nominal telescope transmission.
- Cleaning 6-3, LocalPeakWindowSum integrator and without n_islands feature.

/fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20201204_v0.6.3_prod5_trans_80_local_wo_n_islands/

/fefs/aswg/data/mc/DL2/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20201204_v0.6.3_prod5_trans_80_local_wo_n_islands/

/fefs/aswg/data/models/20200629_prod5_trans_80/zenith_20deg/south_pointing/20201204_v0.6.3_prod5_trans_80_local_wo_n_islands/


23 October 2020

MC Prod5 reduction with lstchain v0.6.3 standard configuration.

  • Cleaning 6-3, LocalPeakWindowSum integrator and without n_islands feature

/fefs/aswg/data/mc/DL1/20200629_prod5/***/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_local_wo_n_islands/

/fefs/aswg/data/mc/DL2/20200629_prod5/***/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_local_wo_n_islands/

/fefs/aswg/data/models/20200629_prod5/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_local_wo_n_islands/


  • Cleaning 8-4, LocalPeakWindowSum integrator and without n_islands feature

/fefs/aswg/data/mc/DL1/20200629_prod5/***/south_pointing/20201023_v0.6.3_prod5_tail_8_4_local_wo_n_islands/

/fefs/aswg/data/mc/DL2/20200629_prod5/***/south_pointing/20201023_v0.6.3_prod5_tail_8_4_local_wo_n_islands/

/fefs/aswg/data/models/20200629_prod5/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_tail_8_4_local_wo_n_islands/


17 October 2020

MC reduction with lstchain v0.6.3 standard configuration.

  • Cleaning 6-3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20201017_v0.6.3_prod3_local/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20201017_v0.6.3_prod3_local/

/fefs/aswg/data/models/20190415/south_pointing/20201017_v0.6.3_prod3_local/


05 October 2020

MC reduction with lstchain v0.6.1 standard configuration.

  • Cleaning 6-3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20201005_v0.6.1_local/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20201005_v0.6.1_local/

/fefs/aswg/data/models/20190415/south_pointing/20201005_v0.6.1_local/


06 June 2020

MC reduction with lstchain v0.5.2 with 2 standard config:

  • Cleaning 6-3, LocalPeakWindowSum integrator & *** `mc_image_scaling_factor` = 0.66 *** :

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200706_v0.5.2_local/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200706_v0.5.2_local/

/fefs/aswg/data/models/20190415/south_pointing/20200706_v0.5.2_local/


  • Cleaning 6-3, GlobalPeakWindowSum integrator & *** `mc_image_scaling_factor` = 0.66 *** :

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200705_v0.5.2_global/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200705_v0.5.2_global/

/fefs/aswg/data/models/20190415/south_pointing/20200705_v0.5.2_global/


28 May 2020

MC reduction with lstchain v0.5.1 with 3 standard configs:

  • Cleaning 6-3, NeighborPeakWindowSum integrator:

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200527_v0.5.1_neighbor/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200527_v0.5.1_neighbor/

/fefs/aswg/data/models/20190415/***/south_pointing/20200527_v0.5.1_neighbor/


  • Cleaning 6-3, GlobalPeakWindowSum integrator:

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200527_v0.5.1_global/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200527_v0.5.1_global/

/fefs/aswg/data/models/20190415/***/south_pointing/20200527_v0.5.1_global/


  • Cleaning 6-3, LocalPeakWindowSum integrator:

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200514_v0.5.1_v01/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200514_v0.5.1_v01/

/fefs/aswg/data/models/20190415/***/south_pointing/20200514_v0.5.1_v01


23 March 2020

MC reduction with lstchain v0.4.5 with 2 different configs:

  • No intercept

(standard config otherwise)

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200316_v0.4.5__EG1/

/fefs/aswg/data/models/20190415/south_pointing/20200316_v0.4.5__EG1/


  • No intercept, no time_gradient

(standard config otherwise)

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200316_v0.4.5__EG2/

/fefs/aswg/data/models/20190415/south_pointing/20200316_v0.4.5__EG2/


02 March 2020

New MC reduction with lstchain v0.4.4 with 3 different configs:

  • Standard config:

Cleaning 6-3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/gamma/south_pointing/20200229_v0.4.4_TV01/

/fefs/aswg/data/mc/DL2/20190415/gamma/south_pointing/20200229_v0.4.4_TV01/

/fefs/aswg/data/models/20190415/south_pointing/20200229_v0.4.4_TV01/


  • 10p cleaning config:

Cleaning 6.6-3.3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/gamma/south_pointing/20200301_v0.4.4_TV02/

/fefs/aswg/data/mc/DL2/20190415/gamma/south_pointing/20200301_v0.4.4_TV02/

/fefs/aswg/data/models/20190415/south_pointing/20200301_v0.4.4_TV02/


  • Neighbor config:

Cleaning 6-3, NeighborPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/gamma/south_pointing/20200301_v0.4.4_TV03/

/fefs/aswg/data/mc/DL2/20190415/gamma/south_pointing/20200301_v0.4.4_TV03/

/fefs/aswg/data/models/20190415/south_pointing/20200301_v0.4.4_TV03/


--Thomas Vuillaume (talk) 08:44, 2 March 2020 (UTC)