Difference between revisions of "MC analysis and IRF production"

From my_wiki
Jump to: navigation, search
(→‎lstmcpipe)
(→‎lstmcpipe productions)
 
(25 intermediate revisions by 11 users not shown)
Line 2: Line 2:
 
== Monte-Carlo analysis ==
 
== Monte-Carlo analysis ==
  
−
The analysis of Monte-Carlo data is mostly done on the cluster in La Palma and the results are accessible in <code> /fefs/aswg/data/mc/ </code>
+
The analysis of Monte-Carlo data is mostly done on the cluster in La Palma thanks to lstmcpipe (see below) and the results are accessible in <code> /fefs/aswg/data/mc/ </code>
  
−
=== DL1 ===
+
=== DL1 to IRF ===
  
 
DL1 MC production to use can be found under:
 
DL1 MC production to use can be found under:
  
−
* <code> /fefs/aswg/data/mc/DL1/20190415/particle/south_pointing/  </code>
+
* <code> /fefs/aswg/data/mc/DL/prod/particle/  </code>
  
 
Replace particle with gamma, gamma_diffuse, proton or electron.
 
Replace particle with gamma, gamma_diffuse, proton or electron.
−
 
  
 
The dataset is already divided in training/testing for RF production and then IRF production.
 
The dataset is already divided in training/testing for RF production and then IRF production.
  
 
Individual DL1 files are merged with parameters only.
 
Individual DL1 files are merged with parameters only.
−
 
−
 
−
=== DL2 ===
 
−
 
−
DL2 MC production to use can be found under:
 
−
 
−
* <code> /fefs/aswg/data/mc/DL2/20190415/particle/south_pointing/  </code>
 
−
 
−
Replace particle with gamma, gamma_diffuse, proton or electron.
 
−
 
−
DL2 files are produced from DL1 testing files and corresponding trained RF models.
 
  
  
Line 32: Line 20:
  
 
The trained models to use for data analyse (MC or real data) can be found in <code> /fefs/aswg/data/models/ </code>
 
The trained models to use for data analyse (MC or real data) can be found in <code> /fefs/aswg/data/models/ </code>
−
 
  
  
Line 46: Line 33:
  
 
lstmcpipe: https://github.com/cta-observatory/lstmcpipe/
 
lstmcpipe: https://github.com/cta-observatory/lstmcpipe/
 +
 +
'''Since February 2022, and in particular for the AllSky production''' The list of productions can be found online, on lstmcpipe documentation:
 +
https://cta-observatory.github.io/lstmcpipe/productions.html
 +
  
 
=== lstmcpipe productions ===
 
=== lstmcpipe productions ===
Line 63: Line 54:
 
  | RS Ophiuchi
 
  | RS Ophiuchi
 
  | src1
 
  | src1
−
  | https://github.com/cta-observatory/lstmcpipe/pull/185
+
  | https://github.com/cta-observatory/lstmcpipe/pull/185 <br/> Reprocess with lsthcain v0.9.9: https://github.com/cta-observatory/lstmcpipe/pull/370
 
  |-
 
  |-
  
Line 70: Line 61:
 
  | LHAASO J2108+5157
 
  | LHAASO J2108+5157
 
  | src2
 
  | src2
−
  | https://github.com/cta-observatory/lstmcpipe/pull/184
+
  | https://github.com/cta-observatory/lstmcpipe/pull/184 <br/> https://github.com/cta-observatory/lstmcpipe/pull/306
 
  |-
 
  |-
  
Line 76: Line 67:
 
  | BL Lacertae
 
  | BL Lacertae
 
  | src3
 
  | src3
−
  | https://github.com/cta-observatory/lstmcpipe/pull/293 <br/> https://www.lst1.iac.es/wiki/index.php/All_sky_mc_bllac  
+
  | v0.9.6 https://github.com/cta-observatory/lstmcpipe/pull/295 <br/> v0.10.4 https://github.com/cta-observatory/lstmcpipe/pull/422 <br/> https://www.lst1.iac.es/wiki/index.php/All_sky_mc_bllac  
 
  |-
 
  |-
 +
! scope="row" |
 +
| G106.3+2.7
 +
| src4
 +
| Coming soon
 +
|-
 +
! scope="row" |
 +
| PSR J2021+3651
 +
| src5
 +
| Coming soon
 +
|-
 +
! scope="row" |
 +
| Geminga
 +
| src6
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| SN 2023ixf
 +
| src7
 +
| Processed with lsthcain v0.9.13: https://github.com/cta-observatory/lstmcpipe/pull/408
 +
|-
 +
 +
! scope="row" |
 +
| GRB 221009A
 +
| src8
 +
| Processed with lsthcain v0.9.13: coming soon
 +
|-
 +
 +
! scope="row" |
 +
| Cygnus X North
 +
| src9
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| Perseus
 +
| src10
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| 1LHAASO_J0056+6346u
 +
| src11
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| G17.8+16.7
 +
| src12
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| NGC6611
 +
| src13
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| TCrb
 +
| src14
 +
| Coming soon
 +
|-
 +
 +
! scope="row" |
 +
| PKS2155-304
 +
| src15
 +
| Coming soon
 +
|-
 +
 +
|}
  
−
|}
 
  
−
== Productions ==
+
Older productions are either listed below or to be found directly on the cluster in <code> /fefs/aswg/data/mc/... </code>
  
 +
== Older productions ==
  
 
=== lschain-v0.6.3 ===
 
=== lschain-v0.6.3 ===

Latest revision as of 23:56, 2 October 2024

Monte-Carlo analysis[edit]

The analysis of Monte-Carlo data is mostly done on the cluster in La Palma thanks to lstmcpipe (see below) and the results are accessible in /fefs/aswg/data/mc/

DL1 to IRF[edit]

DL1 MC production to use can be found under:

  • /fefs/aswg/data/mc/DL/prod/particle/

Replace particle with gamma, gamma_diffuse, proton or electron.

The dataset is already divided in training/testing for RF production and then IRF production.

Individual DL1 files are merged with parameters only.


RF models[edit]

The trained models to use for data analyse (MC or real data) can be found in /fefs/aswg/data/models/


--Thomas Vuillaume (talk) 16:23, 13 January 2020 (UTC)



lstmcpipe[edit]

lstmcpipe: https://github.com/cta-observatory/lstmcpipe/

Since February 2022, and in particular for the AllSky production The list of productions can be found online, on lstmcpipe documentation: https://cta-observatory.github.io/lstmcpipe/productions.html


lstmcpipe productions[edit]

You may request a new production through a lstmcpipe pull request: https://github.com/cta-observatory/lstmcpipe/#requesting-a-mc-analysis

lstmcpipe production source list
True source name Source ID in lstmcpipe Comments
RS Ophiuchi src1 https://github.com/cta-observatory/lstmcpipe/pull/185
Reprocess with lsthcain v0.9.9: https://github.com/cta-observatory/lstmcpipe/pull/370
LHAASO J2108+5157 src2 https://github.com/cta-observatory/lstmcpipe/pull/184
https://github.com/cta-observatory/lstmcpipe/pull/306
BL Lacertae src3 v0.9.6 https://github.com/cta-observatory/lstmcpipe/pull/295
v0.10.4 https://github.com/cta-observatory/lstmcpipe/pull/422
https://www.lst1.iac.es/wiki/index.php/All_sky_mc_bllac
G106.3+2.7 src4 Coming soon
PSR J2021+3651 src5 Coming soon
Geminga src6 Coming soon
SN 2023ixf src7 Processed with lsthcain v0.9.13: https://github.com/cta-observatory/lstmcpipe/pull/408
GRB 221009A src8 Processed with lsthcain v0.9.13: coming soon
Cygnus X North src9 Coming soon
Perseus src10 Coming soon
1LHAASO_J0056+6346u src11 Coming soon
G17.8+16.7 src12 Coming soon
NGC6611 src13 Coming soon
TCrb src14 Coming soon
PKS2155-304 src15 Coming soon


Older productions are either listed below or to be found directly on the cluster in /fefs/aswg/data/mc/...

Older productions[edit]

lschain-v0.6.3[edit]

  • MC Prod5, 80% nominal telescope transmission, zenith 40 deg.
- Cleaning 8-4, LocalPeakWindowSum integrator and no n_islands feature.

/fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/{particle}/zenith_40deg/south_pointing/20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4 /fefs/aswg/data/mc/DL2/20200629_prod5_trans_80/{particle}/zenith_40deg/south_pointing/20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4 /fefs/aswg/data/models/20200629_prod5_trans_80/zenith_40deg/south_pointing/20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4


  • MC Prod5 and with 80% nominal telescope transmission.
- Cleaning 10-5, LocalPeakWindowSum integrator and no n_islands feature.

/fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20210118_v0.6.3_prod5_local_tail_10_5_wo_n_islands /fefs/aswg/data/mc/DL2/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20210118_v0.6.3_prod5_local_tail_10_5_wo_n_islands /fefs/aswg/data/models/20200629_prod5_trans_80/zenith_20deg/south_pointing/20210118_v0.6.3_prod5_local_tail_10_5_wo_n_islands


  • MC Prod5 and with 80% nominal telescope transmission.
- Cleaning 6-3, LocalPeakWindowSum integrator and without n_islands feature.

/fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20201204_v0.6.3_prod5_trans_80_local_wo_n_islands/

/fefs/aswg/data/mc/DL2/20200629_prod5_trans_80/{particle}/zenith_20deg/south_pointing/20201204_v0.6.3_prod5_trans_80_local_wo_n_islands/

/fefs/aswg/data/models/20200629_prod5_trans_80/zenith_20deg/south_pointing/20201204_v0.6.3_prod5_trans_80_local_wo_n_islands/


23 October 2020[edit]

MC Prod5 reduction with lstchain v0.6.3 standard configuration.

  • Cleaning 6-3, LocalPeakWindowSum integrator and without n_islands feature

/fefs/aswg/data/mc/DL1/20200629_prod5/***/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_local_wo_n_islands/

/fefs/aswg/data/mc/DL2/20200629_prod5/***/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_local_wo_n_islands/

/fefs/aswg/data/models/20200629_prod5/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_local_wo_n_islands/


  • Cleaning 8-4, LocalPeakWindowSum integrator and without n_islands feature

/fefs/aswg/data/mc/DL1/20200629_prod5/***/south_pointing/20201023_v0.6.3_prod5_tail_8_4_local_wo_n_islands/

/fefs/aswg/data/mc/DL2/20200629_prod5/***/south_pointing/20201023_v0.6.3_prod5_tail_8_4_local_wo_n_islands/

/fefs/aswg/data/models/20200629_prod5/zenith_20deg/south_pointing/20201023_v0.6.3_prod5_tail_8_4_local_wo_n_islands/


17 October 2020[edit]

MC reduction with lstchain v0.6.3 standard configuration.

  • Cleaning 6-3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20201017_v0.6.3_prod3_local/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20201017_v0.6.3_prod3_local/

/fefs/aswg/data/models/20190415/south_pointing/20201017_v0.6.3_prod3_local/


05 October 2020[edit]

MC reduction with lstchain v0.6.1 standard configuration.

  • Cleaning 6-3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20201005_v0.6.1_local/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20201005_v0.6.1_local/

/fefs/aswg/data/models/20190415/south_pointing/20201005_v0.6.1_local/


06 June 2020[edit]

MC reduction with lstchain v0.5.2 with 2 standard config:

  • Cleaning 6-3, LocalPeakWindowSum integrator & *** `mc_image_scaling_factor` = 0.66 *** :

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200706_v0.5.2_local/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200706_v0.5.2_local/

/fefs/aswg/data/models/20190415/south_pointing/20200706_v0.5.2_local/


  • Cleaning 6-3, GlobalPeakWindowSum integrator & *** `mc_image_scaling_factor` = 0.66 *** :

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200705_v0.5.2_global/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200705_v0.5.2_global/

/fefs/aswg/data/models/20190415/south_pointing/20200705_v0.5.2_global/


28 May 2020[edit]

MC reduction with lstchain v0.5.1 with 3 standard configs:

  • Cleaning 6-3, NeighborPeakWindowSum integrator:

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200527_v0.5.1_neighbor/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200527_v0.5.1_neighbor/

/fefs/aswg/data/models/20190415/***/south_pointing/20200527_v0.5.1_neighbor/


  • Cleaning 6-3, GlobalPeakWindowSum integrator:

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200527_v0.5.1_global/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200527_v0.5.1_global/

/fefs/aswg/data/models/20190415/***/south_pointing/20200527_v0.5.1_global/


  • Cleaning 6-3, LocalPeakWindowSum integrator:

/fefs/aswg/data/mc/DL1/20190415/***/south_pointing/20200514_v0.5.1_v01/

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200514_v0.5.1_v01/

/fefs/aswg/data/models/20190415/***/south_pointing/20200514_v0.5.1_v01


23 March 2020[edit]

MC reduction with lstchain v0.4.5 with 2 different configs:

  • No intercept

(standard config otherwise)

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200316_v0.4.5__EG1/

/fefs/aswg/data/models/20190415/south_pointing/20200316_v0.4.5__EG1/


  • No intercept, no time_gradient

(standard config otherwise)

/fefs/aswg/data/mc/DL2/20190415/***/south_pointing/20200316_v0.4.5__EG2/

/fefs/aswg/data/models/20190415/south_pointing/20200316_v0.4.5__EG2/


02 March 2020[edit]

New MC reduction with lstchain v0.4.4 with 3 different configs:

  • Standard config:

Cleaning 6-3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/gamma/south_pointing/20200229_v0.4.4_TV01/

/fefs/aswg/data/mc/DL2/20190415/gamma/south_pointing/20200229_v0.4.4_TV01/

/fefs/aswg/data/models/20190415/south_pointing/20200229_v0.4.4_TV01/


  • 10p cleaning config:

Cleaning 6.6-3.3, LocalPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/gamma/south_pointing/20200301_v0.4.4_TV02/

/fefs/aswg/data/mc/DL2/20190415/gamma/south_pointing/20200301_v0.4.4_TV02/

/fefs/aswg/data/models/20190415/south_pointing/20200301_v0.4.4_TV02/


  • Neighbor config:

Cleaning 6-3, NeighborPeakWindowSum integrator

/fefs/aswg/data/mc/DL1/20190415/gamma/south_pointing/20200301_v0.4.4_TV03/

/fefs/aswg/data/mc/DL2/20190415/gamma/south_pointing/20200301_v0.4.4_TV03/

/fefs/aswg/data/models/20190415/south_pointing/20200301_v0.4.4_TV03/


--Thomas Vuillaume (talk) 08:44, 2 March 2020 (UTC)

Retrieved from "https://www.lst1.iac.es/wiki/index.php?title=MC_analysis_and_IRF_production&oldid=11584"