Difference between revisions of "GRB221009A src-ind analysis dark conditions"

From my_wiki
Jump to: navigation, search
Line 8: Line 8:
  
 
* Analysis by A. Aguasca-Cabot (Universitat de Barcelona - arnau.aguasca@fqa.ub.edu)
 
* Analysis by A. Aguasca-Cabot (Universitat de Barcelona - arnau.aguasca@fqa.ub.edu)
−
 
  
  
Line 32: Line 31:
 
** Particle types: The standard ones for the AllSky MC production.
 
** Particle types: The standard ones for the AllSky MC production.
 
** DEC Band (deg): dec_2276
 
** DEC Band (deg): dec_2276
 +
 +
The MC production for the Crab is used because the NSB tuning parameters at the DL1 level are very similar between them:
 +
 +
<div><ul>
 +
<li style="display: inline-block;"> [[File:gammas9672-DL1NSB-log.png|thumb|none|350px|Pixel charge distribution for real cosmics (blue, run 9672), standard MC gammas (orange), tuned MC gammas to Crab (green) and to GRB221009A (red) using the DL1 NSB parameters. Plot with y-axis in log scale.]] </li>
 +
</ul></div>
 +
 +
DL1 parameters obtained from GRB221009A runs (the NSB tuning parameters for the Crab can be found in the following subsection):
 +
 +
Runs: 9672, 9802, 9862 and 9890
 +
{
 +
    "number_of_files_used": 46,
 +
    "std": [
 +
    0.181,
 +
    0.077,
 +
    0.209
 +
]
 +
}{
 +
    "increase_nsb": true,
 +
    "extra_noise_in_dim_pixels": 1.782,
 +
    "extra_bias_in_dim_pixels": 0.601,
 +
    "transition_charge": 8,
 +
    "extra_noise_in_bright_pixels": 2.25
 +
}
  
 
==DL1 data==
 
==DL1 data==
Line 49: Line 72:
 
* lstMCpipe-v0.9.0
 
* lstMCpipe-v0.9.0
 
* lstchain v0.9.9
 
* lstchain v0.9.9
−
* MC: tailcut8-4 (with cleaning based on pedestal RMS), dynamic cleaning, NSB tuning
+
* MC: tailcut8-4, dynamic cleaning, NSB tuning
 
     "image_modifier": {
 
     "image_modifier": {
 
         "increase_nsb": true,
 
         "increase_nsb": true,
Line 61: Line 84:
  
 
: Config file: https://github.com/cta-observatory/lstmcpipe/blob/master/production_configs/20221027_v0.9.9_crab_tuned/lstchain_config_2022-10-27.json
 
: Config file: https://github.com/cta-observatory/lstmcpipe/blob/master/production_configs/20221027_v0.9.9_crab_tuned/lstchain_config_2022-10-27.json
−
 
  
 
==Random forest==
 
==Random forest==
Line 75: Line 97:
  
 
==DL2 data==
 
==DL2 data==
−
 
−
Information about your DL2 data and settings such as: specifc versions of lstchain, specfic .json version used.
 
  
 
* lstchain-v0.9.9
 
* lstchain-v0.9.9
  
 
* source-indep
 
* source-indep
−
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcindep/DL2/data/
+
  /fefs/aswg/data/mc/DL2/AllSky/20221027_v0.9.9_crab_tuned/TestingDataset/dec_2276/node_theta_*
−
  /fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcindep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
+
  /fefs/aswg/workspace/arnau.aguasca/Analysis/results/real/DL2/202210*/srcind/v0.9.9/tailcut84_dynclg_tNSBtoCrabPerfPaper/AllSky_20221027_v0.9.9_crab_tuned_dec_2276/dl2_*
  
−
==DL3 data selection==
+
* config file
 +
  /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json
  
−
Information about your DL3 data selection.  
+
==DL2 data selection to produce theta2 plots==
 +
 
 +
Information about the quality cuts to produce the theta2 plots.  
  
 
'''Example'''
 
'''Example'''
 
*intensity > 50
 
*intensity > 50
 
*r: [0,  1 ]
 
*r: [0,  1 ]
−
*wl: [0.1, 1 ]
+
*wl: [0.01, 1 ]
 
*leakage_intensity_width_2: [0, 0.2 ]
 
*leakage_intensity_width_2: [0, 0.2 ]
 +
*event_type: [32, 32]
  
 
* source-indep
 
* source-indep
−
**fixed_gh_cut: 0.3
+
**fixed_gh_cut: 0.7 (standard cut)
−
**fixed_theta_cut: 0.2
+
**fixed_theta_cut: 0.2 (standard cut)
 +
 
 +
 
 +
==Crab check==
 +
 
  
−
* source-dep
 
−
**fixed_gh_cut: 0.7
 
−
**fixed_alpha_cut: 10
 
  
  
Line 108: Line 133:
  
 
==Monte Carlo information==
 
==Monte Carlo information==
−
* Link to MC files used: /fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/*
+
* Link to MC files used: /fefs/aswg/data/mc/DL1/AllSky/20221215_v0.9.12_base_prod/*
 
** Particle types: The standard ones for the AllSky MC production.
 
** Particle types: The standard ones for the AllSky MC production.
 
** DEC Band (deg): dec_2276
 
** DEC Band (deg): dec_2276
Line 114: Line 139:
 
==DL1 data==
 
==DL1 data==
  
−
Reprocessed using DL1a files produced by LSTOSA (lstchain v0.7.3) and dl1ab script (v0.7.5)
+
No reprocessing of the real DL1a data was required, only NSB tuning was added to the MC files. DL1a files produced by LSTOSA (lstchain v0.9.6?) and lstMCpipe (lstMCpipe v0.9.0 using lstchain v0.9.9).
  
 
* original DL1a files
 
* original DL1a files
  
−
  /fefs/aswg/data/real/DL1/20210808/v0.7.3/tailcut84/dl1_LST-1.Run0XXXX.XXXX.h5
+
  /fefs/aswg/data/real/DL1/20221010/v0.9/tailcut84/dl1_LST-1.Run0XXXX.XXXX.h5
−
  /fefs/aswg/data/mc/DL1/20200629_prod5_trans_80/XXX/zenith_20deg/south_pointing/20210416_v0.7.3_prod5_trans_80_local_taicut_8_4/
+
  /fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/
  
−
* lstchain v0.7.5
+
* lstchain v0.9.9
−
* real data: tailcut8-4 (with cleaning based on pedestal RMS), dynamic cleaning
+
* real data: tailcut8-4 (with cleaning based on pedestal RMS), dynamic cleaning.
  
−
   /fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/DL1_raw/lstchain_standard_config.json
+
   /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json
  
−
* MC: tailcut8-4 (with cleaning based on pedestal RMS), dynamic cleaning, PSF+NSB tuning
+
* lstMCpipe-v0.9.0
−
  "image_modifier": {
+
* lstchain v0.9.9
−
    "increase_nsb": true,
+
* MC: tailcut8-4, dynamic cleaning, NSB tuning
−
    "extra_noise_in_dim_pixels": 0.74,
+
    "image_modifier": {
−
    "extra_bias_in_dim_pixels": 0.38,
+
        "increase_nsb": true,
−
    "transition_charge": 8,
+
        "extra_noise_in_dim_pixels": 1.62,
−
    "extra_noise_in_bright_pixels": 0.052,
+
        "extra_bias_in_dim_pixels": 0.655,
−
    "increase_psf": true,
+
        "transition_charge": 8,
−
    "smeared_light_fraction": 0.125
+
        "extra_noise_in_bright_pixels": 2.08,
−
  },
+
        "increase_psf": false,
−
 
+
        "smeared_light_fraction": 0
−
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/DL1_raw/lstchain_dl1ab_tune_MC_to_BLLac_config.json
+
    },
−
 
 
−
* Produced DL1b files
 
−
 
 
−
/fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/DL1_raw/data/
 
−
/fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/DL1_raw/Run0XXXX
 
  
 +
: Config file: https://github.com/cta-observatory/lstmcpipe/blob/master/production_configs/20221027_v0.9.9_crab_tuned/lstchain_config_2022-10-27.json
  
 
==Random forest==
 
==Random forest==
  
−
Please include your specific .json files used in producing your RFs and for which source analysis (source dependent or independent), and variabules used in the RF. 
+
RFs were produced with lstMCpipe
  
−
'''Example'''
+
* lstchain-v0.9.9
  
−
* lstchain-0.7.6.dev242+g2086cb9
+
* lstMCpipe-v0.9.0
  
−
* source-indep (diffuse gamma, src_r<3deg, disp_norm)
+
* source-indep (the standard one for the AllSky MC production)
−
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcindep/RF/lstchain_standard_config.json
+
  /fefs/aswg/data/models/AllSky/20221027_v0.9.9_crab_tuned/dec_2276/
−
 
 
−
 
 
−
* source-dep
 
−
/fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcdep/RF/lstchain_src_dep_config.json
 
  
 
==DL2 data==
 
==DL2 data==
  
−
Information about your DL2 data and settings such as: specifc versions of lstchain, specfic .json version used.
+
* lstchain-v0.9.9
−
 
 
−
'''Example''':
 
−
 
 
−
* lstchain-0.7.6.dev242+g2086cb9
 
  
 
* source-indep
 
* source-indep
−
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcindep/DL2/data/
+
  /fefs/aswg/data/mc/DL2/AllSky/20221027_v0.9.9_crab_tuned/TestingDataset/dec_2276/node_theta_*
−
  /fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcindep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
+
  /fefs/aswg/workspace/arnau.aguasca/Analysis/results/real/DL2/202210*/srcind/v0.9.9/tailcut84_dynclg_tNSBtoCrabPerfPaper/AllSky_20221027_v0.9.9_crab_tuned_dec_2276/dl2_*
  
−
* source-dep
+
* config file
−
/fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcdep/DL2/data/  
+
  /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json
−
/fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcdep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
 
  
−
==DL3 data selection==
+
==DL2 data selection to produce theta2 plots==
  
−
Information about your DL3 data selection.  
+
Information about the quality cuts to produce the theta2 plots.  
  
 
'''Example'''
 
'''Example'''
 
*intensity > 50
 
*intensity > 50
 
*r: [0,  1 ]
 
*r: [0,  1 ]
−
*wl: [0.1, 1 ]
+
*wl: [0.01, 1 ]
 
*leakage_intensity_width_2: [0, 0.2 ]
 
*leakage_intensity_width_2: [0, 0.2 ]
 +
*event_type: [32, 32]
  
 
* source-indep
 
* source-indep
−
**fixed_gh_cut: 0.3
+
**fixed_gh_cut: 0.7 (standard cut)
−
**fixed_theta_cut: 0.2
+
**fixed_theta_cut: 0.2 (standard cut)
−
 
 
−
* source-dep
 
−
**fixed_gh_cut: 0.7
 
−
**fixed_alpha_cut: 10
 
−
 
 
−
 
 
−
=High-level analysis=
 
−
 
 
−
The high-level analysis is done joining the dark and mild moon runs.
 
−
 
 
−
'''Example'''
 
−
 
 
−
*lstchain to generate source-dep IRF, DL3
 
−
*Science Tool: gammapy 0.18.2
 
−
* point-like IRF, 1D analysis
 
  
 
==Analysis Results==
 
==Analysis Results==

Revision as of 12:27, 3 March 2023

Back to the Data analysis page

Go back to Transient Working Group.

Go Back to Gamma-Ray Bursts (GRBs).

Go back to GRB221009A.

  • Analysis by A. Aguasca-Cabot (Universitat de Barcelona - arnau.aguasca@fqa.ub.edu)


General information

This wiki web page shows the analysis of GRB221009A data recorded in dark conditions (run_id: 9625-9960) and in mild moon conditions (run_id: 9629 and 9630) using the source-independent analysis.

For the analysis of GRB221009A for runs in moon conditions go to the following page: GRB221009A_src-ind_analysis_moon

The wiki page with the summary of the current results of the src-ind moon analysis (as of February 8th) for the discussion with LST-Reco conveners is the following: [1]

  • Slides presented at the GRB221009A meetings about the source-independent dark/mild-moon analysis:
Start and Dark analysis I
Dark analysis II
Dark analysis III
Dark analysis IV and mild moon
Dark analysis V and mild moon


Dark analysis

Monte Carlo information

  • Link to MC files used: /fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_crab_tuned/*
    • Particle types: The standard ones for the AllSky MC production.
    • DEC Band (deg): dec_2276

The MC production for the Crab is used because the NSB tuning parameters at the DL1 level are very similar between them:

  • Pixel charge distribution for real cosmics (blue, run 9672), standard MC gammas (orange), tuned MC gammas to Crab (green) and to GRB221009A (red) using the DL1 NSB parameters. Plot with y-axis in log scale.

DL1 parameters obtained from GRB221009A runs (the NSB tuning parameters for the Crab can be found in the following subsection): 

Runs: 9672, 9802, 9862 and 9890
{
    "number_of_files_used": 46,
    "std": [
    0.181,
    0.077,
    0.209
]
}{
    "increase_nsb": true,
    "extra_noise_in_dim_pixels": 1.782,
    "extra_bias_in_dim_pixels": 0.601,
    "transition_charge": 8,
    "extra_noise_in_bright_pixels": 2.25
}

DL1 data

No reprocessing of the real DL1a data was required, only NSB tuning was added to the MC files. DL1a files produced by LSTOSA (lstchain v0.9.6?) and lstMCpipe (lstMCpipe v0.9.0 using lstchain v0.9.9).

  • original DL1a files
/fefs/aswg/data/real/DL1/20221010/v0.9/tailcut84/dl1_LST-1.Run0XXXX.XXXX.h5
/fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/
  • lstchain v0.9.9
  • real data: tailcut8-4 (with cleaning based on pedestal RMS), dynamic cleaning.
 /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json
  • lstMCpipe-v0.9.0
  • lstchain v0.9.9
  • MC: tailcut8-4, dynamic cleaning, NSB tuning
   "image_modifier": {
       "increase_nsb": true,
       "extra_noise_in_dim_pixels": 1.62,
       "extra_bias_in_dim_pixels": 0.655,
       "transition_charge": 8,
       "extra_noise_in_bright_pixels": 2.08,
       "increase_psf": false,
       "smeared_light_fraction": 0
   },
Config file: https://github.com/cta-observatory/lstmcpipe/blob/master/production_configs/20221027_v0.9.9_crab_tuned/lstchain_config_2022-10-27.json

Random forest

RFs were produced with lstMCpipe

  • lstchain-v0.9.9
  • lstMCpipe-v0.9.0
  • source-indep (the standard one for the AllSky MC production)
/fefs/aswg/data/models/AllSky/20221027_v0.9.9_crab_tuned/dec_2276/

DL2 data

  • lstchain-v0.9.9
  • source-indep
/fefs/aswg/data/mc/DL2/AllSky/20221027_v0.9.9_crab_tuned/TestingDataset/dec_2276/node_theta_*
/fefs/aswg/workspace/arnau.aguasca/Analysis/results/real/DL2/202210*/srcind/v0.9.9/tailcut84_dynclg_tNSBtoCrabPerfPaper/AllSky_20221027_v0.9.9_crab_tuned_dec_2276/dl2_*
  • config file
 /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json

DL2 data selection to produce theta2 plots

Information about the quality cuts to produce the theta2 plots.

Example

  • intensity > 50
  • r: [0, 1 ]
  • wl: [0.01, 1 ]
  • leakage_intensity_width_2: [0, 0.2 ]
  • event_type: [32, 32]
  • source-indep
    • fixed_gh_cut: 0.7 (standard cut)
    • fixed_theta_cut: 0.2 (standard cut)


Crab check

Mild moon analysis

Monte Carlo information

  • Link to MC files used: /fefs/aswg/data/mc/DL1/AllSky/20221215_v0.9.12_base_prod/*
    • Particle types: The standard ones for the AllSky MC production.
    • DEC Band (deg): dec_2276

DL1 data

No reprocessing of the real DL1a data was required, only NSB tuning was added to the MC files. DL1a files produced by LSTOSA (lstchain v0.9.6?) and lstMCpipe (lstMCpipe v0.9.0 using lstchain v0.9.9).

  • original DL1a files
/fefs/aswg/data/real/DL1/20221010/v0.9/tailcut84/dl1_LST-1.Run0XXXX.XXXX.h5
/fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/
  • lstchain v0.9.9
  • real data: tailcut8-4 (with cleaning based on pedestal RMS), dynamic cleaning.
 /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json
  • lstMCpipe-v0.9.0
  • lstchain v0.9.9
  • MC: tailcut8-4, dynamic cleaning, NSB tuning
   "image_modifier": {
       "increase_nsb": true,
       "extra_noise_in_dim_pixels": 1.62,
       "extra_bias_in_dim_pixels": 0.655,
       "transition_charge": 8,
       "extra_noise_in_bright_pixels": 2.08,
       "increase_psf": false,
       "smeared_light_fraction": 0
   },
Config file: https://github.com/cta-observatory/lstmcpipe/blob/master/production_configs/20221027_v0.9.9_crab_tuned/lstchain_config_2022-10-27.json

Random forest

RFs were produced with lstMCpipe

  • lstchain-v0.9.9
  • lstMCpipe-v0.9.0
  • source-indep (the standard one for the AllSky MC production)
/fefs/aswg/data/models/AllSky/20221027_v0.9.9_crab_tuned/dec_2276/

DL2 data

  • lstchain-v0.9.9
  • source-indep
/fefs/aswg/data/mc/DL2/AllSky/20221027_v0.9.9_crab_tuned/TestingDataset/dec_2276/node_theta_*
/fefs/aswg/workspace/arnau.aguasca/Analysis/results/real/DL2/202210*/srcind/v0.9.9/tailcut84_dynclg_tNSBtoCrabPerfPaper/AllSky_20221027_v0.9.9_crab_tuned_dec_2276/dl2_*
  • config file
 /fefs/aswg/data/real/DL1/20221015/v0.9/tailcut84/log/lstchain_config_v0.9.4_from2022onwards.json

DL2 data selection to produce theta2 plots

Information about the quality cuts to produce the theta2 plots.

Example

  • intensity > 50
  • r: [0, 1 ]
  • wl: [0.01, 1 ]
  • leakage_intensity_width_2: [0, 0.2 ]
  • event_type: [32, 32]
  • source-indep
    • fixed_gh_cut: 0.7 (standard cut)
    • fixed_theta_cut: 0.2 (standard cut)

Analysis Results

Please place higher-level analysis results (Spectra, SkyMaps, Lightcurves, etc) here.

Theta2 plot

Significance map

Excess map

Spectral results

Retrieved from "https://www.lst1.iac.es/wiki/index.php?title=GRB221009A_src-ind_analysis_dark_conditions&oldid=7353"