Difference between revisions of "GRB221009A srcdep analysis"

From my_wiki
Jump to: navigation, search
(Created page with " Back to the Data analysis page Go back to Transient Working Group. Go Back to [https://www.lst1.iac.es/wiki/index.php/Transient_observation_logbook G...")
 
(DL1 data)
 
(4 intermediate revisions by the same user not shown)
Line 6: Line 6:
  
 
Go back to [[GRB221009A]].
 
Go back to [[GRB221009A]].
 +
 +
=General information=
  
 
* Analysis by Kenta Terauchi (Kyoto University - terauchi.kenta.74s@st.kyoto-u.ac.jp)
 
* Analysis by Kenta Terauchi (Kyoto University - terauchi.kenta.74s@st.kyoto-u.ac.jp)
 
=General information=
 
  
 
=== Superplots ===
 
=== Superplots ===
Line 56: Line 56:
  
 
* Sigma value for pedestal cleaning: 2.5 (default)
 
* Sigma value for pedestal cleaning: 2.5 (default)
 
  
 
= NSB tuning of MC data =
 
= NSB tuning of MC data =
Line 149: Line 148:
 
* original DL1a files
 
* original DL1a files
  
  /fefs/aswg/workspace/franca.cassol/data/real/DL1/20221010/tailcut84/
+
  real: /fefs/aswg/workspace/franca.cassol/data/real/DL1/20221010/tailcut84/
/fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/*
+
  mc: /fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/*
  
 
* Produced DL1b data (2022-10-10)
 
* Produced DL1b data (2022-10-10)
 
   
 
   
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/source/GRB221009A/2022_10_10/DL1_new_calib_tuned/dl1_LST-1.Run0960[2-7].*.h5
+
  real: /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/source/GRB221009A/2022_10_10/DL1_new_calib_tuned/dl1_LST-1.Run0960[2-7].*.h5
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/NSB_tuning/AllSky_nsb_tuned/run960[2-7]/*
+
  mc: /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/NSB_tuning/AllSky_nsb_tuned/run960[2-7]/*
  
 +
* Intensity distributions
 +
 +
<div><ul>
 +
<li style="display: inline-block;"> [[File:intensity_20221010.png|thumb|none|600px|Intensity distributions on 2022-10-10 after image cleaning with proper thresholds. The distributions are not normalized.]] </li>
 +
<li style="display: inline-block;"> [[File:hillas_comp_20221010.png|thumb|none|800px|Comparison of Hillas parameters between the GRB data (run9602) and NSB tuned Proton MC]] </li>
 +
</ul></div>
  
 
=Random forest=
 
=Random forest=
Line 165: Line 170:
 
* source-dep (diffuse gamma, src_r<1deg)
 
* source-dep (diffuse gamma, src_r<1deg)
  
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models/*
+
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_0-1/*
  
 
* source-dep (diffuse gamma, src_r<1deg, w/ extra srcdep parameters)
 
* source-dep (diffuse gamma, src_r<1deg, w/ extra srcdep parameters)
  
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models/*
+
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_0-1_extra_params/*
  
 
* source-dep (diffuse gamma, 0.2<src_r<0.6deg)
 
* source-dep (diffuse gamma, 0.2<src_r<0.6deg)
  
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models/*
+
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_02-06/*
  
* source-dep (diffuse gamma, src_r<1deg)
+
* source-dep (diffuse gamma, 0.2<src_r<0.6deg, w/ extra srcdep parameters)
  
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models/*
+
  /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_02-06_extra_params/*
 
   
 
   
  
 
= DL2 data =
 
= DL2 data =
  
Information about your DL2 data and settings such as: specifc versions of lstchain, specfic .json version used.
+
* lstchain-0.9.10, lstchain-0.9.14-dev (branch: extra_srcdep_params)
  
'''Example''':
+
* Produced DL2 data (2022-10-10)
 +
 +
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/source/GRB221009A/2022_10_10/DL2_new_calib_tuned*/dl2_LST-1.Run0960[2-7].*.h5
 +
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/NSB_tuning/AllSky_nsb_tuned/run960[2-7]/*
  
* lstchain-0.7.6.dev242+g2086cb9
+
= Cut optimization =
  
* source-indep
+
I optimized cut values using moon Crab data (2022-11-05; run10341 - 10346) taken under similar conditions to the GRB data. The GRB run-wise MCs which best match the Crab data (in terms of NSB level and Zd/Az range) are applied.
/fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcindep/DL2/data/
+
The cut optimization procedure is as follows:
/fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcindep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
+
 
 +
# Get Non, Noff and normalization with a certain set of gammaness and alpha cuts
 +
# Replace Nex with 0.05*Nex (5% Crab sensitivity) and recalculate Li&Ma significance (For the calculation of excess and LiMa, I used WStatCountsStatistic class in gammapy)
 +
# Search for cuts value which give the maximum Li&Ma significance
 +
 
 +
* Results
 +
 
 +
<div><ul>
 +
<li style="display: inline-block;"> [[File:cut_opt_src_r_02-06_extra_params_20221010.png|thumb|none|600px|Results for cut optimization; RF trained with src_r: 0.2-0.6; Extra srcdep parameters for g/h separation are used; Intensity > 300]] </li>
 +
<li style="display: inline-block;"> [[File:cut_opt_src_r_0-1_extra_params_20221010.png|thumb|none|600px|Results for cut optimization; RF trained with src_r: 0-1.0; Extra srcdep parameters for g/h separation are used; Intensity > 300]] </li>
 +
</ul></div>
 +
 
 +
= Alpha plot =
 +
 
 +
* 3 OFF regions
 +
* Intensity > 300
 +
* Normalization range: 40 < alpha(deg) < 80
 +
* Used optimized cuts
 +
 
 +
* 2022-10-10
 +
<div><ul>
 +
<li style="display: inline-block;"> [[File:alpha_src_r_02-06_extra_params_20221010.png|thumb|none|600px|Alpha plot; RF trained with src_r: 0.2-0.6; Extra srcdep parameters for g/h separation are used]] </li>
 +
<li style="display: inline-block;"> [[File:alpha_src_r_0-1_extra_params_20221010.png|thumb|none|600px|Alpha plot; RF trained with src_r: 0-1.0; Extra srcdep parameters for g/h separation are used]] </li>
 +
</ul></div>
  
* source-dep
 
/fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcdep/DL2/data/
 
/fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcdep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
 
  
==DL3 data selection==
+
=DL3 data selection=
  
 
Information about your DL3 data selection.  
 
Information about your DL3 data selection.  
Line 214: Line 242:
 
**fixed_alpha_cut: 10
 
**fixed_alpha_cut: 10
  
==High-level analysis==
+
=High-level analysis=
  
 
Please put any information about the production of higher level analysis here.
 
Please put any information about the production of higher level analysis here.

Latest revision as of 13:10, 20 February 2023

Back to the Data analysis page

Go back to Transient Working Group.

Go Back to Gamma-Ray Bursts (GRBs).

Go back to GRB221009A.

General information[edit]

  • Analysis by Kenta Terauchi (Kyoto University - terauchi.kenta.74s@st.kyoto-u.ac.jp)

Superplots[edit]

  • Superplots on 2022-10-10. Made by Seiya


NSB level[edit]

  • Median of pedestal std on 2022-10-10
  • Median of pedestal std on 2022-10-12


Calibrations[edit]

  • Pedestal std distribution of run9602(1st subrun)
  • Pedestal std distribution of run9602(1st subrun). Calibration was processed with new calibration file made by Franca
  • Pedestal std distribution in the camera frame (run9602;1st subrun).
  • Pedestal std distribution in the camera frame (run9602;1st subrun). Calibration was processed with new calibration file made by Franca

Image cleaning[edit]

  • Cleaning method: tailcut cleaning w/ pedestal cleaning, dynamic cleaning
  • Cleaning threshold: (picture threshold, boundary threshold)

The following threshold values are obtained so that ~5% of pedestal events survive after image cleaning. For now, the ratio of picture threshold to boundary threshold are fixed to 2:1 (same as default ratio, 8:4).

<2022_10_10>
run9602 - 9603: (24, 12)
run9604: (26, 13)
run9605 - 9607: (28, 14)
<2022_10_12>
run9613: (26, 13)
run9614: (18,9)
run9615 - 9616: (20, 10)
run9617: (22, 11)
  • Sigma value for pedestal cleaning: 2.5 (default)

NSB tuning of MC data[edit]

I produced run-wise MC taking into account the NSB level, cleaning threshold, and Zd/Az range of each run.

Monte Carlo information[edit]

  • Link to MC files used (base): /fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/*
  • Particle types: standard particle types for AllSky MC prodution
  • DEC band: dec_2276

MC productions[edit]

  • lstchain v0.9.10
  • lstMCpipe v0.10
  • NSB tuning method: Adding NSB noise to DL1 images. (Adding NSB noise to R0 waveform is VERY time consuming! It makes not so much sense to tune waveform for now. Maybe we could produce more dedicated MC in later stage before publication)


Date: 2022-10-10[edit]

  • run9602
"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 28.061,
   "extra_bias_in_dim_pixels": 6.6885,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 69.279,
   "increase_psf": false,
   "smeared_light_fraction": 0
 },
  • run9603
"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 29.361,
   "extra_bias_in_dim_pixels": 6.632,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 78.425,
   "increase_psf": false,
   "smeared_light_fraction": 0
 }
  • run9604
"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 31.232,
   "extra_bias_in_dim_pixels": 6.977,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 85.884,
   "increase_psf": false,
   "smeared_light_fraction": 0
 }
  • run9605
"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 33.304,
   "extra_bias_in_dim_pixels": 7.233,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 94.252,
   "increase_psf": false,
   "smeared_light_fraction": 0
 }
  • run9606
"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 33.860,
   "extra_bias_in_dim_pixels": 7.2195,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 100.024,
   "increase_psf": false,
   "smeared_light_fraction": 0
 }
  • run9607
"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 37.096,
   "extra_bias_in_dim_pixels": 7.972,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 107.688,
   "increase_psf": false,
   "smeared_light_fraction": 0
 }

Date: 2022-10-12[edit]

DL1 data[edit]

  • original DL1a files
real: /fefs/aswg/workspace/franca.cassol/data/real/DL1/20221010/tailcut84/
  mc: /fefs/aswg/data/mc/DL1/AllSky/20221027_v0.9.9_base_prod/*
  • Produced DL1b data (2022-10-10)
real: /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/source/GRB221009A/2022_10_10/DL1_new_calib_tuned/dl1_LST-1.Run0960[2-7].*.h5
  mc: /fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/NSB_tuning/AllSky_nsb_tuned/run960[2-7]/*
  • Intensity distributions
  • Intensity distributions on 2022-10-10 after image cleaning with proper thresholds. The distributions are not normalized.
  • Comparison of Hillas parameters between the GRB data (run9602) and NSB tuned Proton MC

Random forest[edit]

  • lstchain-0.9.10, lstchain-0.9.14-dev (branch: extra_srcdep_params)


  • source-dep (diffuse gamma, src_r<1deg)
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_0-1/*
  • source-dep (diffuse gamma, src_r<1deg, w/ extra srcdep parameters)
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_0-1_extra_params/*
  • source-dep (diffuse gamma, 0.2<src_r<0.6deg)
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_02-06/*
  • source-dep (diffuse gamma, 0.2<src_r<0.6deg, w/ extra srcdep parameters)
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/RF/AllSky_nsb_tuned/run960[2-7]/trained_models_src_r_02-06_extra_params/*

DL2 data[edit]

  • lstchain-0.9.10, lstchain-0.9.14-dev (branch: extra_srcdep_params)
  • Produced DL2 data (2022-10-10)
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/source/GRB221009A/2022_10_10/DL2_new_calib_tuned*/dl2_LST-1.Run0960[2-7].*.h5
/fefs/aswg/workspace/kenta.terauchi/Work/lst-analysis/NSB_tuning/AllSky_nsb_tuned/run960[2-7]/*

Cut optimization[edit]

I optimized cut values using moon Crab data (2022-11-05; run10341 - 10346) taken under similar conditions to the GRB data. The GRB run-wise MCs which best match the Crab data (in terms of NSB level and Zd/Az range) are applied. The cut optimization procedure is as follows:

  1. Get Non, Noff and normalization with a certain set of gammaness and alpha cuts
  2. Replace Nex with 0.05*Nex (5% Crab sensitivity) and recalculate Li&Ma significance (For the calculation of excess and LiMa, I used WStatCountsStatistic class in gammapy)
  3. Search for cuts value which give the maximum Li&Ma significance
  • Results
  • Results for cut optimization; RF trained with src_r: 0.2-0.6; Extra srcdep parameters for g/h separation are used; Intensity > 300
  • Results for cut optimization; RF trained with src_r: 0-1.0; Extra srcdep parameters for g/h separation are used; Intensity > 300

Alpha plot[edit]

  • 3 OFF regions
  • Intensity > 300
  • Normalization range: 40 < alpha(deg) < 80
  • Used optimized cuts
  • 2022-10-10
  • Alpha plot; RF trained with src_r: 0.2-0.6; Extra srcdep parameters for g/h separation are used
  • Alpha plot; RF trained with src_r: 0-1.0; Extra srcdep parameters for g/h separation are used


DL3 data selection[edit]

Information about your DL3 data selection.

Example

  • intensity > 50
  • r: [0, 1 ]
  • wl: [0.1, 1 ]
  • leakage_intensity_width_2: [0, 0.2 ]
  • source-indep
    • fixed_gh_cut: 0.3
    • fixed_theta_cut: 0.2
  • source-dep
    • fixed_gh_cut: 0.7
    • fixed_alpha_cut: 10

High-level analysis[edit]

Please put any information about the production of higher level analysis here.

Example

  • lstchain to generate source-dep IRF, DL3
  • Science Tool: gammapy 0.18.2
  • point-like IRF, 1D analysis

Analysis Results[edit]

Please place higher-level analysis results (Spectra, SkyMaps, Lightcurves, etc) here.

Theta2 plot[edit]

Significance map[edit]

Excess map[edit]

Spectral results[edit]