Difference between revisions of "Fast Offline Analysis Template"

From my_wiki
Jump to: navigation, search
(Significance and Excess map)
 
(12 intermediate revisions by one other user not shown)
Line 1: Line 1:
 +
Go back to [[Logbook_of_ToO]]
 +
 
=Fast offline analysis template=
 
=Fast offline analysis template=
  
 +
Name your fast offline analysis wiki page following the scheme:
 +
 +
Fast_Offline_Analysis_SourceName_Month(s)_Year_ObsPeriod
 +
 +
where:
 +
* ObsPeriod should be e.g. P063
 +
 +
For example: https://www.lst1.iac.es/wiki/index.php/Fast_Analysis_OP313_ToO_Feb_Mar_2024_P062
  
 
==General information==
 
==General information==
Line 12: Line 22:
  
 
* Analysis by:
 
* Analysis by:
**Analyzer name (Institute - email)
+
**Analyzer 1 name (Institute - email)
 
+
**Analyzer 2 name (Institute - email)
  
 
==Data-taking information==
 
==Data-taking information==
Line 19: Line 29:
 
** Date (time of observation h)
 
** Date (time of observation h)
 
***ZD range (deg): Zenith Range
 
***ZD range (deg): Zenith Range
***AZ range (deg): Azimuth Range
+
***Observations: (see example below)
***Transmission9km:
 
***Runs:
 
***Observations:
 
  
  '2024-02-28': [16895, 16896, 16897, 16898]
+
  2024-02-28: [16895, 16896, 16897, 16898]
'2024-03-03': [16912, 16913, 16917, 16918, 16919, 16920, 16921, 16922, 16923, 16924, 16925, 16926, 16927, 16928, 16929, 16930, 16931, 16932]
 
'2024-03-04': [16953, 16954, 16955, 16956, 16957, 16958]
 
'2024-03-06': [16985, 16986, 16987, 16988, 16989, 16990, 16991]
 
'2024-03-11': [17077, 17078, 17079, 17080, 17081, 17082]
 
'2024-03-13': [17107, 17108, 17109, 17110, 17111, 17112, 17113, 17114, 17115]
 
'2024-03-14': [17124, 17125, 17126, 17127, 17128, 17129, 17130, 17131, 17132, 17133, 17134, 17135, 17136, 17137, 17138]
 
'2024-03-15': [17162, 17163, 17164, 17165, 17166, 17167, 17168, 17169]
 
'2024-03-16': [17176, 17177, 17178, 17179, 17180, 17181, 17182]
 
'2024-03-17': [17189, 17191, 17192, 17193]
 
  
*Data quality selection not yet applied on above data sample
+
*Data quality selection: it is not mandatory to apply data selection for these preliminary analyses. But if you do it and select good-quality runs, please also add the plot in which the distribution of the different quality parameters are shown together with the limit values.
*Joint observations with MAGIC? : Simultaneous observations but MAGIC GPS not working so timestamp matching between LST-1 and MAGIC cannot be properly done.
+
*Joint observations with MAGIC?:  
*Information on data-taking (observations summaries): https://www.lst1.iac.es/datacheck/observation_overview/2024/03/run_summary_2024_03_17.pdf
+
*Information on data-taking (observations summaries): Write here if there was any problem with data-taking. (check ELOG for weather info, rate values and e.g. add link https://www.lst1.iac.es/datacheck/observation_overview/2024/03/run_summary_2024_03_17.pdf)
  
 
==General analysis information==
 
==General analysis information==
*source-independent analysis
+
* source-independent analysis
*lstchain version: (e.g. v0.10.10)
+
* lstchain version: (e.g. v0.10.10)
 +
* DL1b standard production (v0.10/tailcut84), run-wise merged files in:
  
==DL1 data==
+
/fefs/aswg/data/real/DL1/YYYYMMDD/v0.10/tailcut84/dl1_LST-1.Run?????.h5
 
 
(Not expected to be changed)
 
 
 
LSTOSA standard production (v0.10/tailcut84) of DL1b run-wise merged files.
 
  
/fefs/aswg/data/real/DL1/YYYYMMDD/v0.10/tailcut84/dl1_LST-1.Run?????.h5
 
  
 
==Monte Carlo information==
 
==Monte Carlo information==
Write below the MC production id among the existing MC
+
Write below the MC production ID among the existing MC
 
* All-sky MC production used: (e.g. 20230901_v0.10.4_allsky_base_prod)
 
* All-sky MC production used: (e.g. 20230901_v0.10.4_allsky_base_prod)
** Declination line (training): dec_XXXX
+
* Declination line (training): dec_XXXX
 
 
  
  
 
===Random forest===
 
===Random forest===
Path to the models used:
+
Path to the models used: (example below)
  
 
  /fefs/aswg/data/models/AllSky/20230901_v0.10.4_allsky_base_prod/dec_3476
 
  /fefs/aswg/data/models/AllSky/20230901_v0.10.4_allsky_base_prod/dec_3476
Line 65: Line 58:
 
==DL2 data==
 
==DL2 data==
  
Config file:
+
The config file to produce the DL2 files must be the one used to produce the RF models. Should be located together with model's files.
 
   
 
   
  
Line 73: Line 66:
  
 
==DL3 data & IRF==
 
==DL3 data & IRF==
 +
 +
(Specify the path to your DL3 files so the other FOA or anyone can also use the files for performing a stacked analysis with all available DL3 data)
 +
 +
Files in:
 +
/fefs/aswg/workspace/your.name/files/to/your/dl3/files
 +
 +
Configuration used for producing IRF/DL3 files (you can leave standard settings):
  
 
   "EventSelector": {
 
   "EventSelector": {
Line 95: Line 95:
 
   },
 
   },
  
* 70 % efficiency for both gammaness and theta gamma-ray selection cuts
+
* Standard cuts: Intensity > 50 p.e., 70 % efficiency for both gammaness and theta gamma-ray selection energy-dependent cuts.
* Point-like IRF
+
* Recommended to produce unzipped DL3 files since the Gammapy analysis Gammapy is faster.
 +
* You can set the max theta cut (and filling value to the same value) to e.g. 0.2 deg. In this way, you can use more off-regions in Gammapy.
 +
* Point-like IRF.
  
==High-level analysis==
+
== High-level analysis and results ==
  
* Gammapy 1.1
+
=== Analysis settings ===
 +
* Gammapy version: 1.1
 
* 1D analysis (point-like IRF)
 
* 1D analysis (point-like IRF)
 
==Analysis Results==
 
  
 
=== Theta2 plot ===
 
=== Theta2 plot ===
Line 114: Line 115:
 
* Energy range:
 
* Energy range:
  
 
+
=== Daily results ===
 
* YYYY-MM-DD
 
* YYYY-MM-DD
  
 
[[File:image1.png|600 px]]
 
[[File:image1.png|600 px]]
  
* Stacked observations
+
=== Stacked observations ===
  
=== Significance and Excess sky map ===
+
=== Significance and Excess sky maps ===
  
 
=== Spectral results ===
 
=== Spectral results ===
  
Include the table of spectral parameters (see example below) and post the SED plot (best-fit model + spectral flux points)
+
Include the spectral parameters (see example below) and the SED plot (best-fit model + spectral flux points)
 +
 
 +
For example:
  
 
   type      name      value        unit        error      min    max frozen is_norm link
 
   type      name      value        unit        error      min    max frozen is_norm link

Latest revision as of 04:19, 25 September 2024

Go back to Logbook_of_ToO

Fast offline analysis template[edit]

Name your fast offline analysis wiki page following the scheme:

Fast_Offline_Analysis_SourceName_Month(s)_Year_ObsPeriod

where:

  • ObsPeriod should be e.g. P063

For example: https://www.lst1.iac.es/wiki/index.php/Fast_Analysis_OP313_ToO_Feb_Mar_2024_P062

General information[edit]

  • Name of the source:
  • Brief description of the source:
    • Object type :
    • Redshift (z) :
    • Other relevant information
    • RA: XX XX XX.XXX (hh mm ss), Dec: YY YY YY.YYY (dd mm ss)
    • RA, Dec in deg (ICRS): XX.XX, YY.YY
  • Analysis by:
    • Analyzer 1 name (Institute - email)
    • Analyzer 2 name (Institute - email)

Data-taking information[edit]

  • Dates of data-taking:
    • Date (time of observation h)
      • ZD range (deg): Zenith Range
      • Observations: (see example below)
2024-02-28: [16895, 16896, 16897, 16898]
  • Data quality selection: it is not mandatory to apply data selection for these preliminary analyses. But if you do it and select good-quality runs, please also add the plot in which the distribution of the different quality parameters are shown together with the limit values.
  • Joint observations with MAGIC?:
  • Information on data-taking (observations summaries): Write here if there was any problem with data-taking. (check ELOG for weather info, rate values and e.g. add link https://www.lst1.iac.es/datacheck/observation_overview/2024/03/run_summary_2024_03_17.pdf)

General analysis information[edit]

  • source-independent analysis
  • lstchain version: (e.g. v0.10.10)
  • DL1b standard production (v0.10/tailcut84), run-wise merged files in:
/fefs/aswg/data/real/DL1/YYYYMMDD/v0.10/tailcut84/dl1_LST-1.Run?????.h5


Monte Carlo information[edit]

Write below the MC production ID among the existing MC

  • All-sky MC production used: (e.g. 20230901_v0.10.4_allsky_base_prod)
  • Declination line (training): dec_XXXX


Random forest[edit]

Path to the models used: (example below)

/fefs/aswg/data/models/AllSky/20230901_v0.10.4_allsky_base_prod/dec_3476

DL2 data[edit]

The config file to produce the DL2 files must be the one used to produce the RF models. Should be located together with model's files.


Files in:

/fefs/aswg/workspace/daniel.morcuende/data/real/DL2/OP313_ToO_Dec2023/dec_3476

DL3 data & IRF[edit]

(Specify the path to your DL3 files so the other FOA or anyone can also use the files for performing a stacked analysis with all available DL3 data)

Files in:

/fefs/aswg/workspace/your.name/files/to/your/dl3/files

Configuration used for producing IRF/DL3 files (you can leave standard settings):

 "EventSelector": {
   "filters": {
     "intensity": [50, Infinity],
     "width": [0, Infinity],
     "length": [0, Infinity],
     "r": [0, 1],
     "wl": [0.01, 1],
     "leakage_intensity_width_2": [0, 1],
     "event_type": [32, 32]
   }
 },
 "DL3Cuts": {
   "min_event_p_en_bin": 100,
   "min_gh_cut": 0.1,
   "max_gh_cut": 0.95,
   "min_theta_cut": 0.0,
   "max_theta_cut": 0.2,
   "fill_theta_cut": 0.2,
   "allowed_tels": [1]
 },
  • Standard cuts: Intensity > 50 p.e., 70 % efficiency for both gammaness and theta gamma-ray selection energy-dependent cuts.
  • Recommended to produce unzipped DL3 files since the Gammapy analysis Gammapy is faster.
  • You can set the max theta cut (and filling value to the same value) to e.g. 0.2 deg. In this way, you can use more off-regions in Gammapy.
  • Point-like IRF.

High-level analysis and results[edit]

Analysis settings[edit]

  • Gammapy version: 1.1
  • 1D analysis (point-like IRF)

Theta2 plot[edit]

Settings:

  • Theta2 cut for signal extraction: X.XX deg2
  • Normalization range: X.X - Y.Y deg2
  • Number of off positions:
  • Energy range:

Daily results[edit]

  • YYYY-MM-DD

600 px

Stacked observations[edit]

Significance and Excess sky maps[edit]

Spectral results[edit]

Include the spectral parameters (see example below) and the SED plot (best-fit model + spectral flux points)

For example:

  type      name      value         unit        error      min    max frozen is_norm link
-------- ---------- ---------- -------------- --------- --------- --- ------ ------- ----
spectral      index 2.8255e+00                3.298e-01 1.000e+00 nan  False   False     
spectral  amplitude 1.7730e-09 TeV-1 s-1 cm-2 4.988e-10       nan nan  False    True     
spectral  reference 1.0000e+02            GeV 0.000e+00       nan nan   True   False       


Light curve[edit]