Difference between revisions of "Crab Nebula Performance srcdep analysis"

From my_wiki
Jump to: navigation, search
(Created page with "=Crab Nebula Performance (source-dependent analysis)= ==General information== * '''Name of the source''': Name * '''Brief description of the source''': ** Object type : Unk...")
 
(Random forest)
 
(4 intermediate revisions by the same user not shown)
Line 18: Line 18:
 
standard OSA production
 
standard OSA production
 
  /fefs/aswg/workspace/abelardo.moralejo/Crab_performance_paper/data/DL1//YYYYMMDD/dl1_LST-1.Run0XXXX.h5
 
  /fefs/aswg/workspace/abelardo.moralejo/Crab_performance_paper/data/DL1//YYYYMMDD/dl1_LST-1.Run0XXXX.h5
  (/fefs/aswg/data/real/DL1/20220228/v0.9/tailcut84/dl1_LST-1.Run07136.h5)
+
  (/fefs/aswg/data/real/DL1/YYYYMMDD/v0.9/tailcut84/dl1_LST-1.Run0XXXX.h5)
  
 
* MC (training)
 
* MC (training)
Line 29: Line 29:
 
  /fefs/aswg/data/mc/DL1/AllSky/20220518_allsky_dec2276_tuned/TestingDataset/dl1_20220518_allsky_dec2276_tuned_node_theta_XXXX_az_YYYYYYY__merged.h5
 
  /fefs/aswg/data/mc/DL1/AllSky/20220518_allsky_dec2276_tuned/TestingDataset/dl1_20220518_allsky_dec2276_tuned_node_theta_XXXX_az_YYYYYYY__merged.h5
  
 +
==Random forest==
  
==Random forest==
+
* configuration file
 +
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/RF/lstchain_src_dep_config.json
  
Please include your specific .json files used in producing your RFs and for which source analysis (source dependent or independent), and variabules used in the RF.
+
* Energy regression
 +
    "random_forest_energy_regressor_args": {
 +
        "max_depth": 30,
 +
        "min_samples_leaf": 10,
 +
        "n_jobs": -1,
 +
        "n_estimators": 150,
 +
        "bootstrap": true,
 +
        "criterion": "squared_error",
 +
        "max_features": "auto",
 +
        "max_leaf_nodes": null,
 +
        "min_impurity_decrease": 0.0,
 +
        "min_samples_split": 10,
 +
        "min_weight_fraction_leaf": 0.0,
 +
        "oob_score": false,
 +
        "random_state": 42,
 +
        "verbose": 0,
 +
        "warm_start": false
 +
    },
  
'''Example'''
 
  
* lstchain-0.7.6.dev242+g2086cb9
+
    "energy_regression_features": [
 +
        "log_intensity",
 +
        "width",
 +
        "length",
 +
        "wl",
 +
        "skewness_from_source",
 +
        "kurtosis",
 +
        "time_gradient_from_source",
 +
        "leakage_intensity_width_2",
 +
        "alt_tel",
 +
        "az_tel",
 +
        "dist"
 +
    ],
  
* source-indep (diffuse gamma, src_r<3deg, disp_norm)
+
* gamma/hadron separation
/fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcindep/RF/lstchain_standard_config.json
+
    "random_forest_particle_classifier_args": {
 +
        "max_depth": 30,
 +
        "min_samples_leaf": 10,
 +
        "n_jobs": -1,
 +
        "n_estimators": 100,
 +
        "criterion": "gini",
 +
        "min_samples_split": 10,
 +
        "min_weight_fraction_leaf": 0.0,
 +
        "max_features": "auto",
 +
        "max_leaf_nodes": null,
 +
        "min_impurity_decrease": 0.0,
 +
        "bootstrap": true,
 +
        "oob_score": false,
 +
        "random_state": 42,
 +
        "verbose": 0.0,
 +
        "warm_start": false,
 +
        "class_weight": null
 +
    },
  
  
* source-dep
+
    "particle_classification_features": [
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcdep/RF/lstchain_src_dep_config.json
+
        "log_intensity",
 +
        "width",
 +
        "length",
 +
        "wl",
 +
        "skewness_from_source",
 +
        "kurtosis",
 +
        "time_gradient_from_source",
 +
        "leakage_intensity_width_2",
 +
        "log_reco_energy",
 +
        "alt_tel",
 +
        "az_tel",
 +
        "dist"
 +
* produced models
 +
  /fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/RF/trained_models/
  
 
==DL2 data==
 
==DL2 data==
  
Information about your DL2 data and settings such as: specifc versions of lstchain, specfic .json version used.
+
* MC
 
+
:* configuration file
'''Example''':
+
  /fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2_MC/lstchain_src_dep_config.json
 
+
:* path
* lstchain-0.7.6.dev242+g2086cb9
+
  /fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2_MC/data
 
 
* source-indep
 
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcindep/DL2/data/
 
  /fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcindep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
 
  
* source-dep
+
* real data
  /fefs/aswg/workspace/seiya.nozaki/data/MC/v0.7.5/tailcut84_dynamic_bllac/srcdep/DL2/data/
+
:* configuration file
  /fefs/aswg/workspace/seiya.nozaki/data/BLLac/v0.7.3/tailcut84_dynamic_v075/srcdep/DL2/data/dl2_LST-1.Run0XXXX_merged.h5
+
  /fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2/lstchain_src_dep_config.json
 +
:* path
 +
  /fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2/YYYYMMDD
  
 
==DL3 data selection==
 
==DL3 data selection==

Latest revision as of 15:02, 12 July 2022

Crab Nebula Performance (source-dependent analysis)[edit]

General information[edit]

  • Name of the source: Name
  • Brief description of the source:
    • Object type : Unknown, AGN, SNR, Pulsar, PWN, GRB, etc
    • Redshift (z) :
    • Other relevant information
    • RA: XX XX XX.XX (hh mm ss), Dec: +/-YY YY YY.YY (dd mm ss)
    • RA, Dec in deg (ICRS): XX.XX, YY.YY
  • Analysis by Name (Institute - email)

DL1 data[edit]

  • real data

standard OSA production

/fefs/aswg/workspace/abelardo.moralejo/Crab_performance_paper/data/DL1//YYYYMMDD/dl1_LST-1.Run0XXXX.h5
(/fefs/aswg/data/real/DL1/YYYYMMDD/v0.9/tailcut84/dl1_LST-1.Run0XXXX.h5)
  • MC (training)

specific lstmcpipe production (NSB tuned)

/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/DL1_MC/TrainingDataset/GammaDiffuse/merged/dl1_20220518_allsky_dec2276_tuned_dec_2276_GammaDiffuse_merged.h5
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/DL1_MC/TrainingDataset/Protons/merged/dl1_20220518_allsky_dec2276_tuned_dec_2276_Protons_merged.h5
  • MC (test)

specific lstmcpipe production (NSB tuned)

/fefs/aswg/data/mc/DL1/AllSky/20220518_allsky_dec2276_tuned/TestingDataset/dl1_20220518_allsky_dec2276_tuned_node_theta_XXXX_az_YYYYYYY__merged.h5

Random forest[edit]

  • configuration file
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/RF/lstchain_src_dep_config.json
  • Energy regression
   "random_forest_energy_regressor_args": {
       "max_depth": 30,
       "min_samples_leaf": 10,
       "n_jobs": -1,
       "n_estimators": 150,
       "bootstrap": true,
       "criterion": "squared_error",
       "max_features": "auto",
       "max_leaf_nodes": null,
       "min_impurity_decrease": 0.0,
       "min_samples_split": 10,
       "min_weight_fraction_leaf": 0.0,
       "oob_score": false,
       "random_state": 42,
       "verbose": 0,
       "warm_start": false
   },


   "energy_regression_features": [
       "log_intensity",
       "width",
       "length",
       "wl",
       "skewness_from_source",
       "kurtosis",
       "time_gradient_from_source",
       "leakage_intensity_width_2",
       "alt_tel",
       "az_tel",
       "dist"
   ],
  • gamma/hadron separation
   "random_forest_particle_classifier_args": {
       "max_depth": 30,
       "min_samples_leaf": 10,
       "n_jobs": -1,
       "n_estimators": 100,
       "criterion": "gini",
       "min_samples_split": 10,
       "min_weight_fraction_leaf": 0.0,
       "max_features": "auto",
       "max_leaf_nodes": null,
       "min_impurity_decrease": 0.0,
       "bootstrap": true,
       "oob_score": false,
       "random_state": 42,
       "verbose": 0.0,
       "warm_start": false,
       "class_weight": null
   },


   "particle_classification_features": [
       "log_intensity",
       "width",
       "length",
       "wl",
       "skewness_from_source",
       "kurtosis",
       "time_gradient_from_source",
       "leakage_intensity_width_2",
       "log_reco_energy",
       "alt_tel",
       "az_tel",
       "dist"
  • produced models
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/RF/trained_models/

DL2 data[edit]

  • MC
  • configuration file
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2_MC/lstchain_src_dep_config.json
  • path
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2_MC/data
  • real data
  • configuration file
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2/lstchain_src_dep_config.json
  • path
/fefs/aswg/workspace/seiya.nozaki/Crab_performance_paper/20220518_allsky_dec2276_tuned/zd_all_with_pointing_info/DL2/YYYYMMDD

DL3 data selection[edit]

Information about your DL3 data selection.

Example

  • intensity > 50
  • r: [0, 1 ]
  • wl: [0.1, 1 ]
  • leakage_intensity_width_2: [0, 0.2 ]
  • source-indep
    • fixed_gh_cut: 0.3
    • fixed_theta_cut: 0.2
  • source-dep
    • fixed_gh_cut: 0.7
    • fixed_alpha_cut: 10

High-level analysis[edit]

Please put any information about the production of higher level analysis here.

Example

  • lstchain to generate source-dep IRF, DL3
  • Science Tool: gammapy 0.18.2
  • point-like IRF, 1D analysis

Analysis Results[edit]

Please place higher-level analysis results (Spectra, SkyMaps, Lightcurves, etc) here.

Theta2 plot[edit]

Significance map[edit]

Excess map[edit]

Spectral results[edit]