Difference between revisions of "Downloading data"

From my_wiki
Jump to: navigation, search
m
m (Update instructions for the login using CTA credentials.)
 
(4 intermediate revisions by 2 users not shown)
Line 3: Line 3:
 
This page is to explain how to download data if you prefer to work outside the LP IT cluster (see [[Working at the LST-IT center|Working at the LST-IT center]] instead).
 
This page is to explain how to download data if you prefer to work outside the LP IT cluster (see [[Working at the LST-IT center|Working at the LST-IT center]] instead).
  
'''Please do not copy data directly from the IT cluster on La Palma''', as LST is charged for each transferred byte. '''Instead, copy the data from PIC OR CNAF''' to which the data is already transferred automatically from LP.
+
'''Please avoid to copy large data directly from the La Palma IT cluster''', as LST is charged for each transferred byte. '''Instead, copy the data from PIC or CNAF''' (if already having been automatically transferred) or work directly on the LP cluster.
  
 
This how-to is based on the presentation by Jordi Delgado on the LST analysis school in January 2022 [https://indico.cta-observatory.org/event/3687/contributions/31926/attachments/20648/28909/jdelgado_LST_Software_School_Jan2022.pdf].
 
This how-to is based on the presentation by Jordi Delgado on the LST analysis school in January 2022 [https://indico.cta-observatory.org/event/3687/contributions/31926/attachments/20648/28909/jdelgado_LST_Software_School_Jan2022.pdf].
Line 12: Line 12:
 
==Accessing LST data through the web: exploration and download==
 
==Accessing LST data through the web: exploration and download==
  
URL: [https://lstcam.data.pic.es https://lstcam.data.pic.es]
+
URL: [https://data.lstcam.pic.es/ https://data.lstcam.pic.es/]
  
Credentials: using your CTA Consortium account. If you are note yet registered as CTA member, clarify with your supervisor and request a CTA account.
+
Credentials: either your PIC account (see next section) or using your CTA Consortium account. If you are note yet registered as CTA member, clarify with your supervisor and request a CTA account. To use the CTA credentials, click on "Login via OpenID-Connect account" and then "Login via CTA-Azuredirectory"
  
 
Username: name.surname, password: “the one you defined”
 
Username: name.surname, password: “the one you defined”
  
You need to be member of the <code>lst</code> group of CTA users. If you are already LST member (you should when seeing this Wiki page), request by mail to [mailto:admin-ctan@cta-observatory.org admin-ctan@cta-observatory.org] to be added to the <code>lst</code> group.  
+
You need to be member of the <code>lst</code> group of CTA users. If you are already LST member (you should when seeing this Wiki page), request by mail to [mailto:admin-ctan@cta-observatory.org admin-ctan@cta-observatory.org] to be added to the <code>lst</code> group.
  
 
==Accessing through the command line==
 
==Accessing through the command line==
Line 28: Line 28:
 
* Access the User Interface: <code>ssh your_pic_account@ui.pic.es</code>
 
* Access the User Interface: <code>ssh your_pic_account@ui.pic.es</code>
  
* If you are a MAGIC member and have already a PIC account: You have access through mic.magic.pic.es machines. However, you need to register again at [https://www.pic.es/register www.pic.es/register] if you are not yet member of the <code>cta-lst</code> group. Indicate at registration for LST data access that you are already MAGIC member and provide your PIC user name.
+
* If you are a MAGIC member and have already a PIC account: You have access through mic.magic.pic.es machines. In case you are not yet member of the <code>cta-lst</code> group, request it by a personal email to [mailto:jordidem@pic.es Jordi Delgado (jordidem@pic.es)]
  
 
* The data is stored at <code>/pnfs/pic.es/data/cta/LST/Data/</code>.
 
* The data is stored at <code>/pnfs/pic.es/data/cta/LST/Data/</code>.
 
  
 
=Access to data from CNAF=
 
=Access to data from CNAF=
  
 
to be continued...
 
to be continued...

Latest revision as of 08:47, 14 March 2024

Back to Main page

This page is to explain how to download data if you prefer to work outside the LP IT cluster (see Working at the LST-IT center instead).

Please avoid to copy large data directly from the La Palma IT cluster, as LST is charged for each transferred byte. Instead, copy the data from PIC or CNAF (if already having been automatically transferred) or work directly on the LP cluster.

This how-to is based on the presentation by Jordi Delgado on the LST analysis school in January 2022 [1].


Access to data from PIC[edit]

Accessing LST data through the web: exploration and download[edit]

URL: https://data.lstcam.pic.es/

Credentials: either your PIC account (see next section) or using your CTA Consortium account. If you are note yet registered as CTA member, clarify with your supervisor and request a CTA account. To use the CTA credentials, click on "Login via OpenID-Connect account" and then "Login via CTA-Azuredirectory"

Username: name.surname, password: “the one you defined”

You need to be member of the lst group of CTA users. If you are already LST member (you should when seeing this Wiki page), request by mail to admin-ctan@cta-observatory.org to be added to the lst group.

Accessing through the command line[edit]

  • At registration, request to be part of the cta-lst group at PIC.
  • Access the User Interface: ssh your_pic_account@ui.pic.es
  • If you are a MAGIC member and have already a PIC account: You have access through mic.magic.pic.es machines. In case you are not yet member of the cta-lst group, request it by a personal email to Jordi Delgado (jordidem@pic.es)
  • The data is stored at /pnfs/pic.es/data/cta/LST/Data/.

Access to data from CNAF[edit]

to be continued...