Logbook TestsCalibrationAtIAC-2017

From my_wiki
Jump to: navigation, search

Enter comments in reverse time order[edit]

Date Who did it? Action Comments Documents
2017-09-22 Alicia, Pepa, Taka, Yusuke Shipping All arrived in Mirka without any problem!! We are done!!
2017-09-21 Alicia, Taka, Yusuke Shipping All stuff were put into container with a fork lifter. Everything went smoothly. Now Sala AIV is empty!!
2017-09-20 Alicia, Taka, Yusuke Packing We built the last module tower in rush. 8 towers were successfully put into the wooden box by mechanical engineers and the transportation company. Everything is ready for shipping!!
2017-09-19 Alicia, Taka, Yusuke Packing We built 4 more module towers. The wooden frame for mirror was also built. Dark box frame and panels were also well packed.
2017-09-18 Alicia, Taka, Yusuke Packing We established the way of module rack packing. We built 3 towers.
2017-09-16 Taka, Yusuke LGs We put LG bases for all modules. All modules in 10 racks are screwed onto the racks. 2.5 more to go. (its saturday today!)
2017-09-15 Taka, Pepa, Yusuke Packing Silica Gel finally arrived. All polystyrene boards are cut in right size. But we realized that we need to make dips on the boards for latch of the racks. Higinio agreed to make them. Packing carton boxes has started.
2017-09-14 Pepa LG base It was a holiday in LaLaguna, but Pepa worked for LG base... Thank you!
2017-09-13 Taka, Pepa, Yusuke Dismantling Dark Box and putting LGs Dark box was successfully dismantled. LG base was finally delivered and we put them for 3 racks.
2017-09-12 Taka, Pepa, Yusuke Packing and Module QC Right polystyrene delivered. Out of 40, 12 are already cut to make right size. Module QC also worked. Dark box was started to be dismantled. Packing small boxes has started. We ordered 16 belt needed for crane. Only worries are missing LGs and Silica Gel. We hope they will arrive in time.
2017-09-11 Taka, Pepa, Yusuke Packing and Module assembly Yusuke arrived. Formed polystyrene delivered from Leroy Merlin had a wrong thickness. They will deliver the right one tomorrow. Yusuke build 5 new modules. QE of them are not known. But performance should be fine. QC script didn't work well.
2017-09-08 Taka, Pepa Packing In the end, we asked Oscar to buy Silica Gel from RS and send them to IAC with express packet. Let's see. We bought film (8 rolls), sheet (8) and foamed polystyrene (40). They should be enough to wrap 8 towers. 3 spaniards left IAC.
2017-09-07 Taka, Pepa, Crhistobal Packing Bought plastic film. Basic idea of packing is established, (foamed polystyrene, plastic sheet, and then film. We realized that Silica Gel cannot be bought in this island. Even in online, delivery takes more than 10 days. Big problem.
2017-09-06 Taka, Alicia Packing Went to Leroy Merlin to buy plastic sheet and foamed polystyrene for packing.
2017-09-05 Taka, Alicia, Chirstobal, Luis Angel, Pablo Packing Studied how to pack the module racks to prevent humidity during shipping.
2017-09-05 Cristobal, Luis Angel, Pable TIB, UCTS, White Rabbit The DHCP problem is solved. Now things are working fine.
2017-09-05 Taka Accident To study the 0 problem, one modules was taken out (ID007) from position 18. After some time we needed to put one module in the missing place. But we forgot to power off the camera. As a result, the fuse of the Dragon is blown (ID 207). Sorry for the mistake. Now ID 208 is there.
2017-09-04 Cristobal, Luis Angel, Pable TIB, UCTS, White Rabbit They arrived. Tried to setup white Rabbit switch, UCTS. UCTS needs DHCP server to get IP. Osaka was configured as DHCP but it did not work.
2017-09-04 Tsutomu Cross talk Cross talk of PMT is less than 0.5 %. https://drive.google.com/open?id=0B0PR0tNrCVoWX0ZOaV9rcU1WQjg
2017-09-01 Takayuki Dragon firmware Taka reproduced the zero problem (some dragons send only 0 ADC values after some events).
2017-09-01 Alicia, Takayuki Climate Chamber test We made again 2 Sum Trigger runs. This time successful. Behavior of SumT is fine. Only IPR and Majority trigger is affected. Majority Trigger is more sensitive than IPR to the temperature.
2017-09-01 Gustavo BP calibration 3 delays, Clock phase, L1 trigger and camera trigger were successfully calibrated. Differences between modules are less than 1 ns. Gustavo left IAC with one Dragon and one Ethernet switch.
2017-08-31 Alicia, Takayuki Climate Chamber test We made 3 runs, 1 Majority trigger and 2 Sum Trigger. But it turned out later that the sum trigger runs were unsuccessful. Taka's pc went to sleep mode and communication was lost.
2017-08-30 Takayuki Climate Chamber test Two module set up is well configured. Tomor

row we check trigger propagation and Majority trigger with ClimateChamber. ||

2017-08-29 Gustavo BP calibration 10 MHz clocks were time-equalized within 1 ns. Gustavo found that mezzanine (L0 037 L1 066) had problem in reading register value. Writing seems not be a problem.
2017-08-29 Takayuki Climate Chamber test Softwares (ClusCo and Analysis). Taka found that L0 delay initialization from ClusCo doesn't work from his laptop (ubuntu on mac), although rbcp itself worked.
2017-08-28 Takayuki Daisuke Climate Chamber test Softwares (ClusCo and Analysis) https://drive.google.com/open?id=0B6V4naKAxXfUcDZnaGdGR09EWWs
2017-08-28 Takayuki Daisuke Tsutomu Alicia Gustavo Climate Chamber test The central BP (BPV3 S481500038) removed from the minicamera setup to be tested in the climate chamber. Instead, the BP who was at #3 is moved to the center, one of the spare BP Gustavo brought here is installed at #3.
2017-08-28 Takayuki New leader Takayuki has arrived
2017-08-24 Daisuke, Alicia, Gustavo Climate Chamber test We repeated the measurement in the climate chamber with the same and with a new mezzanine. Most probably the instability in IPR rates is originated somewhere in the copied L0 line of mezzanines. short summary
2017-08-24 Leyre Gustavo Calibration Confirmation that binary search is working properly. We confirm also that the TP input signals are measured as expected. We started checking L0 timing calibration procedure.
2017-08-24 Tsutomu Daisuke Cross Talk We took some data with ROI=200
2017-08-23 Daisuke, Alicia, Gustavo Climate Chamber test we observed that IPRs were very unstable when the ambient temperature is as high as 40 deg. short summary
2017-08-22 Leyre, Gustavo Trigger Calibration We reviewed the algorithm of the binary search because there was a bug in the previous version. We tested it in the camera and found some other bugs to be corrected.
2017-08-22 Daisuke Alicia Tsutomu Gustavo Climate Chamber We will be performing the same test tomorrow with one of the spare trigger mezzanine. Gustavo made a good configuration setting of BP such that BP propagate back L1 to its own
CONFIGURE_BP 1 12 0x0099 
CONFIGURE_BP 1 11 0xFFFF
CONFIGURE_BP 1 11 0x0000
CONFIGURE_BP 1  3 0x0000 
CONFIGURE_BP 1  4 0x0000 
CONFIGURE_BP 1  5 0x0000 
CONFIGURE_BP 1  6 0x8001 
CONFIGURE_BP 1  8 0x0000 
CONFIGURE_BP 1 10 0x0000
CONFIGURE_BP 1 24 0x0000
2017-08-22 Daisuke Alicia Tsutomu Climate Chamber We performed the test Temperature
HV
TP charge
2017-08-21 Alicia, Daisuke, Tsutomu Climate Chamber We have configured the climate chamber as follows, 1) go to 60 degree over 1 hour (~0.5deg/sec), 2) stay at 60 deg. for 10 min, 3) go down to 20 deg. in 45 min (~1deg/min). We have prepared a script which, 1) Take TP data (1000events), 2) turn ON HV (@1000V), 3) wait for 1min, 4) turn OFF, 5) wait for 1min, during the entire period. Fundamental pedestal table (with Taka's old method )was created just before we start the test. Experiment was successful however, due to the power-saving setting of Daisuke's macbook pro, monitoring was done only some partial time,,, we will repeat tomorrow again the same test TemperatureLog of the chamber
SCB temperature
HV val
TP charge
Link down at 12:46 ( at 11:46 in UTC)
2017-08-21 Gustavo A new comer Gustavo has joined to the IAC crew
2017-08-21 Leyre L1 problem in cluster 9 L1 adder of cluster 9 can not be reseted.
2017-08-17 Daisuke, Tsutomu Strange data Something is strange Short Summary
2017-08-16 Leyre, Christobal, Daisuke, Tsutomu Calibration Debugging of the Barcelona software for the calibration
2017-08-14 Daisuke, Tsutomu Analysis Analysis of cross-talk data (Tsutomu) and EVB data(Tsutomu + Daisuke) on going.
2017-08-14 Daisuke, Tsutomu Climate Chamber Test Necessary softwares (e.g. ClusCo etc.) are installed into Daisuke's laptop virtual machine(SL6). Scripts are more or less ready.
2017-08-11 Daisuke, Tsutomu, Alicia Cross Talk study We several sets of data for studying cross talk.
2017-08-10 Daisuke, Tsutomu, Alicia Dragon firmware We flushed old firmware to all Dragon boards. Fundamental Pedestal table look very healthy.
2017-08-10 Daisuke, Tsutomu, Alicia Strange Fundamental Pedestal table Something must be wrong. https://drive.google.com/open?id=0B6V4naKAxXfULVpHMElVaU1OQ2M
2017-08-10 Daisuke, Tsutomu, Alicia TIB setting Following three lines added in test_python_script.sh
python ${py_dir}/disable_software_trigger.py 
python ${py_dir}/disable_mono.py
python ${py_dir}/disable_slow_control_trigger.py

It seems the initial ModeMask setting has changed in the new TIB firmware, and we need to explicitly disable SOFT/MONO/SLOW triggers when we want to use AUTOPEDESTAL trigger

2017-08-10 Daisuke, Tsutomu, Alicia Climate Chamber We have visited IAC climate chamber room, and explained what we want to do to the person responsible. We reserved the room on 21st, 22nd, temperature range 20 deg. to 60 deg, 10deg step, 1 hour per step,humidity 15% (or lower). https://drive.google.com/open?id=0B6V4naKAxXfUQ1hNQUJrUnZ0b0U

Manual
2017-08-09 Daisuke, Tsutomu, Riccardo Byte swap Here is the data header of the first event of one dragon event with the newest dragon firmware V5-1-0d
aaaa 0000 8c15 000f 0001 0000 0001 0000
4bcd 00cf 0000 0000 dddd dddd dddd dddd

Event/trigger numbers are both "0001 0000". Is this what we wanted?
In order to express 1,
Before : 0100 0000
After the byte swap (current situation) : 0001 0000
We thought it would have been: 0000 0001

This was our misunderstanding, sorry.
2017-08-09 Daisuke, Tsutomu, Riccardo Cross Talk measurement In order to investigate cross talks, we prepared a mask to cover all modules except the central one. https://drive.google.com/open?id=0B6V4naKAxXfURmxzWjNNWExvU3M
2017-08-08 Dirk, Daisuke Tsutomu EVB Plots to demonstrate the importance of timeout duration, fast re-transmission option (still preliminary, more data points with slightly different condition will be added) https://drive.google.com/open?id=0B6V4naKAxXfUajN3X3FFbkYtNVU
2017-08-08 Dirk, Daisuke Tsutomu OPCUA Following host names added in /etc/hosts for convenience
 
10.1.0.54    okinawa-10g-1
10.1.11.201  okinawa-10g-2
10.1.12.201  okinawa-10g-3
10.1.0.250   okinawa-1g

10.1.0.83    tib
2017-08-08 Dirk, Daisuke Tsutomu OPCUA A small problem we found is reported https://forge.in2p3.fr/issues/20103
2017-08-08 Dirk, Daisuke Tsutomu Strange Triggers?? We can not reproduce the strange behaviour we saw yesterday... An email sent from Daisuke to the email thread [climate chamber at IAC]
2017-08-08 Dirk, Daisuke Forgotten NIC Dirk forgot to bring back their 2×10Gb NIC from okinawa. We should keep track of them. If really necessary, they will ask us to ship them.
2017-08-07 Dirk, Daisuke Tsutomu, Riccardo Additional Dragon setting wrb 0xFFFFFF10 3
(Enables fast re-transmission)

wrs 0xFFFFFF2E 1
(Set time-out duration to 1ms)
Temporally we are doing like as follows, but should be implemented in future in ClusCo.
for i in $(scanIP | \
awk '/Bee.Beans/ {print $1}')
do  
    rbcp $i 4660 << EoCommands
 rd 0xFFFFFF10 1
 wrb 0xFFFFFF10 3
 rd 0xFFFFFF10 1
 rd 0xFFFFFF2E 4
 wrs 0xFFFFFF2E 1
 rd 0xFFFFFF2E 4
 quit

EoCommands
    echo Done for $i

done
2017-08-07 Dirk, Daisuke Strange Triggers?? We discovered today that sometime module 14,15 and 18 created ~4 MHz of L1 external triggers by its own when temperature is high. Very strange behaviour, need to be investigated further. Attached are screenshots, we have injected periodic trigger at 1kHz, but only some modules got very high trigger rate. https://drive.google.com/open?id=0B6V4naKAxXfUTl8xcXR4VXYzY0k https://drive.google.com/open?id=0B6V4naKAxXfUeVdlNF9vLXlVZ1E
2017-08-07 Dirk, Daisuke Tsutomu, Riccardo EVB Implementation of OPC/UA https://drive.google.com/open?id=0B6V4naKAxXfUTnRJeWVYamV1bDg
2017-08-04 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB Cold start Daisuke can start EVB from the beginning. HowToRunEVB
2017-08-04 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test Two 10GSFP+ links from the switch to the camera server. we could take up to 88 kHz periodic trigger!
2017-08-04 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test Throughput measurements with Random/Poisson triggers, FastRetransmission option, Timeout duration https://docs.google.com/spreadsheets/d/1hc_JQFFzJYI-o9oFybhmTCVDvkSL2t5UxaX7MgLj9qs/edit?usp=sharing
2017-08-03 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test Julien found an interesting SiTCP option :Fast retrains, second bit of the address 0xFFFFFF10. (Default is off). With this option re-transmission time is automatically optimised!
2017-08-03 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test We understood the SiTCP parameter for the timeout duration of re-transmission (0xFFFFFF2E). This should be optimised with respect to the real RTT
2017-08-03 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test Dragon buffer size consistent with Takayuki's report 88 events
2017-08-03 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test No event/trigger number mismatch both with periodic and poissonian triggers. TIB new firmware seems good
2017-08-02 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test Ramdisk installe, 2GB/s of writing speed
2017-08-02 Dirk, Julien, Daisuke Tsutomu, Riccardo see https://forge.in2p3.fr/issues/19976
2017-08-02 Dirk, Julien, Daisuke Tsutomu, Riccardo EVB test Closing procedure confirmed. Just closing socket is enough.
2017-08-02 Dirk, Julien, Daisuke Tsutomu, Riccardo Okinawa Installed one more x520 to have a connection between okinawa and osaka
2017-08-02 Dirk, Julien, Daisuke Tsutomu, Riccardo Okinawa Isocpu setting of CPU, all cores except 0,2,4,6,8,10 are isolated to be used only for EVB
2017-08-02 Dirk, Julien, Daisuke Tsutomu TIB firmware Updated to the newest one
2017-08-01 Dirk, Julien, Daisuke Tsutomu EVB test We managed to take data at the periodic trigger rate of 46.3 kHz.
2017-08-01 Dirk, Julien, Daisuke Tsutomu EVB test The new dragon firmware (dv5_1_0d_00, byte swapped) flushed to all modules
2017-07-31 Alicia et al MiniCamera setup 19 modules are mounted, 2 without trigger mezzanine google doc
2017-07-28 Mazin Created this page Juan Calvo issued entrance permits for all participants of the tests