Day shift. Tue Mar 2, 2004 (185/185)

2004 CDF E-Log -- Day shift. Tue Mar 2, 2004
SciCo	DAQ Ace	Monitoring Ace	CO	(Operations Manager)
Rainer W.	Tom S.	Susana C.	Franco S.	Mary C.

Start of Shift Notes:

Tev in quench recovery. D0 in access for 8 hours. CDF in access. 

Plan: - Roser investigates flipping the gas flow of the COT. 
      - reboot online database, webserver, central file system 
        some time (Frank C.) 
      - disable access to b0dau30 (Frank C.) 
      - L2 fibre splitting ?

Tue Mar 2 08:24:53 CDF cryo tells us solenoid is down. - Rainer

Tue Mar 2 08:29:23 There was a problem with converter 7. When aces try to use the rest of the farm (excluding that subfarm #7), run control settings didn't work (apparently), and the couldn't make any run. It was needed to mark it off-line to check the rest was ok.
c07 seems to be ok now after rebooting it (I can see some complains related to atm and nickstar in /var/log/messages file), and I have already included. The whole L3 farm is available for your entertainment. ^_^ - Guillelmo

Tue Mar 2 08:31:13 Run 179523 ACTIVATE: L3 Test. junk data. - Tom x2080

Tue Mar 2 08:31:14 Run 179523 TERMINATE: L3 Test. Junk Data. All works now. - Tom x2080

Tue Mar 2 08:34:58 Run 179524 ACTIVATE: CLC QIE Calib. - Tom x2080

Tue Mar 2 08:35:40 Run 179524 TERMINATE: CLC QIE Calib. In response to bad cal first time around. - Tom x2080

Tue Mar 2 08:49:28

Reset ADMEMS For CLC Cal.  Nice way to do this is the following (thanks to Rainer): 

1. ssh b0dap10 (need a kerb ticket) 
2. minicom b0clc00 
3. VISIONdemo and just hit enter when asked for IP 
4. option 9 
5. option 10 
6. watch it reset everything 
7. hit CTRL-A then hit Z 
8. X for exit out of minicom

- Tom

Tue Mar 2 08:59:52 Run 179525 ACTIVATE: Calorim QIE Calib. - Tom x2080

Tue Mar 2 09:00:26 Run 179525 TERMINATE: Calorim. QIE Calib. - Tom x2080

Tue Mar 2 09:04:41 there was COT 02 analyzer alarm - we called cryo and were told it was related to the roser show in the collision hall. - rainer

Tue Mar 2 09:06:08 Roser et al come out of the collision hall and they carry a big piece of COT plumbing with them - is there still something down there ? - rainer
-- Tue Mar 2 09:20:06 comment by...convery -- Sorry, Rob asked me to make an entry saying that they were successful with the plumbing for reversing the COT gas flow.
-- Tue Mar 2 09:23:10 comment by...convery -- The COT should remain off for 2 gas volume exchanges (about 30 hours).

Tue Mar 2 09:14:07 spurious IMU 02 alarm which cleared itself momentarily. - rainer

Tue Mar 2 09:25:06 relief CO Franco S. - his phone number is x5013. - Rainer

Tue Mar 2 09:55:50 from the Run Coordinator elog:

09:43:35- The Tevatron quench was caused by the RF not changing frequency during the ramp. In other words, the magnet current increased but the energy of the beam wasn't increased synchronously as it is supposed to. Beam was displaced to the inside of the momentum aperture, eventually hitting the magnets. Experts are invstigating why the RF did not play properly, but we should be able to demonstrate things are working again prior to the next transfer. - JPM
- convery
-- Tue Mar 2 10:35:36 comment by...Rainer -- was this the same RF station which acted up earlier?
-- Tue Mar 2 10:39:03 comment by...ronmoore -- No...the RF voltage was fine for all cavities. The RF frequency did not change to match the ramp of the bend bus. (Frequency/phase is controlled by a special processor.)

Tue Mar 2 10:30:33 Frank and Sergei will start working on the database. there will be a brief period of unavailable file server during reboot as well - they reserve 1 hour starting 10:45am. - rainer
-- Tue Mar 2 10:52:41 comment by...rainer -- 10:45am online computers momentarily freeze.
-- Tue Mar 2 11:22:15 comment by...Rainer -- one file server does not come up. DAQ needs more time.

Tue Mar 2 10:54:46 trip of CMU, then overvoltage condition. apparently, an expert is working on it. - rainer
-- Tue Mar 2 11:05:55 comment by...ps -- correct

Tue Mar 2 11:05:12

 
Standing requests:

CHA laser calibration when solenoid is up - Fotis x5624. 
Plug laser calibration - solenoid ?       - Diego x4228.

Currently, DAQ is busy. - Rainer
-- Tue Mar 2 11:08:42 comment by...rainer -- meaning, DAQ people are working on online computers.
-- Tue Mar 2 12:31:22 comment by...Fotis -- My number is x4624

Tue Mar 2 11:06:35 I made some timing studies of the HV ramps of the muon chambers and the argonne chambers. I'm done now. - ps
-- Tue Mar 2 15:19:46 comment by...ps -- standby->on: CMP 2:14, CMX 1:43, CMU 1:18, BMU :56, CES :32, CPR :32, CCR :25; on->standby: CMU 5:34, CMX 1:00, CMP :51, CPR :39, CCR :33, BMU :31, CES :28

Tue Mar 2 11:18:06

fibre splitting work - no L2 - need DAQ/L2 torture - Burkhard, Dervin.

XTRP standalone test after fibre test. - Anyes. - Rainer
-- Tue Mar 2 11:18:50 comment by...rainer -- Burkhard and Dervin start splittin' da fibres.

Tue Mar 2 11:46:50 In preparation for splitting L2 muon fiber signals, we have rearranged CLIST fibers 3-5 in different splitters. There should be no effect no the system. F.L.W. - jdl & Burkhart
-- Tue Mar 2 11:59:12 comment by...rainer -- CLIST re-arrangement is done. would like to checkout with DAQ, but DAQ currently unavailable. after lunch, will split muon fibers.

Tue Mar 2 12:05:25 b0dap29 (Scico terminal) nosedived. now back on. - Rainer

Tue Mar 2 12:17:28 still have pending access request of silicon (need DAQ up). called D0. estimation of end of shutdown still between 2pm - 4pm. things seem to go well over there, timewise. - rainer

Tue Mar 2 12:18:05 Anyes calls - she wants to be called x 3899 once fibre splitter work is finished. - rainer

Tue Mar 2 12:20:04 DAQ back up. patching things back together ... - rainer

Tue Mar 2 12:30:23

We have a heart-beat alarm in ICICLE. It re-started it.

- Susana.

Tue Mar 2 12:34:24 COT 02 spurious GAS alarm. some manual testing/sampling being done in cryo area. - Rainer

Tue Mar 2 12:41:45 Solenoid coming up, will take about 45 min - convery

Tue Mar 2 12:42:35

solenoid should be up in 45min.

- rainer

Tue Mar 2 12:56:30 Run 179526 ACTIVATE: L2 Torture. - Tom x2080

Tue Mar 2 13:15:00

List of pending requests:

what	who	phone	resources	time estimate
Silicon access	Florencia et al	6880	DAQ up, silicon crates	2 hrs
L2 torture for CLIST fibre test	Burkhard	2080	L2, SVT,XTRP,CALO, CALO TRIG, DAQ no L3	30min
splitting muon fibres	Burkhard	2080	L2 crates	30min
L2 torture for muon fibre test	Burkhard	2080	L2, SVT,XTRP CALO TRIG, DAQ no L3	30min
XTRP standalone	Anyes	3899	XTRP	no estimate given
Plug laser calibration standalone	Diego Cauz	4228	Plug crates, b0puls01, Plug hadron TDC Plug HV on	~ hr
CHA laser calibration	Fotis	4624	b0puls01, CHA,CCAL,WCAL,L3,EVB Solenoid up	15min

- Rainer

Tue Mar 2 13:19:56 Run 179526 TERMINATE: L2 Torture. - Tom x2080

Tue Mar 2 13:33:10 David Clark et al (silicon optical fibre work) are out of the collision hall. Florencia and Stefano still working on FFO firmware upgrade. - rainer

Tue Mar 2 13:34:46

After the restart of all DAQ computers all DAQ processes are up and running.....i
hope...

- Tom

Tue Mar 2 13:36:55 Diego beginning laser calibration of plug - Plug HV ON. - rainer

Tue Mar 2 13:38:23

Due to calibration purposes, we turn  on the HV for plug (PEM,PHA,PSH)

- Susana.
-- Tue Mar 2 13:41:30 comment by...Susana. --

Crate 2 PEM in error for 5 seconds, very brief alarm in the CDF global alarms gui

Tue Mar 2 13:40:27 Run 179527 ACTIVATE: Plug Laser Cal. BOTHPLUGS_NORMAL - Tom x2080

Tue Mar 2 13:47:14 Run 179527 TERMINATE: Plug Laser Calib. BOTHPLUGS_NORMAL - Tom x2080

Tue Mar 2 13:49:12 Run 179528 ACTIVATE: Plug Laser Calib. BOTHPLUGS_MM_C - Tom x2080

Tue Mar 2 13:53:32 Run 179528 TERMINATE: Plug Laser Calib. BOTHPLUGS_MM_C - Tom x2080

Tue Mar 2 13:54:50 Run 179529 ACTIVATE: Plug Laser Calib. BOTHPLUGS_MM - Tom x2080

Tue Mar 2 13:55:42 Run 179529 TERMINATE: Calib Laser Aborted. - Tom x2080

Tue Mar 2 13:57:52 Run 179530 ACTIVATE: Plug Laser Calib. BOTHPLUGS_MM_C - Tom x2080

Tue Mar 2 13:59:34 Run 179530 TERMINATE: Plug Laser Calib BOTHPLUGS_MM_C - Tom x2080

Tue Mar 2 14:01:39 Run 179531 ACTIVATE: BOTHPLUGS_MM Plug Laser Calib. - Tom x2080

Tue Mar 2 14:03:36 Run 179531 TERMINATE: BOTHPLUGS_MM Plug Laser Calib. - Tom x2080

Tue Mar 2 14:10:39

Checked the QIE Calibtration as requested.  Calibration seems fine.  All Channels out of range
in Sig for last run but no black channels.  I've been asked to do this to check that dbana can
access database.  Not sure if i'm testing this correctly.

- Tom

Tue Mar 2 14:14:13 Run 179532 ACTIVATE: start of laser timing scan for plugs - diego 2081

Tue Mar 2 14:17:43 Run 179533 ACTIVATE: timing scan -20 ns - diego 2081

Tue Mar 2 14:20:14 Run 179533 TERMINATE: delay -30ns - diego 2081

Tue Mar 2 14:21:43 Run 179534 ACTIVATE: delay -30ns - diego 2081

Tue Mar 2 14:25:09 Run 179535 ACTIVATE: delay -40ns - diego 2081

Tue Mar 2 14:27:36 Run 179536 ACTIVATE: delay -50ns - diego 2081

Tue Mar 2 14:31:42 Run 179537 ACTIVATE: delay +10ns - diego 2081

Tue Mar 2 14:34:28 Run 179538 ACTIVATE: delay -5ns - diego 2081

Tue Mar 2 14:37:57 Run 179539 ACTIVATE: delay -15ns - diego 2081

Tue Mar 2 14:42:09 Run 179540 ACTIVATE: delay -25 ns - diego 2081

Tue Mar 2 14:44:39 Run 179541 ACTIVATE: delay -35ns - diego 2081

Tue Mar 2 14:47:39 Run 179542 ACTIVATE: delay -45 ns - diego 2081

Tue Mar 2 14:50:21 Run 179543 ACTIVATE: delay +5ns - diego 2081

Tue Mar 2 14:54:19 Run 179544 ACTIVATE: delay +15ns - diego 2081

Tue Mar 2 14:56:59 Run 179545 ACTIVATE: delay +20ns - diego 2081

Tue Mar 2 15:00:23 Run 179546 ACTIVATE: delay 0ns, gone back to starting delays. Scan finished. - diego 2081

Tue Mar 2 15:11:14 Run 179548 ACTIVATE: Central hadron laser run - B on - Tom x2080

Tue Mar 2 15:18:07 Diego is done. Fotis started CHA laser calibration. Bill Badgett would like to have calo crates etc. comes after fotis. - rainer

Tue Mar 2 15:20:41 elog did not accept entry any more in netscape. complained about cookies not enabled, which however isn't true (they are enabled). if this entry goes in, clearing the disk cache has helped. - rainer

Tue Mar 2 15:22:46 relieving monitoring ace who was dangerously getting close to getting bored to death. she owes friendly DAQ ace who is willing to take over monitoring. - rainer

Tue Mar 2 15:23:31 Run 179548 TERMINATE: Terminate central hadron laser run - Tom x2080