[Cdf_production_farm] fncdfsrv0 JID 102059 summary

cdfcaf at fnal.gov cdfcaf at fnal.gov
Sun Sep 17 20:56:20 CDT 2006


CAF  : fncdfsrv0
JID  : 102059
User : cdfprd
Group: long Limit: 72:00:00
DH   : None

Segment number from 1 to 17
Initial command: ./cdfopr/farm/start_loader --station=cdf-fncdfsrv0 --dataset=CalibExe_1_bphysr_223118_223118 --project=cdfprd_cdf-fncdfsrv0_CalibExe_1_bphysr_223118_223118_20060917_142907 --exec_script=./cdfopr/farm/do_exe.sh --setup_script=./Production/calib/CalibExe.sh --verbose=1 -x FCP_USER=cdfopr -x FCP_HOST=fcdfdata125.fnal.gov -x FCP_PATH=/export/data1/cdfopr/current/streamb -x CALIB_PASS_NAME=10A -x CALIB_PARM_SET=Pass10Prod -x prodPass=1 -x FCP_PATH=/export/data1/cdfopr/current/streamb -x FCP_USER=cdfopr -x FCP_HOST=fcdfdata125.fnal.gov -x FCP_HIST= -x FCP_LOGS=logs -x FCP_META=logs -x FCP_CRASHED=logs -x OUTPUTFILELIST=./Production/calib/CalibExe_streamb_outputs.lst --job=$ 
Output file    : cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamb/Cafoutdir/CalibExe.cdfprd_cdf-fncdfsrv0_CalibExe_1_bphysr_223118_223118_20060917_142907.$.tgz
Submitted   : Sun Sep 17 14:30:20 2006
Ended       : Sun Sep 17 20:54:30 2006
Job duration:   6:24:10

     Wait times:       Max   	     Min    	Abs.Avg.	Start Avg.
	       :     0:05:23 	    0:01:16 	  0:00:19 	  0:00:14

  Segment times:      Total  	      Mean  	     RMS	     Max
	   Real:    40:44:19 	    2:23:47 	  1:48:49 	  6:20:38
	    CPU:    12:33:55 	    0:44:20 	  1:26:11 	  3:59:12
IO Data summary:
	 WaitDH:     0:00:04 	    0:00:01 	  0:00:00 	  0:00:01
	   Read:     4056.8M 	    1014.2M 	   441.7M 	  1261.8M

Datasets: local

                                                   #Segments
                                                   ---------
Completed with exit status = 0 (OK):                   4
Completed with exit status != 0:                      12
Completed, output lost         :                       1



segment      node        exit      Wait     Real     CPU    WaitDH        Read      Written  
      1 fncdf253.fnal.gov  61696   0:01:50  2:22:59  0:02:19                                   
      2 fncdf256.fnal.gov  61696   0:01:46  2:12:26  0:02:23                                   
      3 fncdf257.fnal.gov  61696   0:01:40  0:10:00  0:02:19                                   
      4 fncdf258.fnal.gov  61696   0:01:16  2:16:16  0:02:20                                   
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamb/Cafoutdir/CalibExe-102059.cdfprd_cdf-fncdfsrv0_CalibExe_1_bphysr_223118_223118_20060917_142907.4.tgzfailed:rcp: lost connection

Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_4-102059.tgzfailed:kshd: Permission denied.

rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_4-102059.tgzfailed:kshd: Permission denied.


      5 fncdf257.fnal.gov  61696   0:01:37  0:10:00  0:02:25                                   
      6 fncdf300.fnal.gov  61696   0:03:50  0:10:01  0:02:22                                   
      7 fncdf261.fnal.gov      0   0:03:25  6:20:38  3:59:12  0:00:01      1261.8M             
      8 fncdf271.fnal.gov  61696   0:03:50  2:18:47  0:02:17                                   
      9 fncdf280.fnal.gov  61696   0:03:27  2:09:07  0:02:21                                   
     10 fncdf302.fnal.gov  61696   0:03:54  2:18:22  0:02:29                                   
     11 fncdf302.fnal.gov  61696   0:03:58  0:10:00  0:02:22                                   
     12 fncdf262.fnal.gov  61696   0:03:52  2:17:42  0:02:34                                   
     13 fncdf281.fnal.gov      0   0:03:33  3:44:52  0:55:32  0:00:01       352.3M             
     14 fncdf290.fnal.gov      0   0:03:55  3:32:08  3:20:51  0:00:01      1221.9M             
     15 fncdf262.fnal.gov  61696   0:04:04  2:09:12  0:02:30                                   
     16 fncdf263.fnal.gov      0   0:03:25  6:06:53  3:47:08  0:00:01      1220.8M             
     17 fncdf303.fnal.gov  61696   0:05:23  2:14:56  0:02:31                                   

INPUT data
==========
segment  Nr.Recs  Nr.Evts  WaitDH    Open         Data   Avg.Rec  Avg.Evt  Nr.Files  Nr.Fail Datasets
      7     7088     7087  0:00:01  0:15:29      1261.8M     178k     178k        1        0 local
     13     2130     2129  0:00:01  0:08:04       352.3M     165k     165k        1        0 local
     14     7191     7190  0:00:01  0:11:15      1221.9M     169k     169k        1        0 local
     16     7002     7001  0:00:01  0:13:30      1220.8M     174k     174k        1        0 local
----------------------------------------------------------------------------------------------
 Total:    23411    23407  0:00:04  0:48:18      4056.8M       0k       0k        4        0 
  Mean:     5852     5851  0:00:01  0:12:04      1014.2M     171k     171k        1        0 
   RMS:     2483     2483  0:00:00  0:03:10       441.7M       5k       5k        0        0 
   Max:     7191     7190  0:00:01  0:15:29      1261.8M     178k     178k        1        0 

OUTPUT data
===========
segment  Nr.Recs  Nr.Evts   Open         Data   Avg.Rec  Avg.Evt  Nr.Files
      7      154      142  1:02:00        25.5M     165k     179k        4
     13       39       28  0:32:30         4.0M     103k     143k        4
     14      128      113  0:45:00        18.2M     142k     161k        4
     16      111      100  0:54:08        17.6M     158k     175k        4
----------------------------------------------------------------------------------------------
 Total:      278      241  2:11:38        39.8M       0k       0k       12
  Mean:       92       80  0:43:52        13.3M     134k     160k        4
   RMS:       47       45  0:10:51         8.0M      28k      16k        0
   Max:      128      113  0:54:08        18.2M     158k     175k        4


More information about the Cdf_production_farm mailing list