[Cdf_production_farm] fncdfsrv0 JID 102010 summary

cdfcaf at fnal.gov cdfcaf at fnal.gov
Sun Sep 17 21:14:31 CDT 2006


CAF  : fncdfsrv0
JID  : 102010
User : cdfprd
Group: long Limit: 72:00:00
DH   : None

Segment number from 1 to 24
Initial command: ./cdfopr/farm/start_loader --station=cdf-fncdfsrv0 --dataset=CalibExe_1_gphysr_223119_223119 --project=cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559 --exec_script=./cdfopr/farm/do_exe.sh --setup_script=./Production/calib/CalibExe.sh --verbose=1 -x FCP_USER=cdfopr -x FCP_HOST=fcdfdata125.fnal.gov -x FCP_PATH=/export/data1/cdfopr/current/streamg -x CALIB_PASS_NAME=10A -x CALIB_PARM_SET=Pass10Prod -x prodPass=1 -x FCP_PATH=/export/data1/cdfopr/current/streamg -x FCP_USER=cdfopr -x FCP_HOST=fcdfdata125.fnal.gov -x FCP_HIST= -x FCP_LOGS=logs -x FCP_META=logs -x FCP_CRASHED=logs -x OUTPUTFILELIST=./Production/calib/CalibExe_streamg_outputs.lst --job=$ 
Output file    : cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559.$.tgz
Submitted   : Sun Sep 17 13:47:14 2006
Ended       : Sun Sep 17 21:14:05 2006
Job duration:   7:26:51

     Wait times:       Max   	     Min    	Abs.Avg.	Start Avg.
	       :     0:07:22 	    0:01:54 	  0:00:18 	  0:00:13

  Segment times:      Total  	      Mean  	     RMS	     Max
	   Real:    56:47:00 	    2:21:57 	  1:53:07 	  7:23:07
	    CPU:     9:23:47 	    0:23:29 	  0:57:02 	  2:54:20
IO Data summary:
	 WaitDH:     0:00:04 	    0:00:01 	  0:00:00 	  0:00:02
	   Read:     3045.1M 	    1015.0M 	     2.7M 	  1017.1M

Datasets: local

                                                   #Segments
                                                   ---------
Completed with exit status = 0 (OK):                   3
Completed with exit status != 0:                      16
Completed, output lost         :                       5



segment      node        exit      Wait     Real     CPU    WaitDH        Read      Written  
      1 fncdf256.fnal.gov  61696   0:03:09  0:12:35  0:02:28                                   
      2 fncdf257.fnal.gov  61696   0:01:54  0:10:51  0:02:23                                   
      3 fncdf258.fnal.gov  61696   0:01:55  0:10:33  0:02:24                                   
      4 fncdf258.fnal.gov  61696   0:02:08  2:58:57  0:02:32                                   
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102010.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559.4.tgzfailed:rcp: lost connection

Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_4-102010.tgzfailed:kshd: Permission denied.

rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_4-102010.tgzfailed:kshd: Permission denied.


      5 fncdf258.fnal.gov  61696   0:02:20  3:04:50  0:02:27                                   
      6 fncdf300.fnal.gov  61696   0:02:15  2:53:11  0:02:30                                   
      7 fncdf260.fnal.gov  61696   0:02:13  2:59:01  0:02:20                                   
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102010.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559.7.tgzfailed:rcp: lost connection

Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_7-102010.tgzfailed:kshd: Permission denied.

rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_7-102010.tgzfailed:kshd: Permission denied.


      8 fncdf301.fnal.gov  61696   0:02:49  3:04:41  0:02:27                                   
      9 fncdf260.fnal.gov  61696   0:03:22  2:57:10  0:02:19                                   
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102010.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559.9.tgzfailed:rcp: lost connection

Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_9-102010.tgzfailed:kshd: Permission denied.

rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_9-102010.tgzfailed:kshd: Permission denied.


     10 fncdf270.fnal.gov  61696   0:03:21  2:57:47  0:02:23                                   
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102010.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559.10.tgzfailed:rcp: lost connection

Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_10-102010.tgzfailed:kshd: Permission denied.

rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_10-102010.tgzfailed:kshd: Permission denied.


     11 fncdf261.fnal.gov  61696   0:03:19  0:10:00  0:02:22                                   
     12 fncdf302.fnal.gov      0   0:03:36  7:23:07  2:45:09  0:00:02      1012.0M             
     13 fncdf320.fnal.gov  61696   0:06:09  3:01:17  0:02:06                                   
     14 fncdf271.fnal.gov  61696   0:05:09  0:10:00  0:02:19                                   
     15 fncdf280.fnal.gov  61696   0:05:34  0:10:00  0:02:30                                   
     16 fncdf320.fnal.gov      0   0:06:03  3:06:39  2:54:20  0:00:01      1016.0M             
     17 fncdf261.fnal.gov  61696   0:06:12  2:54:48  0:02:28                                   
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102010.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223119_223119_20060917_134559.17.tgzfailed:rcp: lost connection

Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_17-102010.tgzfailed:kshd: Permission denied.

rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_17-102010.tgzfailed:kshd: Permission denied.


     18 fncdf302.fnal.gov  61696   0:05:32  0:10:00  0:02:24                                   
     19 fncdf320.fnal.gov  61696   0:05:30  3:01:58  0:02:14                                   
     20 fncdf321.fnal.gov  61696   0:05:35  3:01:46  0:02:13                                   
     21 fncdf281.fnal.gov  61696   0:05:18  0:16:19  0:02:29                                   
     22 fncdf272.fnal.gov  61696   0:05:06  2:53:18  0:02:30                                   
     23 fncdf280.fnal.gov  61696   0:07:22  2:59:48  0:02:26                                   
     24 fncdf312.fnal.gov      0   0:07:21  5:58:24  2:54:04  0:00:01      1017.1M             

INPUT data
==========
segment  Nr.Recs  Nr.Evts  WaitDH    Open         Data   Avg.Rec  Avg.Evt  Nr.Files  Nr.Fail Datasets
     12     7471     7470  0:00:02  0:52:11      1012.0M     135k     135k        1        0 local
     16     7436     7435  0:00:01  0:11:51      1016.0M     136k     136k        1        0 local
     24     7485     7484  0:00:01  0:12:26      1017.1M     135k     135k        1        0 local
----------------------------------------------------------------------------------------------
 Total:    22392    22389  0:00:04  1:16:28      3045.1M       0k       0k        3        0 
  Mean:     7464     7463  0:00:01  0:25:29      1015.0M     136k     136k        1        0 
   RMS:       25       25  0:00:00  0:23:07         2.7M       0k       0k        0        0 
   Max:     7485     7484  0:00:02  0:52:11      1017.1M     136k     136k        1        0 


More information about the Cdf_production_farm mailing list