[Cdf_production_farm] fncdfsrv0 JID 102024 summary
cdfcaf at fnal.gov
cdfcaf at fnal.gov
Sun Sep 17 19:42:04 CDT 2006
CAF : fncdfsrv0
JID : 102024
User : cdfprd
Group: long Limit: 72:00:00
DH : None
Segment number from 1 to 17
Initial command: ./cdfopr/farm/start_loader --station=cdf-fncdfsrv0 --dataset=CalibExe_1_gphysr_223120_223120 --project=cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223120_223120_20060917_134717 --exec_script=./cdfopr/farm/do_exe.sh --setup_script=./Production/calib/CalibExe.sh --verbose=1 -x FCP_USER=cdfopr -x FCP_HOST=fcdfdata125.fnal.gov -x FCP_PATH=/export/data1/cdfopr/current/streamg -x CALIB_PASS_NAME=10A -x CALIB_PARM_SET=Pass10Prod -x prodPass=1 -x FCP_PATH=/export/data1/cdfopr/current/streamg -x FCP_USER=cdfopr -x FCP_HOST=fcdfdata125.fnal.gov -x FCP_HIST= -x FCP_LOGS=logs -x FCP_META=logs -x FCP_CRASHED=logs -x OUTPUTFILELIST=./Production/calib/CalibExe_streamg_outputs.lst --job=$
Output file : cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223120_223120_20060917_134717.$.tgz
Submitted : Sun Sep 17 13:48:48 2006
Ended : Sun Sep 17 19:40:52 2006
Job duration: 5:52:04
Wait times: Max Min Abs.Avg. Start Avg.
: 0:06:29 0:02:09 0:00:22 0:00:15
Segment times: Total Mean RMS Max
Real: 55:49:45 3:17:02 2:08:43 5:49:31
CPU: 16:57:19 0:59:50 1:17:56 2:53:08
IO Data summary:
WaitDH: 0:00:05 0:00:00 0:00:00 0:00:01
Read: 6099.8M 871.4M 321.4M 1027.0M
Datasets: local
#Segments
---------
Completed with exit status = 0 (OK): 7
Completed with exit status != 0: 7
Completed, output lost : 3
segment node exit Wait Real CPU WaitDH Read Written
1 fncdf300.fnal.gov 61696 0:02:20 0:10:00 0:02:24
2 fncdf301.fnal.gov 61696 0:02:18 2:56:45 0:02:24
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102024.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223120_223120_20060917_134717.2.tgzfailed:/usr/krb5/bin/rcp: kcmd to host fcdfdata125.fnal.gov failed - Connection reset by peer
Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_2-102024.tgzfailed:kshd: Permission denied.
rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_2-102024.tgzfailed:kshd: Permission denied.
3 fncdf260.fnal.gov 61696 0:02:09 3:03:39 0:02:26
4 fncdf301.fnal.gov 0 0:02:23 5:49:31 2:53:08 0:00:00 1027.0M
5 fncdf270.fnal.gov 0 0:04:48 5:33:55 2:33:43 0:00:01 972.0M
6 fncdf261.fnal.gov 61696 0:04:13 2:55:26 0:02:26
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102024.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223120_223120_20060917_134717.6.tgzfailed:rcp: lost connection
Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_6-102024.tgzfailed:kshd: Permission denied.
rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_6-102024.tgzfailed:kshd: Permission denied.
7 fncdf302.fnal.gov 61696 0:04:14 0:10:00 0:02:33
8 fncdf270.fnal.gov 61696 0:03:26 2:55:55 0:02:31
Output probably lost; ask CAF operator.
Error in rcp'ing outgoing tar file into output machine
rcp to cdfopr at fcdfdata125.fnal.gov:/export/data1/cdfopr/current/streamg/Cafoutdir/CalibExe-102024.cdfprd_cdf-fncdfsrv0_CalibExe_1_gphysr_223120_223120_20060917_134717.8.tgzfailed:rcp: lost connection
Backup location error
Error in fcp'ing and rcp'ing outgoing tar file into output machine
fcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_8-102024.tgzfailed:kshd: Permission denied.
rcp to cdfdata at fcdfdata114.fnal.gov:/export/data3/cdfdata/icaf/icaf_out_cdfprd_8-102024.tgzfailed:kshd: Permission denied.
9 fncdf262.fnal.gov 0 0:04:40 5:47:10 2:48:02 0:00:01 983.0M
10 fncdf303.fnal.gov 0 0:04:51 5:34:34 2:33:57 0:00:01 984.3M
11 fncdf280.fnal.gov 0 0:04:04 5:40:09 2:42:52 0:00:01 1005.7M
12 fncdf312.fnal.gov 0 0:04:14 5:35:37 2:39:39 0:00:01 984.2M
13 fncdf262.fnal.gov 61696 0:04:41 0:10:00 0:02:31
14 fncdf290.fnal.gov 61696 0:04:41 0:10:00 0:02:25
15 fncdf271.fnal.gov 61696 0:03:57 2:59:26 0:02:24
16 fncdf303.fnal.gov 0 0:06:29 3:17:18 0:21:45 0:00:00 143.7M
17 fncdf321.fnal.gov 61696 0:05:27 3:00:20 0:02:09
INPUT data
==========
segment Nr.Recs Nr.Evts WaitDH Open Data Avg.Rec Avg.Evt Nr.Files Nr.Fail Datasets
4 7803 7802 0:00:00 0:12:06 1027.0M 131k 131k 1 0 local
5 7783 7782 0:00:01 0:11:42 972.0M 124k 124k 1 0 local
9 8053 8052 0:00:01 0:14:11 983.0M 122k 122k 1 0 local
10 7915 7914 0:00:01 0:11:18 984.3M 124k 124k 1 0 local
11 7838 7837 0:00:01 0:12:25 1005.7M 128k 128k 1 0 local
12 7595 7594 0:00:01 0:12:26 984.2M 129k 129k 1 0 local
16 1200 1199 0:00:00 0:01:49 143.7M 119k 119k 1 0 local
----------------------------------------------------------------------------------------------
Total: 48187 48180 0:00:05 1:15:57 6099.8M 0k 0k 7 0
Mean: 6883 6882 0:00:00 0:10:51 871.4M 125k 125k 1 0
RMS: 2510 2510 0:00:00 0:04:05 321.4M 4k 4k 0 0
Max: 8053 8052 0:00:01 0:14:11 1027.0M 131k 131k 1 0
More information about the Cdf_production_farm
mailing list