Views
#2453: question on CRC of a file
View
(Anonymous)
issuedata
Topic:
D0
Classification:
User Problem
Importance:
Medium
Assigned to: D0SAMonshift
Created by: emailsubmitter
Created at: 2006-12-07
contact
E-Mail:
hynek@fzu.cz
Description:
Dear experts, I would like to ask, how to tell the v7 sam to fill CRC value when doing transfer of file in sam: sam request file transfer --sourceFile=`pwd`/CAF_p18.07.00_FPD_test- recoT_daq_test_1_0000215417_018.raw_p17.09.06_hynek_sam.farm.particle.cz_035804_1056_FZU_GRID.root --station="d0_fzu_prague2" --destinationPath="sam2.farm.particle.cz:/raid4_work/samgrid2/jim_tmbs" --waitForCompletion; done This is the resulting metadata, but the CRC value isn't filled. I would like to have files in sam with CRC filled, then I suppose that I can relay on inherent mechanims in sam that guarantee that only copies of files with CRC matching the metadata values are kept in caches. Could you please commnet or clarify . PhysicsGenericFile({ 'fileName' : 'CAF_p18.07.00_FPD_test- recoT_daq_test_1_0000215417_018.raw_p17.09.06_hynek_sam.farm.particle.cz_035804_1056_FZU_GRID.root', 'fileId' : 14944134L, 'fileType' : 'physicsGeneric', 'fileFormat' : 'root', 'fileSize' : SamSize('15.04MB'), 'crc' : CRC('unknown crc value', 'unknown crc type'), 'fileContentStatus' : 'good', 'eventCount' : 2679L, 'dataTier' : 'root-bygroup', 'firstEvent' : 1636420L, 'lastEvent' : 1659265L, 'startTime' : SamTime('NULL'), 'endTime' : SamTime('NULL'), 'applicationFamily' : ApplicationFamily(appFamily='treemaker', appName='tmb_analyze', appVersion='fpd-p18.07.00'), 'group' : 'dzero', 'parents' : NameOrIdList(['recoT_daq_test_1_0000215417_018.raw_p17.09.06_hynek_sam.farm.particle.cz_035804_1056_ FZU_GRID']), 'datastream' : 'daq_test_1', 'lumBlockRangeList' : LumBlockRangeList([LumBlockRange(4524701L, 4524701L)]), 'runDescriptorList' : RunDescriptorList([RunDescriptor(runType='physics data taking', runNumber=215417)]), }) Thank you Vlastislav
Transcript
#3:
2006-12-07 09:42 AM (abaranov)
status: "accepted" ->
"resolved"
Dear Vlastislav, The CRC data is filled by FSS when transfer is requested between 2 different nodes. If both durable location and temporary staging area are on the same machine, FSS does not autimatically compute CRC value. To have that valued filled , you can either push the file further to tape or use "sam calculate crc" command explicitly. Regard, Andrew
#2:
2006-12-07 12:19 AM (emailsubmitter)
status: "pending" ->
"accepted"
assignees: "[]" ->
"['D0SAMonshift']"
topic: "" ->
"D0"
#1:
2006-12-07 12:19 AM (Anonymous User)
Dear experts, I would like to ask, how to tell the v7 sam to fill CRC value when doing transfer of file in sam: sam request file transfer --sourceFile=`pwd`/CAF_p18.07.00_FPD_test-recoT_daq_test_1_0000215417_018.raw_p1 7.09.06_hynek_sam.farm.particle.cz_035804_1056_FZU_GRID.root --station="d0_fzu_prague2" --destinationPath="sam2.farm.particle.cz:/raid4_work/samgrid2/jim_tmbs" --waitForCompletion; done This is the resulting metadata, but the CRC value isn't filled. I would like to have files in sam with CRC filled, then I suppose that I can relay on inherent mechanims in sam that guarantee that only copies of files with CRC matching the metadata values are kept in caches. Could you please commnet or clarify . PhysicsGenericFile({ 'fileName' : 'CAF_p18.07.00_FPD_test-recoT_daq_test_1_0000215417_018.raw_p17.09.06_hynek_sam. farm.particle.cz_035804_1056_FZU_GRID.root', 'fileId' : 14944134L, 'fileType' : 'physicsGeneric', 'fileFormat' : 'root', 'fileSize' : SamSize('15.04MB'), 'crc' : CRC('unknown crc value', 'unknown crc type'), 'fileContentStatus' : 'good', 'eventCount' : 2679L, 'dataTier' : 'root-bygroup', 'firstEvent' : 1636420L, 'lastEvent' : 1659265L, 'startTime' : SamTime('NULL'), 'endTime' : SamTime('NULL'), 'applicationFamily' : ApplicationFamily(appFamily='treemaker', appName='tmb_analyze', appVersion='fpd-p18.07.00'), 'group' : 'dzero', 'parents' : NameOrIdList(['recoT_daq_test_1_0000215417_018.raw_p17.09.06_hynek_sam.farm.part icle.cz_035804_1056_FZU_GRID']), 'datastream' : 'daq_test_1', 'lumBlockRangeList' : LumBlockRangeList([LumBlockRange(4524701L, 4524701L)]), 'runDescriptorList' : RunDescriptorList([RunDescriptor(runType='physics data taking', runNumber=215417)]), }) Thank you Vlastislav
PloneCollectorNG (C) 2003-2004 by ZOPYX - Software Development and Consulting Andreas Jung