08/15/06 13:38:56 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2719018
08/15/06 13:38:56 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: File 2719018 becomes disposable
08/15/06 13:38:56 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:56 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.PollProcess.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door26
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7447928 incRefCount 0
08/15/06 13:38:56 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7447928 incRefCount 1
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719183 
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719183 from CFID 7447928
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7447928 decRefCount 2
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343644 requests next file via CORBA callback
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343644 (tkuhr(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2343644))
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:38:56 cdf-caf.SM.CacheMan test 9610: Needed: 318363455B. can have: 232395983MB. Cache manager uses 169962184MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:38:56 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:38:56 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719183 is constrained to disks 744 
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719183->744 
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:38:56 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:38:56 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7447928 incRefCount 1
08/15/06 13:38:56 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719183; 7447928 decRefCount 2
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.00aebhd0(2719183)
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf401.fnal.gov[SAM Consumer Process](2343393) closes file xd027761.03c3bhd0(2723642) 
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf401.fnal.gov[SAM Consumer Process](2343393)
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:38:56 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:38:56 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca3.fnal.gov:25160/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:38:56 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.00aebhd0(2719183)
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:38:56 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719183
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7855981 from project ID 99952 has been recorded in the database
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027761.03c3bhd0(2723642)  at dcap://cdfcaf-door1
08/15/06 13:38:56 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027761.03c3bhd0 at node dcap://cdfcaf-door1
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7855981 decRefCount 1
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: CFID 7855981 becoming disposable
08/15/06 13:38:56 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723642
08/15/06 13:38:56 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: File 2723642 becomes disposable
08/15/06 13:38:56 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door1
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 0
08/15/06 13:38:56 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 1
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719184 
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719184 from CFID 7449358
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7449358 decRefCount 2
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719183
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: 1043 to deliver on dcap://cdfcaf-door26 for project 99952
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door26 for project 99952
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7856355 incRefCount 0
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719183 on dcap://cdfcaf-door26 num to deliver 1042
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343393 requests next file via CORBA callback
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343393 (tkuhr(demo:1)@fcdfcaf401.fnal.gov[SAM Consumer Process](2343393))
08/15/06 13:38:56 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719183; 7447928 decRefCount 1
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: CFID 7447928 becoming disposable
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:38:56 cdf-caf.SM.FileCachedInDB 9610: File 2719183 acquired cached file ID 7856355
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:38:56 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7449359 incRefCount 0
08/15/06 13:38:56 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7449359 incRefCount 1
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:56 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719185 
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719185 from CFID 7449359
08/15/06 13:38:56 cdf-caf.SM.FileManager 9610: 7449359 decRefCount 2
08/15/06 13:38:56 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:38:56 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.00aebhd0 to project 99952
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.00aebhd0 arrived at cdf-caf:dcap://cdfcaf-door26:dcap://cdfdca3.fnal.gov:25160/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:38:56 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.00aebhd0
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856355
08/15/06 13:38:56 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856355 will be set to test
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856355 by project ID 99952 has been recorded in the database
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.00aebhd0 arrived to dcap://cdfcaf-door26:dcap://cdfdca3.fnal.gov:25160/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719183: (91166)
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2343644) about to open file xd027507.00aebhd0(2719183) 
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2343644)
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2343644) successfully opens file xd027507.00aebhd0(2719183) 
08/15/06 13:38:57 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: Proc hays(demo:1)@fcdfcaf964.fnal.gov[SAM Consumer Process](2344277) closes file bh02faad.0022hel0(5390055) 
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: Skipping idle TO for process hays(demo:1)@fcdfcaf964.fnal.gov[SAM Consumer Process](2344277)
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: Release of file CFID 7848832 from project ID 99962 has been recorded in the database
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: All consumers have seen the good file bh02faad.0022hel0(5390055)  at dcap://cdfcaf-door28
08/15/06 13:38:57 cdf-caf.SM.cdf-caf 9610: Project 99962 releases file bh02faad.0022hel0 at node dcap://cdfcaf-door28
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: 7848832 decRefCount 1
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: CFID 7848832 becoming disposable
08/15/06 13:38:57 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99962 of group test releasing file 5390055
08/15/06 13:38:57 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99962
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610: File 5390055 becomes disposable
08/15/06 13:38:57 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610: Consumers at dcap://cdfcaf-door28 for project 99962 are happy
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: Process 2344277 requests next file via CORBA callback
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: No files are available for process CPID 2344277 (hays(demo:1)@fcdfcaf964.fnal.gov[SAM Consumer Process](2344277))
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: Process CPID 2344277 will not wait until other processes finish
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.EndOfFileStream.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:38:57 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.PollProcess.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.GPM 7470: Not all consumers have finished, delaying end of project /SAMStations/cdf-caf/hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638:Project
08/15/06 13:38:57 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Proc genser(demo:1)@fcdfcaf857.fnal.gov[SAM Consumer Process](2345409) closes file s900028.001kbh2(6515682) 
08/15/06 13:38:57 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Skipping idle TO for process genser(demo:1)@fcdfcaf857.fnal.gov[SAM Consumer Process](2345409)
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:38:57 cdf-caf.SM.CacheMan test 9610: Needed: 312544884B. can have: 232396914MB. Cache manager uses 169962488MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:38:57 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:38:57 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719185 is constrained to disks 719 
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing 7842405 , delivering (file->disk): 2719185->719 
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: Deleted a real state from file 6431591; there are 1 real states and 1 zombies
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: Telling DBS that 1 files are being uncached
08/15/06 13:38:57 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:38:57 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:38:57 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (7842405:test)
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: Work to erase 1 files is broken down for 1 stagers
08/15/06 13:38:57 cdf-caf.SM.DCAPDiskAgent 9610: Ignoring erase file physically
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: Deleted a Zombie state from file 6431591; there are 1 real states and 0 zombies
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:38:57 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: 7449359 incRefCount 1
08/15/06 13:38:57 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719185; 7449359 decRefCount 2
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.01c1bhd0(2719185)
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: Pruning canceled file 2719184
08/15/06 13:38:57 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719184; 7449358 decRefCount 1
08/15/06 13:38:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: CFID 7449358 becoming disposable
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:38:57 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Release of file CFID 7844839 from project ID 100083 has been recorded in the database
08/15/06 13:38:57 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: All consumers have seen the good file s900028.001kbh2(6515682)  at dcap://cdfcaf-door20
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:38:57 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:38:57 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:38:57 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (7842405:test)
08/15/06 13:38:57 cdf-caf.SM.cdf-caf 9610: Project 100083 releases file s900028.001kbh2 at node dcap://cdfcaf-door20
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: 7844839 decRefCount 1
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: CFID 7844839 becoming disposable
08/15/06 13:38:57 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100083 of group test releasing file 6515682
08/15/06 13:38:57 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100083
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610: File 6515682 becomes disposable
08/15/06 13:38:57 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610: Project 100083 will now be able to use 1 cached files
08/15/06 13:38:57 cdf-caf.SM.FileManager 9610: 7845007 incRefCount 0
08/15/06 13:38:57 cdf-caf.SM.ProjectManager 9610: Project 100083 uses file 6515761 on dcap://cdfcaf-door20 num to deliver 5
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Process 2345409 requests next file via CORBA callback
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: No files are available for process CPID 2345409 (genser(demo:1)@fcdfcaf857.fnal.gov[SAM Consumer Process](2345409))
08/15/06 13:38:58 cdf-caf.SM.FileUncachedInDBTimer 9610: DBS now knows that CFID 7842405 is uncached
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:38:58 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca1.fnal.gov:25125/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:38:58 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.01c1bhd0(2719185)
08/15/06 13:38:58 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file s900080.012kbh2 to project 100083
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: s900080.012kbh2 arrived at cdf-caf:dcap://cdfcaf-door20:dcap://cdfdca2.fnal.gov:25154/pnfs/fnal.gov/usr/cdfen/filesets/SO/SO00/SO0001/SO0001.2
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GiveFile2ProjectInDBTimer 15118: Telling DBS that project 100083 uses file CFID 7845007
08/15/06 13:38:58 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100083 contacted OK, actually uses file s900080.012kbh2
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GiveFile2ProjectInDBTimer 15118: Owner group for file CFID 7845007 will be set to test
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:38:58 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719185
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GiveFile2ProjectInDBTimer 15118: Usage of file CFID 7845007 by project ID 100083 has been recorded in the database
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: File s900080.012kbh2 arrived to dcap://cdfcaf-door20:dcap://cdfdca2.fnal.gov:25154/pnfs/fnal.gov/usr/cdfen/filesets/SO/SO00/SO0001/SO0001.2
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Umers interested in file 6515761: (91204)
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Proc genser(demo:1)@fcdfcaf857.fnal.gov[SAM Consumer Process](2345409) about to open file s900080.012kbh2(6515761) 
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Skipping busy TO for process genser(demo:1)@fcdfcaf857.fnal.gov[SAM Consumer Process](2345409)
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.GPM 15118: Proc genser(demo:1)@fcdfcaf857.fnal.gov[SAM Consumer Process](2345409) successfully opens file s900080.012kbh2(6515761) 
08/15/06 13:38:58 cdf-caf.genser_cdf-caf_skbh29_205661_23762.FileReady.Worker 15118: Notifing, timeout set to 1 min.
08/15/06 13:38:58 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:38:58 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719185
08/15/06 13:38:58 cdf-caf.SM.ProjectManager 9610: 784 to deliver on dcap://cdfcaf-door1 for project 99952
08/15/06 13:38:58 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door1 for project 99952
08/15/06 13:38:58 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:38:58 cdf-caf.SM.FileManager 9610: 7856356 incRefCount 0
08/15/06 13:38:58 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719185 on dcap://cdfcaf-door1 num to deliver 783
08/15/06 13:38:58 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:38:58 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:38:58 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719185; 7449359 decRefCount 1
08/15/06 13:38:58 cdf-caf.SM.FileManager 9610: CFID 7449359 becoming disposable
08/15/06 13:38:58 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:38:58 cdf-caf.SM.FileCachedInDB 9610: File 2719185 acquired cached file ID 7856356
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:38:58 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:38:58 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.01c1bhd0 to project 99952
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.01c1bhd0 arrived at cdf-caf:dcap://cdfcaf-door1:dcap://cdfdca1.fnal.gov:25125/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:38:58 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.01c1bhd0
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856356
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856356 will be set to test
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856356 by project ID 99952 has been recorded in the database
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.01c1bhd0 arrived to dcap://cdfcaf-door1:dcap://cdfdca1.fnal.gov:25125/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719185: (91166)
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf401.fnal.gov[SAM Consumer Process](2343393) about to open file xd027507.01c1bhd0(2719185) 
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf401.fnal.gov[SAM Consumer Process](2343393)
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf401.fnal.gov[SAM Consumer Process](2343393) successfully opens file xd027507.01c1bhd0(2719185) 
08/15/06 13:38:58 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:38:58 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:38:58 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:38:58 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf347.fnal.gov[SAM Consumer Process](2343496) closes file xd027761.0383bhd0(2723643) 
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf347.fnal.gov[SAM Consumer Process](2343496)
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf934.fnal.gov[SAM Consumer Process](2343413) closes file xd0274db.00d9bhd0(2719028) 
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf934.fnal.gov[SAM Consumer Process](2343413)
08/15/06 13:38:59 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Proc johnpaul(demo:1)@fcdfcaf990.fnal.gov[SAM Consumer Process](2345149) closes file ji031e33.022cpmm0(5860338) 
08/15/06 13:38:59 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Skipping idle TO for process johnpaul(demo:1)@fcdfcaf990.fnal.gov[SAM Consumer Process](2345149)
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856170 from project ID 99952 has been recorded in the database
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd0274db.00d9bhd0(2719028)  at dcap://cdfcaf-door16
08/15/06 13:38:59 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd0274db.00d9bhd0 at node dcap://cdfcaf-door16
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7856170 decRefCount 1
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: CFID 7856170 becoming disposable
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2719028
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: File 2719028 becomes disposable
08/15/06 13:38:59 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:59 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Release of file CFID 7855052 from project ID 100054 has been recorded in the database
08/15/06 13:38:59 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: All consumers have seen the good file ji031e33.022cpmm0(5860338)  at dcap://cdfcaf-door2
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door16
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 1
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719184 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719184 from CFID 7449358
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449358 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:38:59 cdf-caf.SM.cdf-caf 9610: Project 100054 releases file ji031e33.022cpmm0 at node dcap://cdfcaf-door2
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7855052 decRefCount 1
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: CFID 7855052 becoming disposable
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100054 of group test releasing file 5860338
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100054
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: File 5860338 becomes disposable
08/15/06 13:38:59 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100054 at dcap://cdfcaf-door2
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7121216 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7121216 incRefCount 1
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 5866820 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 5866820 from CFID 7121216
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7121216 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343413 requests next file via CORBA callback
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343413 (tkuhr(demo:1)@fcdfcaf934.fnal.gov[SAM Consumer Process](2343413))
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7855980 from project ID 99952 has been recorded in the database
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027761.0383bhd0(2723643)  at dcap://cdfcaf-door17
08/15/06 13:38:59 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027761.0383bhd0 at node dcap://cdfcaf-door17
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7855980 decRefCount 1
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: CFID 7855980 becoming disposable
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723643
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: File 2723643 becomes disposable
08/15/06 13:38:59 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:59 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Process 2345149 requests next file via CORBA callback
08/15/06 13:38:59 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: No files are available for process CPID 2345149 (johnpaul(demo:1)@fcdfcaf990.fnal.gov[SAM Consumer Process](2345149))
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf364.fnal.gov[SAM Consumer Process](2343464) closes file xd027761.0414bhd0(2723596) 
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf364.fnal.gov[SAM Consumer Process](2343464)
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door17
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610:  Found 2 hits, reaquired for ISX
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856027 from project ID 99952 has been recorded in the database
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 1
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027761.0414bhd0(2723596)  at dcap://cdfcaf-door27
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719186 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719186 from CFID 7449360
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449360 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448153 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448153 incRefCount 1
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719187 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719187 from CFID 7448153
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448153 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: 2 Total requests created, to satisfyConsumers
08/15/06 13:38:59 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027761.0414bhd0 at node dcap://cdfcaf-door27
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7856027 decRefCount 1
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: CFID 7856027 becoming disposable
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723596
08/15/06 13:38:59 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: File 2723596 becomes disposable
08/15/06 13:38:59 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door27
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610:  Found 3 hits, reaquired for ISX
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448722 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448722 incRefCount 1
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719188 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719188 from CFID 7448722
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448722 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448517 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448517 incRefCount 1
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719189 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719189 from CFID 7448517
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7448517 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449357 incRefCount 0
08/15/06 13:38:59 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449357 incRefCount 1
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:38:59 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719190 
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719190 from CFID 7449357
08/15/06 13:38:59 cdf-caf.SM.FileManager 9610: 7449357 decRefCount 2
08/15/06 13:38:59 cdf-caf.SM.ProjectManager 9610: 3 Total requests created, to satisfyConsumers
08/15/06 13:38:59 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343464 requests next file via CORBA callback
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343464 (tkuhr(demo:1)@fcdfcaf364.fnal.gov[SAM Consumer Process](2343464))
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343496 requests next file via CORBA callback
08/15/06 13:38:59 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343496 (tkuhr(demo:1)@fcdfcaf347.fnal.gov[SAM Consumer Process](2343496))
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:00 cdf-caf.SM.CacheMan test 9610: Needed: 323945450B. can have: 232396289MB. Cache manager uses 169961197MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 3 consumption sites , priority : hi
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719190 is constrained to disks 734 735 745 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719190->745 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: 7449357 incRefCount 1
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719190; 7449357 decRefCount 2
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.0047bhd0(2719190)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:00 cdf-caf.SM.CacheMan test 9610: Needed: 337622282B. can have: 232396289MB. Cache manager uses 169961506MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 2 consumption sites , priority : hi
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719189 is constrained to disks 734 735 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719189->734 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: 7448517 incRefCount 1
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719189; 7448517 decRefCount 2
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.00ddbhd0(2719189)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:00 cdf-caf.SM.CacheMan test 9610: Needed: 321466170B. can have: 232396289MB. Cache manager uses 169961828MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719188 is constrained to disks 735 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719188->735 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: 7448722 incRefCount 1
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719188; 7448722 decRefCount 2
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027505.0474bhd0(2719188)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Pruning canceled file 2719187
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719187; 7448153 decRefCount 1
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: CFID 7448153 becoming disposable
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Pruning canceled file 2719186
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719186; 7449360 decRefCount 1
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: CFID 7449360 becoming disposable
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.CacheMan test 9610: Needed: 1465845480B. can have: 232396926MB. Cache manager uses 169962134MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:00 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 5866820 is constrained to disks 720 
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing 7841458 , delivering (file->disk): 5866820->720 
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 6634799; there are 1 real states and 1 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Telling DBS that 1 files are being uncached
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (7841458:test)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Work to erase 1 files is broken down for 1 stagers
08/15/06 13:39:00 cdf-caf.SM.DCAPDiskAgent 9610: Ignoring erase file physically
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a Zombie state from file 6634799; there are 1 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: 7121216 incRefCount 1
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 5866820; 7121216 decRefCount 2
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Scheduling transfer for ji031e9c.02b5pmm0(5866820)
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: Pruning canceled file 2719184
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719184; 7449358 decRefCount 1
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: CFID 7449358 becoming disposable
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:00 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:00 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0 -> dcap://cdfdca3.fnal.gov:25161/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.0047bhd0(2719190)
08/15/06 13:39:00 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca2.fnal.gov:25150/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.00ddbhd0(2719189)
08/15/06 13:39:00 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0 -> dcap://cdfdca2.fnal.gov:25151/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027505.0474bhd0(2719188)
08/15/06 13:39:00 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM48/SM4845/SM4845.5 -> dcap://cdfdca1.fnal.gov:25136/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM48/SM4845/SM4845.5
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile ji031e9c.02b5pmm0(5866820)
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (7841458:test)
08/15/06 13:39:00 cdf-caf.SM.FileUncachedInDBTimer 9610: DBS now knows that CFID 7841458 is uncached
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719190
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719190
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: 1794 to deliver on dcap://cdfcaf-door27 for project 99952
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door27 for project 99952
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: 7856357 incRefCount 0
08/15/06 13:39:00 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719190 on dcap://cdfcaf-door27 num to deliver 1793
08/15/06 13:39:00 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719190; 7449357 decRefCount 1
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: CFID 7449357 becoming disposable
08/15/06 13:39:00 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: File 2719190 acquired cached file ID 7856357
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:00 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.0047bhd0 to project 99952
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.0047bhd0 arrived at cdf-caf:dcap://cdfcaf-door27:dcap://cdfdca3.fnal.gov:25161/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:00 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.0047bhd0
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856357
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856357 will be set to test
08/15/06 13:39:00 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:00 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719189
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856357 by project ID 99952 has been recorded in the database
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.0047bhd0 arrived to dcap://cdfcaf-door27:dcap://cdfdca3.fnal.gov:25161/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719190: (91166)
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf364.fnal.gov[SAM Consumer Process](2343464) about to open file xd027507.0047bhd0(2719190) 
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf364.fnal.gov[SAM Consumer Process](2343464)
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf364.fnal.gov[SAM Consumer Process](2343464) successfully opens file xd027507.0047bhd0(2719190) 
08/15/06 13:39:00 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719189
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: 1015 to deliver on dcap://cdfcaf-door16 for project 99952
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door16 for project 99952
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7856358 incRefCount 0
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719189 on dcap://cdfcaf-door16 num to deliver 1014
08/15/06 13:39:01 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719189; 7448517 decRefCount 1
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: CFID 7448517 becoming disposable
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:01 cdf-caf.SM.FileCachedInDB 9610: File 2719189 acquired cached file ID 7856358
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.00ddbhd0 to project 99952
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.00ddbhd0 arrived at cdf-caf:dcap://cdfcaf-door16:dcap://cdfdca2.fnal.gov:25150/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.00ddbhd0
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856358
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856358 will be set to test
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:01 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719188
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856358 by project ID 99952 has been recorded in the database
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.00ddbhd0 arrived to dcap://cdfcaf-door16:dcap://cdfdca2.fnal.gov:25150/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719189: (91166)
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf934.fnal.gov[SAM Consumer Process](2343413) about to open file xd027507.00ddbhd0(2719189) 
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf934.fnal.gov[SAM Consumer Process](2343413)
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf934.fnal.gov[SAM Consumer Process](2343413) successfully opens file xd027507.00ddbhd0(2719189) 
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719188
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: 1005 to deliver on dcap://cdfcaf-door17 for project 99952
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door17 for project 99952
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7856359 incRefCount 0
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719188 on dcap://cdfcaf-door17 num to deliver 1004
08/15/06 13:39:01 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719188; 7448722 decRefCount 1
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: CFID 7448722 becoming disposable
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:01 cdf-caf.SM.FileCachedInDB 9610: File 2719188 acquired cached file ID 7856359
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027505.0474bhd0 to project 99952
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027505.0474bhd0 arrived at cdf-caf:dcap://cdfcaf-door17:dcap://cdfdca2.fnal.gov:25151/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027505.0474bhd0
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856359
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856359 will be set to test
08/15/06 13:39:01 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856359 by project ID 99952 has been recorded in the database
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027505.0474bhd0 arrived to dcap://cdfcaf-door17:dcap://cdfdca2.fnal.gov:25151/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719188: (91166)
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf347.fnal.gov[SAM Consumer Process](2343496) about to open file xd027505.0474bhd0(2719188) 
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf347.fnal.gov[SAM Consumer Process](2343496)
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf347.fnal.gov[SAM Consumer Process](2343496) successfully opens file xd027505.0474bhd0(2719188) 
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:01 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:01 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:01 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 5866820
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf876.fnal.gov[SAM Consumer Process](2343390) closes file xd027505.040dbhd0(2719157) 
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf876.fnal.gov[SAM Consumer Process](2343390)
08/15/06 13:39:01 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf625.fnal.gov[SAM Consumer Process](2345510) closes file bh02fe39.006dhmu0(4532250) 
08/15/06 13:39:01 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping idle TO for process genser(demo:1)@fcdfcaf625.fnal.gov[SAM Consumer Process](2345510)
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Checking if project 100054 can use file 5866820
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: 80 to deliver on dcap://cdfcaf-door2 for project 100054
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door2 for project 100054
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 100054 will now be able to use 1 cached files
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7856360 incRefCount 0
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 100054 uses file 5866820 on dcap://cdfcaf-door2 num to deliver 79
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856309 from project ID 99952 has been recorded in the database
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027505.040dbhd0(2719157)  at dcap://cdfcaf-door16
08/15/06 13:39:01 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: Deleted a real state from file 5866820; 7121216 decRefCount 1
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: CFID 7121216 becoming disposable
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:01 cdf-caf.SM.FileCachedInDB 9610: File 5866820 acquired cached file ID 7856360
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:01 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file ji031e9c.02b5pmm0 to project 100054
08/15/06 13:39:01 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027505.040dbhd0 at node dcap://cdfcaf-door16
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7856309 decRefCount 1
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: CFID 7856309 becoming disposable
08/15/06 13:39:01 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2719157
08/15/06 13:39:01 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: File 2719157 becomes disposable
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:01 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Release of file CFID 7852118 from project ID 100093 has been recorded in the database
08/15/06 13:39:01 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: All consumers have seen the good file bh02fe39.006dhmu0(4532250)  at dcap://cdfcaf-door28
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door16
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 0
08/15/06 13:39:01 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 1
08/15/06 13:39:01 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:01 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719184 
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719184 from CFID 7449358
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7449358 decRefCount 2
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:01 cdf-caf.SM.cdf-caf 9610: Project 100093 releases file bh02fe39.006dhmu0 at node dcap://cdfcaf-door28
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7852118 decRefCount 1
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: CFID 7852118 becoming disposable
08/15/06 13:39:01 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100093 of group test releasing file 4532250
08/15/06 13:39:01 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100093
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: File 4532250 becomes disposable
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 100093 will now be able to use 1 cached files
08/15/06 13:39:01 cdf-caf.SM.FileManager 9610: 7853472 incRefCount 0
08/15/06 13:39:01 cdf-caf.SM.ProjectManager 9610: Project 100093 uses file 4556670 on dcap://cdfcaf-door28 num to deliver 53
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343390 requests next file via CORBA callback
08/15/06 13:39:01 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343390 (tkuhr(demo:1)@fcdfcaf876.fnal.gov[SAM Consumer Process](2343390))
08/15/06 13:39:01 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: ji031e9c.02b5pmm0 arrived at cdf-caf:dcap://cdfcaf-door2:dcap://cdfdca1.fnal.gov:25136/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM48/SM4845/SM4845.5
08/15/06 13:39:01 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GiveFile2ProjectInDBTimer 12414: Telling DBS that project 100054 uses file CFID 7856360
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100054 contacted OK, actually uses file ji031e9c.02b5pmm0
08/15/06 13:39:01 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GiveFile2ProjectInDBTimer 12414: Owner group for file CFID 7856360 will be set to test
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file bh02ff83.0001hmu0 to project 100093
08/15/06 13:39:01 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: bh02ff83.0001hmu0 arrived at cdf-caf:dcap://cdfcaf-door28:dcap://cdfdca3.fnal.gov:25162/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM13/SM1387/SM1387.2
08/15/06 13:39:01 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100093 contacted OK, actually uses file bh02ff83.0001hmu0
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Process 2345510 requests next file via CORBA callback
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: No files are available for process CPID 2345510 (genser(demo:1)@fcdfcaf625.fnal.gov[SAM Consumer Process](2345510))
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GiveFile2ProjectInDBTimer 17045: Telling DBS that project 100093 uses file CFID 7853472
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GiveFile2ProjectInDBTimer 17045: Owner group for file CFID 7853472 will be set to test
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GiveFile2ProjectInDBTimer 12414: Usage of file CFID 7856360 by project ID 100054 has been recorded in the database
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: File ji031e9c.02b5pmm0 arrived to dcap://cdfcaf-door2:dcap://cdfdca1.fnal.gov:25136/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM48/SM4845/SM4845.5
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Umers interested in file 5866820: (91196)
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Proc johnpaul(demo:1)@fcdfcaf990.fnal.gov[SAM Consumer Process](2345149) about to open file ji031e9c.02b5pmm0(5866820) 
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Skipping busy TO for process johnpaul(demo:1)@fcdfcaf990.fnal.gov[SAM Consumer Process](2345149)
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.GPM 12414: Proc johnpaul(demo:1)@fcdfcaf990.fnal.gov[SAM Consumer Process](2345149) successfully opens file ji031e9c.02b5pmm0(5866820) 
08/15/06 13:39:02 cdf-caf.johnpaul_cdf-caf_jpmm0i_205657_26899.FileReady.Worker 12414: Notifing, timeout set to 1 min.
08/15/06 13:39:02 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GiveFile2ProjectInDBTimer 17045: Usage of file CFID 7853472 by project ID 100093 has been recorded in the database
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: File bh02ff83.0001hmu0 arrived to dcap://cdfcaf-door28:dcap://cdfdca3.fnal.gov:25162/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM13/SM1387/SM1387.2
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Umers interested in file 4556670: (91211)
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf625.fnal.gov[SAM Consumer Process](2345510) about to open file bh02ff83.0001hmu0(4556670) 
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping busy TO for process genser(demo:1)@fcdfcaf625.fnal.gov[SAM Consumer Process](2345510)
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf625.fnal.gov[SAM Consumer Process](2345510) successfully opens file bh02ff83.0001hmu0(4556670) 
08/15/06 13:39:02 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.FileReady.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:39:02 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:02 cdf-caf.SM.CacheMan test 9610: Needed: 325550756B. can have: 232399339MB. Cache manager uses 169961906MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:02 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:02 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:02 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719184 is constrained to disks 734 
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing 7843940 , delivering (file->disk): 2719184->734 
08/15/06 13:39:02 cdf-caf.SM.FileManager 9610: Deleted a real state from file 6427084; there are 1 real states and 1 zombies
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: Telling DBS that 1 files are being uncached
08/15/06 13:39:02 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:02 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:02 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (7843940:test)
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: Work to erase 1 files is broken down for 1 stagers
08/15/06 13:39:02 cdf-caf.SM.DCAPDiskAgent 9610: Ignoring erase file physically
08/15/06 13:39:02 cdf-caf.SM.FileManager 9610: Deleted a Zombie state from file 6427084; there are 1 real states and 0 zombies
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:02 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:02 cdf-caf.SM.FileManager 9610: 7449358 incRefCount 1
08/15/06 13:39:02 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:02 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719184; 7449358 decRefCount 2
08/15/06 13:39:02 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.0072bhd0(2719184)
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:02 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:02 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:02 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (7843940:test)
08/15/06 13:39:03 cdf-caf.SM.FileUncachedInDBTimer 9610: DBS now knows that CFID 7843940 is uncached
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:03 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0 -> dcap://cdfdca2.fnal.gov:25150/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:03 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.0072bhd0(2719184)
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:03 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719184
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719184
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: 1014 to deliver on dcap://cdfcaf-door16 for project 99952
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door16 for project 99952
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: 7856361 incRefCount 0
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719184 on dcap://cdfcaf-door16 num to deliver 1013
08/15/06 13:39:03 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719184; 7449358 decRefCount 1
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: CFID 7449358 becoming disposable
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:03 cdf-caf.SM.FileCachedInDB 9610: File 2719184 acquired cached file ID 7856361
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:03 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:03 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.0072bhd0 to project 99952
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.0072bhd0 arrived at cdf-caf:dcap://cdfcaf-door16:dcap://cdfdca2.fnal.gov:25150/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:03 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.0072bhd0
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856361
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856361 will be set to test
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856361 by project ID 99952 has been recorded in the database
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.0072bhd0 arrived to dcap://cdfcaf-door16:dcap://cdfdca2.fnal.gov:25150/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719184: (91166)
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf876.fnal.gov[SAM Consumer Process](2343390) about to open file xd027507.0072bhd0(2719184) 
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf876.fnal.gov[SAM Consumer Process](2343390)
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf876.fnal.gov[SAM Consumer Process](2343390) successfully opens file xd027507.0072bhd0(2719184) 
08/15/06 13:39:03 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf618.fnal.gov[SAM Consumer Process](2345516) closes file bh030177.0140hmu0(4580169) 
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping idle TO for process genser(demo:1)@fcdfcaf618.fnal.gov[SAM Consumer Process](2345516)
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Release of file CFID 7854411 from project ID 100093 has been recorded in the database
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: All consumers have seen the good file bh030177.0140hmu0(4580169)  at dcap://cdfcaf-door25
08/15/06 13:39:03 cdf-caf.SM.cdf-caf 9610: Project 100093 releases file bh030177.0140hmu0 at node dcap://cdfcaf-door25
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: 7854411 decRefCount 1
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: CFID 7854411 becoming disposable
08/15/06 13:39:03 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100093 of group test releasing file 4580169
08/15/06 13:39:03 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100093
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: File 4580169 becomes disposable
08/15/06 13:39:03 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Project 100093 will now be able to use 1 cached files
08/15/06 13:39:03 cdf-caf.SM.FileManager 9610: 7853648 incRefCount 0
08/15/06 13:39:03 cdf-caf.SM.ProjectManager 9610: Project 100093 uses file 4556874 on dcap://cdfcaf-door25 num to deliver 17
08/15/06 13:39:03 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file bh030038.06f1hmu0 to project 100093
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: bh030038.06f1hmu0 arrived at cdf-caf:dcap://cdfcaf-door25:dcap://cdfdca3.fnal.gov:25159/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM13/SM1387/SM1387.2
08/15/06 13:39:03 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100093 contacted OK, actually uses file bh030038.06f1hmu0
08/15/06 13:39:03 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Process 2345516 requests next file via CORBA callback
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: No files are available for process CPID 2345516 (genser(demo:1)@fcdfcaf618.fnal.gov[SAM Consumer Process](2345516))
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GiveFile2ProjectInDBTimer 17045: Telling DBS that project 100093 uses file CFID 7853648
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GiveFile2ProjectInDBTimer 17045: Owner group for file CFID 7853648 will be set to test
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GiveFile2ProjectInDBTimer 17045: Usage of file CFID 7853648 by project ID 100093 has been recorded in the database
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: File bh030038.06f1hmu0 arrived to dcap://cdfcaf-door25:dcap://cdfdca3.fnal.gov:25159/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM13/SM1387/SM1387.2
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Umers interested in file 4556874: (91211)
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf618.fnal.gov[SAM Consumer Process](2345516) about to open file bh030038.06f1hmu0(4556874) 
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping busy TO for process genser(demo:1)@fcdfcaf618.fnal.gov[SAM Consumer Process](2345516)
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf618.fnal.gov[SAM Consumer Process](2345516) successfully opens file bh030038.06f1hmu0(4556874) 
08/15/06 13:39:03 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.FileReady.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:39:04 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:04 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:04 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:04 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:04 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf360.fnal.gov[SAM Consumer Process](2343515) closes file xd027762.0043bhd0(2723632) 
08/15/06 13:39:04 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf360.fnal.gov[SAM Consumer Process](2343515)
08/15/06 13:39:04 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7855991 from project ID 99952 has been recorded in the database
08/15/06 13:39:04 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027762.0043bhd0(2723632)  at dcap://cdfcaf-door14
08/15/06 13:39:04 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027762.0043bhd0 at node dcap://cdfcaf-door14
08/15/06 13:39:04 cdf-caf.SM.FileManager 9610: 7855991 decRefCount 1
08/15/06 13:39:04 cdf-caf.SM.FileManager 9610: CFID 7855991 becoming disposable
08/15/06 13:39:04 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723632
08/15/06 13:39:04 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:04 cdf-caf.SM.ProjectManager 9610: File 2723632 becomes disposable
08/15/06 13:39:04 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door14
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 0
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 1
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719186 
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719186 from CFID 7449360
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7449360 decRefCount 2
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:05 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.PollProcess.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343515 requests next file via CORBA callback
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343515 (tkuhr(demo:1)@fcdfcaf360.fnal.gov[SAM Consumer Process](2343515))
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf370.fnal.gov[SAM Consumer Process](2343470) closes file xd027761.02e1bhd0(2723637) 
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf370.fnal.gov[SAM Consumer Process](2343470)
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7855986 from project ID 99952 has been recorded in the database
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027761.02e1bhd0(2723637)  at dcap://cdfcaf-door30
08/15/06 13:39:05 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027761.02e1bhd0 at node dcap://cdfcaf-door30
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7855986 decRefCount 1
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: CFID 7855986 becoming disposable
08/15/06 13:39:05 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723637
08/15/06 13:39:05 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: File 2723637 becomes disposable
08/15/06 13:39:05 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door30
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610:  Found 2 hits, reaquired for ISX
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448153 incRefCount 0
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448153 incRefCount 1
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719187 
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719187 from CFID 7448153
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448153 decRefCount 2
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448721 incRefCount 0
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448721 incRefCount 1
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719191 
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719191 from CFID 7448721
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448721 decRefCount 2
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: 2 Total requests created, to satisfyConsumers
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:05 cdf-caf.SM.CacheMan test 9610: Needed: 341200707B. can have: 232399345MB. Cache manager uses 169960554MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:05 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 2 consumption sites , priority : hi
08/15/06 13:39:05 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719191 is constrained to disks 732 748 
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719191->748 
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:05 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:05 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:05 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448721 incRefCount 1
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719191; 7448721 decRefCount 2
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.00e8bhd0(2719191)
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:05 cdf-caf.SM.CacheMan test 9610: Needed: 335028408B. can have: 232399345MB. Cache manager uses 169960880MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:05 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:05 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:05 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719187 is constrained to disks 732 
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719187->732 
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:05 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:05 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: 7448153 incRefCount 1
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719187; 7448153 decRefCount 2
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.00b8bhd0(2719187)
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:05 cdf-caf.SM.Repler 9610: Pruning canceled file 2719186
08/15/06 13:39:05 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719186; 7449360 decRefCount 1
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: CFID 7449360 becoming disposable
08/15/06 13:39:05 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343470 requests next file via CORBA callback
08/15/06 13:39:05 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343470 (tkuhr(demo:1)@fcdfcaf370.fnal.gov[SAM Consumer Process](2343470))
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf610.fnal.gov[SAM Consumer Process](2343549) closes file xd027762.0029bhd0(2723628) 
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf610.fnal.gov[SAM Consumer Process](2343549)
08/15/06 13:39:06 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:06 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:06 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:06 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.00e8bhd0(2719191)
08/15/06 13:39:06 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca2.fnal.gov:25148/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:06 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.00b8bhd0(2719187)
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:06 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:06 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719191
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7855995 from project ID 99952 has been recorded in the database
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027762.0029bhd0(2723628)  at dcap://cdfcaf-door19
08/15/06 13:39:06 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027762.0029bhd0 at node dcap://cdfcaf-door19
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7855995 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7855995 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723628
08/15/06 13:39:06 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: File 2723628 becomes disposable
08/15/06 13:39:06 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door19
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719186 
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719186 from CFID 7449360
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449360 decRefCount 2
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719191
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: 783 to deliver on dcap://cdfcaf-door30 for project 99952
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door30 for project 99952
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7856362 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719191 on dcap://cdfcaf-door30 num to deliver 782
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf350.fnal.gov[SAM Consumer Process](2343551) closes file xd027762.0059bhd0(2723630) 
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf350.fnal.gov[SAM Consumer Process](2343551)
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719191; 7448721 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7448721 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.FileCachedInDB 9610: File 2719191 acquired cached file ID 7856362
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:06 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.00e8bhd0 to project 99952
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.00e8bhd0 arrived at cdf-caf:dcap://cdfcaf-door30:dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:06 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.00e8bhd0
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:06 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719187
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7855993 from project ID 99952 has been recorded in the database
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027762.0059bhd0(2723630)  at dcap://cdfcaf-door18
08/15/06 13:39:06 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027762.0059bhd0 at node dcap://cdfcaf-door18
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7855993 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7855993 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723630
08/15/06 13:39:06 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: File 2723630 becomes disposable
08/15/06 13:39:06 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door18
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610:  Found 2 hits, reaquired for ISX
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7448720 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7448720 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719192 
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719192 from CFID 7448720
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7448720 decRefCount 2
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447802 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447802 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719193 
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719193 from CFID 7447802
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447802 decRefCount 2
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: 2 Total requests created, to satisfyConsumers
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719187
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: 1234 to deliver on dcap://cdfcaf-door14 for project 99952
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door14 for project 99952
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7856363 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719187 on dcap://cdfcaf-door14 num to deliver 1233
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719187; 7448153 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7448153 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.FileCachedInDB 9610: File 2719187 acquired cached file ID 7856363
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610:  Found 2 hits, reaquired for ISX
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449739 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449739 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719194 
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719194 from CFID 7449739
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449739 decRefCount 2
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447799 incRefCount 0
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343551 requests next file via CORBA callback
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343551 (tkuhr(demo:1)@fcdfcaf350.fnal.gov[SAM Consumer Process](2343551))
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343549 requests next file via CORBA callback
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343549 (tkuhr(demo:1)@fcdfcaf610.fnal.gov[SAM Consumer Process](2343549))
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447799 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719195 
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856362
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856362 will be set to test
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719195 from CFID 7447799
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447799 decRefCount 2
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: 2 Total requests created, to satisfyConsumers
08/15/06 13:39:06 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.00b8bhd0 to project 99952
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.00b8bhd0 arrived at cdf-caf:dcap://cdfcaf-door14:dcap://cdfdca2.fnal.gov:25148/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:06 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.00b8bhd0
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856362 by project ID 99952 has been recorded in the database
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.00e8bhd0 arrived to dcap://cdfcaf-door30:dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719191: (91166)
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf370.fnal.gov[SAM Consumer Process](2343470) about to open file xd027507.00e8bhd0(2719191) 
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf370.fnal.gov[SAM Consumer Process](2343470)
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf370.fnal.gov[SAM Consumer Process](2343470) successfully opens file xd027507.00e8bhd0(2719191) 
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856363
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856363 will be set to test
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:06 cdf-caf.SM.CacheMan test 9610: Needed: 312676263B. can have: 232399375MB. Cache manager uses 169961199MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:06 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 2 consumption sites , priority : hi
08/15/06 13:39:06 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719195 is constrained to disks 736 737 
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719195->737 
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:06 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7447799 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719195; 7447799 decRefCount 2
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.0090bhd0(2719195)
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:06 cdf-caf.SM.CacheMan test 9610: Needed: 331847866B. can have: 232399375MB. Cache manager uses 169961497MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:06 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:06 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:06 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719194 is constrained to disks 736 
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing 7847011 , delivering (file->disk): 2719194->736 
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2698811; there are 1 real states and 1 zombies
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Telling DBS that 1 files are being uncached
08/15/06 13:39:06 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:06 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (7847011:test)
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Work to erase 1 files is broken down for 1 stagers
08/15/06 13:39:06 cdf-caf.SM.DCAPDiskAgent 9610: Ignoring erase file physically
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a Zombie state from file 2698811; there are 1 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856363 by project ID 99952 has been recorded in the database
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: 7449739 incRefCount 1
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.00b8bhd0 arrived to dcap://cdfcaf-door14:dcap://cdfdca2.fnal.gov:25148/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719187: (91166)
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf360.fnal.gov[SAM Consumer Process](2343515) about to open file xd027507.00b8bhd0(2719187) 
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf360.fnal.gov[SAM Consumer Process](2343515)
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf360.fnal.gov[SAM Consumer Process](2343515) successfully opens file xd027507.00b8bhd0(2719187) 
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719194; 7449739 decRefCount 2
08/15/06 13:39:06 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027505.0486bhd0(2719194)
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Pruning canceled file 2719193
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719193; 7447802 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7447802 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Pruning canceled file 2719192
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719192; 7448720 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7448720 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:06 cdf-caf.SM.Repler 9610: Pruning canceled file 2719186
08/15/06 13:39:06 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719186; 7449360 decRefCount 1
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: CFID 7449360 becoming disposable
08/15/06 13:39:06 cdf-caf.SM.FileManager 9610: there are 1 real states and 0 zombies
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Proc hays(demo:1)@fcdfcaf933.fnal.gov[SAM Consumer Process](2343116) closes file bh031b69.002bhel0(5620191) 
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Skipping idle TO for process hays(demo:1)@fcdfcaf933.fnal.gov[SAM Consumer Process](2343116)
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Station DBProxy 5262: Warning, Db server became unreachable
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Station DBProxy 5262: Resolving Db Server Factory as SAMDbServer.cdfcafstation_prd:SAMDbServer
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Station DBProxy 5262: Obtaining servant of type Station
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Station DBProxy 5262: DbServer is alive 
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:07 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:07 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca2.fnal.gov:25153/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:07 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.0090bhd0(2719195)
08/15/06 13:39:07 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0 -> dcap://cdfdca2.fnal.gov:25152/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:07 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027505.0486bhd0(2719194)
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:07 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (7847011:test)
08/15/06 13:39:07 cdf-caf.SM.FileUncachedInDBTimer 9610: DBS now knows that CFID 7847011 is uncached
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:07 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719195
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Release of file CFID 7846185 from project ID 99938 has been recorded in the database
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: All consumers have seen the good file bh031b69.002bhel0(5620191)  at dcap://cdfcaf-door24
08/15/06 13:39:07 cdf-caf.SM.cdf-caf 9610: Project 99938 releases file bh031b69.002bhel0 at node dcap://cdfcaf-door24
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7846185 decRefCount 1
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: CFID 7846185 becoming disposable
08/15/06 13:39:07 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99938 of group test releasing file 5620191
08/15/06 13:39:07 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99938
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: File 5620191 becomes disposable
08/15/06 13:39:07 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Consumers at dcap://cdfcaf-door24 for project 99938 are happy
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Project DBProxy 5262: Warning, Db server became unreachable
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Project DBProxy 5262: Resolving Db Server Factory as SAMDbServer.cdfcafstation_prd:SAMDbServer
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Project DBProxy 5262: Obtaining servant of type Project
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.Project DBProxy 5262: DbServer is alive 
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Process 2343116 requests next file via CORBA callback
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: No files are available for process CPID 2343116 (hays(demo:1)@fcdfcaf933.fnal.gov[SAM Consumer Process](2343116))
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Process CPID 2343116 will not wait until other processes finish
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.EndOfFileStream.Worker 5262: Notifing, timeout set to 1 min.
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719195
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: 1535 to deliver on dcap://cdfcaf-door19 for project 99952
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door19 for project 99952
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7856364 incRefCount 0
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719195 on dcap://cdfcaf-door19 num to deliver 1534
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Not all consumers have finished, delaying end of project /SAMStations/cdf-caf/hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117:Project
08/15/06 13:39:07 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719195; 7447799 decRefCount 1
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: CFID 7447799 becoming disposable
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:07 cdf-caf.SM.FileCachedInDB 9610: File 2719195 acquired cached file ID 7856364
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:07 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.0090bhd0 to project 99952
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.0090bhd0 arrived at cdf-caf:dcap://cdfcaf-door19:dcap://cdfdca2.fnal.gov:25153/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:07 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.0090bhd0
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856364
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856364 will be set to test
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:07 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719194
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf885.fnal.gov[SAM Consumer Process](2343502) closes file xd0274dc.0352bhd0(2719033) 
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf885.fnal.gov[SAM Consumer Process](2343502)
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719194
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: 1752 to deliver on dcap://cdfcaf-door18 for project 99952
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door18 for project 99952
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7856365 incRefCount 0
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719194 on dcap://cdfcaf-door18 num to deliver 1751
08/15/06 13:39:07 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719194; 7449739 decRefCount 1
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: CFID 7449739 becoming disposable
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:07 cdf-caf.SM.FileCachedInDB 9610: File 2719194 acquired cached file ID 7856365
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:07 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027505.0486bhd0 to project 99952
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027505.0486bhd0 arrived at cdf-caf:dcap://cdfcaf-door18:dcap://cdfdca2.fnal.gov:25152/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:07 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027505.0486bhd0
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856181 from project ID 99952 has been recorded in the database
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd0274dc.0352bhd0(2719033)  at dcap://cdfcaf-door17
08/15/06 13:39:07 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd0274dc.0352bhd0 at node dcap://cdfcaf-door17
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7856181 decRefCount 1
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: CFID 7856181 becoming disposable
08/15/06 13:39:07 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2719033
08/15/06 13:39:07 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: File 2719033 becomes disposable
08/15/06 13:39:07 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:07 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door17
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 0
08/15/06 13:39:07 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 1
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719186 
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719186 from CFID 7449360
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7449360 decRefCount 2
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343502 requests next file via CORBA callback
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343502 (tkuhr(demo:1)@fcdfcaf885.fnal.gov[SAM Consumer Process](2343502))
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856364 by project ID 99952 has been recorded in the database
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.0090bhd0 arrived to dcap://cdfcaf-door19:dcap://cdfdca2.fnal.gov:25153/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719195: (91166)
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf610.fnal.gov[SAM Consumer Process](2343549) about to open file xd027507.0090bhd0(2719195) 
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf610.fnal.gov[SAM Consumer Process](2343549)
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf610.fnal.gov[SAM Consumer Process](2343549) successfully opens file xd027507.0090bhd0(2719195) 
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856365
08/15/06 13:39:07 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856365 will be set to test
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:07 cdf-caf.SM.CacheMan test 9610: Needed: 333712745B. can have: 232401821MB. Cache manager uses 169961501MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:07 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:07 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:07 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719186 is constrained to disks 735 
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719186->735 
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:07 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:07 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:07 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: 7449360 incRefCount 1
08/15/06 13:39:07 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719186; 7449360 decRefCount 2
08/15/06 13:39:07 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027505.03c5bhd0(2719186)
08/15/06 13:39:07 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856365 by project ID 99952 has been recorded in the database
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027505.0486bhd0 arrived to dcap://cdfcaf-door18:dcap://cdfdca2.fnal.gov:25152/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719194: (91166)
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf350.fnal.gov[SAM Consumer Process](2343551) about to open file xd027505.0486bhd0(2719194) 
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf350.fnal.gov[SAM Consumer Process](2343551)
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf350.fnal.gov[SAM Consumer Process](2343551) successfully opens file xd027505.0486bhd0(2719194) 
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Proc johnpaul(demo:1)@fcdfcaf1067.fnal.gov[SAM Consumer Process](2344928) closes file bh03175a.0019lpc0(5543803) 
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Skipping idle TO for process johnpaul(demo:1)@fcdfcaf1067.fnal.gov[SAM Consumer Process](2344928)
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Station DBProxy 11850: Warning, Db server became unreachable
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Station DBProxy 11850: Resolving Db Server Factory as SAMDbServer.cdfcafstation_prd:SAMDbServer
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Station DBProxy 11850: Obtaining servant of type Station
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Station DBProxy 11850: DbServer is alive 
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:08 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:08 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:08 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:08 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3141/GJ3141.0 -> dcap://cdfdca2.fnal.gov:25151/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3141/GJ3141.0
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:08 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027505.03c5bhd0(2719186)
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:08 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719186
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Release of file CFID 7855288 from project ID 100033 has been recorded in the database
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: All consumers have seen the good file bh03175a.0019lpc0(5543803)  at dcap://cdfcaf-door24
08/15/06 13:39:08 cdf-caf.SM.cdf-caf 9610: Project 100033 releases file bh03175a.0019lpc0 at node dcap://cdfcaf-door24
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: 7855288 decRefCount 1
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: CFID 7855288 becoming disposable
08/15/06 13:39:08 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100033 of group test releasing file 5543803
08/15/06 13:39:08 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100033
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: File 5543803 becomes disposable
08/15/06 13:39:08 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100033 at dcap://cdfcaf-door24
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: 6498275 incRefCount 0
08/15/06 13:39:08 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: 6498275 incRefCount 1
08/15/06 13:39:08 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:08 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 5543866 
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: Created intra-station request for file 5543866 from CFID 6498275
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: 6498275 decRefCount 2
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719186
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: 1004 to deliver on dcap://cdfcaf-door17 for project 99952
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door17 for project 99952
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: 7856366 incRefCount 0
08/15/06 13:39:08 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719186 on dcap://cdfcaf-door17 num to deliver 1003
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Project DBProxy 11850: Warning, Db server became unreachable
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Project DBProxy 11850: Resolving Db Server Factory as SAMDbServer.cdfcafstation_prd:SAMDbServer
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Project DBProxy 11850: Obtaining servant of type Project
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.Project DBProxy 11850: DbServer is alive 
08/15/06 13:39:08 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719186; 7449360 decRefCount 1
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: CFID 7449360 becoming disposable
08/15/06 13:39:08 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:08 cdf-caf.SM.FileCachedInDB 9610: File 2719186 acquired cached file ID 7856366
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:08 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:08 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027505.03c5bhd0 to project 99952
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027505.03c5bhd0 arrived at cdf-caf:dcap://cdfcaf-door17:dcap://cdfdca2.fnal.gov:25151/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3141/GJ3141.0
08/15/06 13:39:08 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027505.03c5bhd0
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856366
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856366 will be set to test
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Process 2344928 requests next file via CORBA callback
08/15/06 13:39:08 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: No files are available for process CPID 2344928 (johnpaul(demo:1)@fcdfcaf1067.fnal.gov[SAM Consumer Process](2344928))
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856366 by project ID 99952 has been recorded in the database
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027505.03c5bhd0 arrived to dcap://cdfcaf-door17:dcap://cdfdca2.fnal.gov:25151/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3141/GJ3141.0
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719186: (91166)
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf885.fnal.gov[SAM Consumer Process](2343502) about to open file xd027505.03c5bhd0(2719186) 
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf885.fnal.gov[SAM Consumer Process](2343502)
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf885.fnal.gov[SAM Consumer Process](2343502) successfully opens file xd027505.03c5bhd0(2719186) 
08/15/06 13:39:08 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:09 cdf-caf.SM.CacheMan test 9610: Needed: 790066949B. can have: 232402332MB. Cache manager uses 169961820MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:09 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:09 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 5543866 is constrained to disks 742 
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing 7842607 , delivering (file->disk): 5543866->742 
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: Deleted a real state from file 6431613; there are 1 real states and 1 zombies
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: Telling DBS that 1 files are being uncached
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:09 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (7842607:test)
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: Work to erase 1 files is broken down for 1 stagers
08/15/06 13:39:09 cdf-caf.SM.DCAPDiskAgent 9610: Ignoring erase file physically
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: Deleted a Zombie state from file 6431613; there are 1 real states and 0 zombies
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:09 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: 6498275 incRefCount 1
08/15/06 13:39:09 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: Deleted a real state from file 5543866; 6498275 decRefCount 2
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: Scheduling transfer for bh031760.0095lpc0(5543866)
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:09 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:09 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (7842607:test)
08/15/06 13:39:09 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:09 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf864.fnal.gov[SAM Consumer Process](2343580) closes file xd027761.04adbhd0(2723604) 
08/15/06 13:39:09 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf864.fnal.gov[SAM Consumer Process](2343580)
08/15/06 13:39:09 cdf-caf.SM.FileUncachedInDBTimer 9610: DBS now knows that CFID 7842607 is uncached
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:09 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM40/SM4032/SM4032.2 -> dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM40/SM4032/SM4032.2
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:09 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile bh031760.0095lpc0(5543866)
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:09 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 5543866
08/15/06 13:39:09 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856019 from project ID 99952 has been recorded in the database
08/15/06 13:39:09 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027761.04adbhd0(2723604)  at dcap://cdfcaf-door8
08/15/06 13:39:09 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027761.04adbhd0 at node dcap://cdfcaf-door8
08/15/06 13:39:09 cdf-caf.reid_cdf-caf_x6nx5h_205665_2517.PollProcess.Worker 17405: Notifing, timeout set to 1 min.
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: 7856019 decRefCount 1
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: CFID 7856019 becoming disposable
08/15/06 13:39:09 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723604
08/15/06 13:39:09 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: File 2723604 becomes disposable
08/15/06 13:39:09 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door8
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: 7448720 incRefCount 0
08/15/06 13:39:09 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: 7448720 incRefCount 1
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:09 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719192 
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719192 from CFID 7448720
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: 7448720 decRefCount 2
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: Checking if project 100033 can use file 5543866
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: 44 to deliver on dcap://cdfcaf-door24 for project 100033
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door24 for project 100033
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: Project 100033 will now be able to use 1 cached files
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: 7856367 incRefCount 0
08/15/06 13:39:09 cdf-caf.SM.ProjectManager 9610: Project 100033 uses file 5543866 on dcap://cdfcaf-door24 num to deliver 43
08/15/06 13:39:09 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:09 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343580 requests next file via CORBA callback
08/15/06 13:39:09 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343580 (tkuhr(demo:1)@fcdfcaf864.fnal.gov[SAM Consumer Process](2343580))
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: Deleted a real state from file 5543866; 6498275 decRefCount 1
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: CFID 6498275 becoming disposable
08/15/06 13:39:09 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:09 cdf-caf.SM.FileCachedInDB 9610: File 5543866 acquired cached file ID 7856367
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:09 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:09 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file bh031760.0095lpc0 to project 100033
08/15/06 13:39:09 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: bh031760.0095lpc0 arrived at cdf-caf:dcap://cdfcaf-door24:dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM40/SM4032/SM4032.2
08/15/06 13:39:09 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GiveFile2ProjectInDBTimer 11850: Telling DBS that project 100033 uses file CFID 7856367
08/15/06 13:39:09 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100033 contacted OK, actually uses file bh031760.0095lpc0
08/15/06 13:39:09 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GiveFile2ProjectInDBTimer 11850: Owner group for file CFID 7856367 will be set to test
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GiveFile2ProjectInDBTimer 11850: Usage of file CFID 7856367 by project ID 100033 has been recorded in the database
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: File bh031760.0095lpc0 arrived to dcap://cdfcaf-door24:dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM40/SM4032/SM4032.2
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Umers interested in file 5543866: (91189)
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Proc johnpaul(demo:1)@fcdfcaf1067.fnal.gov[SAM Consumer Process](2344928) about to open file bh031760.0095lpc0(5543866) 
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Skipping busy TO for process johnpaul(demo:1)@fcdfcaf1067.fnal.gov[SAM Consumer Process](2344928)
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.GPM 11850: Proc johnpaul(demo:1)@fcdfcaf1067.fnal.gov[SAM Consumer Process](2344928) successfully opens file bh031760.0095lpc0(5543866) 
08/15/06 13:39:10 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.FileReady.Worker 11850: Notifing, timeout set to 1 min.
08/15/06 13:39:10 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.PollProcess.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:39:10 cdf-caf.reid_cdf-caf_x6nx5h_205665_2517.PollProcess.Worker 17405: Notifing, timeout set to 1 min.
08/15/06 13:39:10 cdf-caf.byhan_20060718152313.PollProcess.Worker 16611: Notifing, timeout set to 1 min.
08/15/06 13:39:10 cdf-caf.byhan_20060718152313.PollProcess.Worker 16611: CPID 2205668 does not have IOR set
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:10 cdf-caf.SM.CacheMan test 9610: Needed: 326952336B. can have: 232403096MB. Cache manager uses 169961076MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:10 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:10 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719192 is constrained to disks 726 
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719192->726 
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:10 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:10 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:10 cdf-caf.SM.FileManager 9610: 7448720 incRefCount 1
08/15/06 13:39:10 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:10 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719192; 7448720 decRefCount 2
08/15/06 13:39:10 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027505.046bbhd0(2719192)
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:10 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:10 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:10 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:10 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0 -> dcap://cdfdca1.fnal.gov:25142/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:10 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027505.046bbhd0(2719192)
08/15/06 13:39:10 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:10 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719192
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719192
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: 1303 to deliver on dcap://cdfcaf-door8 for project 99952
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door8 for project 99952
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:10 cdf-caf.SM.FileManager 9610: 7856368 incRefCount 0
08/15/06 13:39:10 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719192 on dcap://cdfcaf-door8 num to deliver 1302
08/15/06 13:39:11 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:11 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719192; 7448720 decRefCount 1
08/15/06 13:39:11 cdf-caf.SM.FileManager 9610: CFID 7448720 becoming disposable
08/15/06 13:39:11 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:11 cdf-caf.SM.FileCachedInDB 9610: File 2719192 acquired cached file ID 7856368
08/15/06 13:39:11 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:11 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:11 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027505.046bbhd0 to project 99952
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027505.046bbhd0 arrived at cdf-caf:dcap://cdfcaf-door8:dcap://cdfdca1.fnal.gov:25142/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:11 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027505.046bbhd0
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856368
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856368 will be set to test
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856368 by project ID 99952 has been recorded in the database
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027505.046bbhd0 arrived to dcap://cdfcaf-door8:dcap://cdfdca1.fnal.gov:25142/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719192: (91166)
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf864.fnal.gov[SAM Consumer Process](2343580) about to open file xd027505.046bbhd0(2719192) 
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf864.fnal.gov[SAM Consumer Process](2343580)
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf864.fnal.gov[SAM Consumer Process](2343580) successfully opens file xd027505.046bbhd0(2719192) 
08/15/06 13:39:11 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:11 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:11 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:11 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:11 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:12 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:12 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.PollProcess.Worker 5262: Notifing, timeout set to 1 min.
08/15/06 13:39:12 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:12 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:12 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:14 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:14 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:15 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:15 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Thread 16470: Consumer ljn(demo:1) requests registering. 
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Novelty flag: 0
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Consumer already exists
08/15/06 13:39:15 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Umer 91210 described as SAM Consumer Process registers process
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf940.fnal.gov[SAM Consumer Process](CID=91210) acquired CPID=2345617
08/15/06 13:39:15 cdf-caf.SM.cdf-caf 9610: Consumption is being enabled for project 100092 at node dcap://cdfcaf-door24 num files to deliver : 20
08/15/06 13:39:15 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:15 cdf-caf.SM.ProjectManager 9610: Project 100092 will now be able to use 1 cached files
08/15/06 13:39:15 cdf-caf.SM.FileManager 9610: 7850496 incRefCount 1
08/15/06 13:39:15 cdf-caf.SM.ProjectManager 9610: Project 100092 uses file 4707816 on dcap://cdfcaf-door24 num to deliver 55
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Skipping idle TO for process ljn(demo:1)@fcdfcaf940.fnal.gov[SAM Consumer Process](2345617)
08/15/06 13:39:15 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file bh030971.00e2hel0 to project 100092
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc fcdfcaf940.fnal.gov(CID=91210) acquired CPID=2345617
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Process 2345617 requests next file via CORBA callback
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: No files are available for process CPID 2345617 (ljn(demo:1)@fcdfcaf940.fnal.gov[SAM Consumer Process](2345617))
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: bh030971.00e2hel0 arrived at cdf-caf:dcap://cdfcaf-door24:dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM15/SM1589/SM1589.3
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GiveFile2ProjectInDBTimer 16470: Telling DBS that project 100092 uses file CFID 7850496
08/15/06 13:39:15 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100092 contacted OK, actually uses file bh030971.00e2hel0
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GiveFile2ProjectInDBTimer 16470: Owner group for file CFID 7850496 will be set to test
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GiveFile2ProjectInDBTimer 16470: Usage of file CFID 7850496 by project ID 100092 has been recorded in the database
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: File bh030971.00e2hel0 arrived to dcap://cdfcaf-door24:dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM15/SM1589/SM1589.3
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Umers interested in file 4707816: (91210)
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf940.fnal.gov[SAM Consumer Process](2345617) about to open file bh030971.00e2hel0(4707816) 
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Skipping busy TO for process ljn(demo:1)@fcdfcaf940.fnal.gov[SAM Consumer Process](2345617)
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf940.fnal.gov[SAM Consumer Process](2345617) successfully opens file bh030971.00e2hel0(4707816) 
08/15/06 13:39:15 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.FileReady.Worker 16470: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf944.fnal.gov[SAM Consumer Process](2343395) closes file xd0274f3.0246bhd0(2719043) 
08/15/06 13:39:16 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf944.fnal.gov[SAM Consumer Process](2343395)
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856205 from project ID 99952 has been recorded in the database
08/15/06 13:39:16 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd0274f3.0246bhd0(2719043)  at dcap://cdfcaf-door12
08/15/06 13:39:16 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd0274f3.0246bhd0 at node dcap://cdfcaf-door12
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: 7856205 decRefCount 1
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: CFID 7856205 becoming disposable
08/15/06 13:39:16 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2719043
08/15/06 13:39:16 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610: File 2719043 becomes disposable
08/15/06 13:39:16 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door12
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: 7447802 incRefCount 0
08/15/06 13:39:16 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: 7447802 incRefCount 1
08/15/06 13:39:16 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:16 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719193 
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719193 from CFID 7447802
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: 7447802 decRefCount 2
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:16 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343395 requests next file via CORBA callback
08/15/06 13:39:16 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343395 (tkuhr(demo:1)@fcdfcaf944.fnal.gov[SAM Consumer Process](2343395))
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:16 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2345599) closes file bh0308e2.060chel0(4706306) 
08/15/06 13:39:16 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Skipping idle TO for process ljn(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2345599)
08/15/06 13:39:16 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Release of file CFID 7850444 from project ID 100092 has been recorded in the database
08/15/06 13:39:16 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: All consumers have seen the good file bh0308e2.060chel0(4706306)  at dcap://cdfcaf-door24
08/15/06 13:39:16 cdf-caf.SM.cdf-caf 9610: Project 100092 releases file bh0308e2.060chel0 at node dcap://cdfcaf-door24
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: 7850444 decRefCount 2
08/15/06 13:39:16 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100092 of group test releasing file 4706306
08/15/06 13:39:16 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100092
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610: File 4706306 does not become disposable
08/15/06 13:39:16 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610: Project 100092 will now be able to use 1 cached files
08/15/06 13:39:16 cdf-caf.SM.FileManager 9610: 7851099 incRefCount 1
08/15/06 13:39:16 cdf-caf.SM.ProjectManager 9610: Project 100092 uses file 4731864 on dcap://cdfcaf-door24 num to deliver 54
08/15/06 13:39:16 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file bh0309ec.0213hel0 to project 100092
08/15/06 13:39:16 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: bh0309ec.0213hel0 arrived at cdf-caf:dcap://cdfcaf-door24:dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM16/SM1616/SM1616.7
08/15/06 13:39:16 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 100092 contacted OK, actually uses file bh0309ec.0213hel0
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Process 2345599 requests next file via CORBA callback
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: No files are available for process CPID 2345599 (ljn(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2345599))
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GiveFile2ProjectInDBTimer 16470: Telling DBS that project 100092 uses file CFID 7851099
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GiveFile2ProjectInDBTimer 16470: Owner group for file CFID 7851099 will be set to test
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GiveFile2ProjectInDBTimer 16470: Usage of file CFID 7851099 by project ID 100092 has been recorded in the database
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: File bh0309ec.0213hel0 arrived to dcap://cdfcaf-door24:dcap://cdfdca3.fnal.gov:25158/pnfs/fnal.gov/usr/cdfen/filesets/SM/SM16/SM1616/SM1616.7
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Umers interested in file 4731864: (91210)
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2345599) about to open file bh0309ec.0213hel0(4731864) 
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Skipping busy TO for process ljn(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2345599)
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf861.fnal.gov[SAM Consumer Process](2345599) successfully opens file bh0309ec.0213hel0(4731864) 
08/15/06 13:39:17 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.FileReady.Worker 16470: Notifing, timeout set to 1 min.
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:17 cdf-caf.SM.CacheMan test 9610: Needed: 319952404B. can have: 232403438MB. Cache manager uses 169961388MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:17 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:17 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719193 is constrained to disks 730 
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing (none), delivering (file->disk): 2719193->730 
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: Telling DBS that 0 files are being uncached
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:17 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (empty)
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: Work to erase 0 files is broken down for 0 stagers
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:17 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: 7447802 incRefCount 1
08/15/06 13:39:17 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719193; 7447802 decRefCount 2
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.009abhd0(2719193)
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:17 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:17 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (empty)
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:17 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0 -> dcap://cdfdca2.fnal.gov:25146/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:17 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.009abhd0(2719193)
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:17 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719193
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719193
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: 780 to deliver on dcap://cdfcaf-door12 for project 99952
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door12 for project 99952
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: 7856369 incRefCount 0
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719193 on dcap://cdfcaf-door12 num to deliver 779
08/15/06 13:39:17 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719193; 7447802 decRefCount 1
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: CFID 7447802 becoming disposable
08/15/06 13:39:17 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:17 cdf-caf.SM.FileCachedInDB 9610: File 2719193 acquired cached file ID 7856369
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:17 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:17 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.009abhd0 to project 99952
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: xd027507.009abhd0 arrived at cdf-caf:dcap://cdfcaf-door12:dcap://cdfdca2.fnal.gov:25146/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:17 cdf-caf.SM.FileReceiverProjectProxy 9610: Project 99952 contacted OK, actually uses file xd027507.009abhd0
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Telling DBS that project 99952 uses file CFID 7856369
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Owner group for file CFID 7856369 will be set to test
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GiveFile2ProjectInDBTimer 6459: Usage of file CFID 7856369 by project ID 99952 has been recorded in the database
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: File xd027507.009abhd0 arrived to dcap://cdfcaf-door12:dcap://cdfdca2.fnal.gov:25146/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3140/GJ3140.0
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Umers interested in file 2719193: (91166)
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf944.fnal.gov[SAM Consumer Process](2343395) about to open file xd027507.009abhd0(2719193) 
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping busy TO for process tkuhr(demo:1)@fcdfcaf944.fnal.gov[SAM Consumer Process](2343395)
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf944.fnal.gov[SAM Consumer Process](2343395) successfully opens file xd027507.009abhd0(2719193) 
08/15/06 13:39:17 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.FileReady.Worker 6459: Notifing, timeout set to 1 min.
08/15/06 13:39:17 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:17 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:17 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: System exception `COMM_FAILURE'
Reason: Connection refused
Completed: no
Minor code: 1330577418 (connect() failed)
08/15/06 13:39:17 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.GPM 20070: Proc vrusu@fcdfcaf997.fnal.gov[SAM Consumer Process](2343902) ends abnormally
08/15/06 13:39:17 cdf-caf.SM.ProjectManager 9610: There are now 1 umers for project 99889 at node dcap://cdfcaf-door7
08/15/06 13:39:17 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.GPM 20070: Telling cache manager that consumption lowers at node dcap://cdfcaf-door7 
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf390.fnal.gov[SAM Consumer Process](2343638) closes file xd027761.0426bhd0(2723599) 
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf390.fnal.gov[SAM Consumer Process](2343638)
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Proc tkuhr(demo:1)@fcdfcaf328.fnal.gov[SAM Consumer Process](2343637) closes file xd027761.046ebhd0(2723584) 
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Skipping idle TO for process tkuhr(demo:1)@fcdfcaf328.fnal.gov[SAM Consumer Process](2343637)
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Release of file CFID 7856039 from project ID 99952 has been recorded in the database
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: All consumers have seen the good file xd027761.046ebhd0(2723584)  at dcap://cdfcaf-door7
08/15/06 13:39:18 cdf-caf.SM.cdf-caf 9610: Project 99952 releases file xd027761.046ebhd0 at node dcap://cdfcaf-door7
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: 7856039 decRefCount 1
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: CFID 7856039 becoming disposable
08/15/06 13:39:18 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99952 of group test releasing file 2723584
08/15/06 13:39:18 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99952
08/15/06 13:39:18 cdf-caf.SM.ProjectManager 9610: File 2723584 becomes disposable
08/15/06 13:39:18 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:18 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 99952 at dcap://cdfcaf-door7
08/15/06 13:39:18 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: 7449740 incRefCount 0
08/15/06 13:39:18 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: 7449740 incRefCount 1
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2719196 
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2719196 from CFID 7449740
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: 7449740 decRefCount 2
08/15/06 13:39:18 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: Attempting new deliveries 
08/15/06 13:39:18 cdf-caf.SM.CacheMan test 9610: Needed: 332749369B. can have: 232403757MB. Cache manager uses 169961693MB out of 183840000MB. Trying to fit 1 files onto 31 disks, using fast algorithm
08/15/06 13:39:18 cdf-caf.SM.CacheFitter_constrained 9610: Initialized with 31 disks
08/15/06 13:39:18 cdf-caf.SM.ProjectManager 9610: Constraining delivery to the 1 consumption sites , priority : hi
08/15/06 13:39:18 cdf-caf.SM.CacheFitter_constrained 9610: Delivery of 2719196 is constrained to disks 725 
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: Executing cache replacement plan: erasing 7848657 , delivering (file->disk): 2719196->725 
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2701416; there are 1 real states and 1 zombies
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: Telling DBS that 1 files are being uncached
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:18 cdf-caf.SM.FileUncachedInDBTimer 9610: Creating work to uncache in DB files: (7848657:test)
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: Work to erase 1 files is broken down for 1 stagers
08/15/06 13:39:18 cdf-caf.SM.DCAPDiskAgent 9610: Ignoring erase file physically
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: Deleted a Zombie state from file 2701416; there are 1 real states and 0 zombies
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: 1 files can be delivered
08/15/06 13:39:18 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: 7449740 incRefCount 1
08/15/06 13:39:18 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719196; 7449740 decRefCount 2
08/15/06 13:39:18 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: Scheduling transfer for xd027507.000abhd0(2719196)
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: A whole unit has been delivered
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: Process 2343637 requests next file via CORBA callback
08/15/06 13:39:18 cdf-caf.tkuhr_cdf-caf_xbhd0d_205646_23406.GPM 6459: No files are available for process CPID 2343637 (tkuhr(demo:1)@fcdfcaf328.fnal.gov[SAM Consumer Process](2343637))
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: No more deliveries possible
08/15/06 13:39:18 cdf-caf.SM.Repler 9610: 0 rejected based on past brokering failures
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:18 cdf-caf.SM.FileUncachedInDBTimer 9610: About to uncache files (7848657:test)
08/15/06 13:39:18 cdf-caf.SM.FileUncachedInDBTimer 9610: DBS now knows that CFID 7848657 is uncached
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:18 cdf-caf.SM.DCAPDiskAgent 9610: dcap://cdfdca3.fnal.gov:25164/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0 -> dcap://cdfdca1.fnal.gov:25141/pnfs/fnal.gov/usr/cdfen/filesets/GJ/GJ31/GJ3139/GJ3139.0
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Adding work item
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Activating head item in the queue immediately
08/15/06 13:39:18 cdf-caf.SM.FileCachedInDB 9610: Created work to cache inXferFile xd027507.000abhd0(2719196)
08/15/06 13:39:18 cdf-caf.SM.DBS WorkQMan 9610: Dispatching work in the front of queue
08/15/06 13:39:18 cdf-caf.SM.FileCachedInDB 9610: Trying to cache file 2719196
08/15/06 13:39:19 cdf-caf.SM.ProjectManager 9610: Deferring ISX until hungry umers appear
08/15/06 13:39:19 cdf-caf.SM.ProjectManager 9610: Checking if project 99952 can use file 2719196
08/15/06 13:39:19 cdf-caf.SM.ProjectManager 9610: 2584 to deliver on dcap://cdfcaf-door7 for project 99952
08/15/06 13:39:19 cdf-caf.SM.ProjectManager 9610: Increasing consumer satisfaction level at node dcap://cdfcaf-door7 for project 99952
08/15/06 13:39:19 cdf-caf.SM.ProjectManager 9610: Project 99952 will now be able to use 1 cached files
08/15/06 13:39:19 cdf-caf.SM.FileManager 9610: 7856370 incRefCount 0
08/15/06 13:39:19 cdf-caf.SM.ProjectManager 9610: Project 99952 uses file 2719196 on dcap://cdfcaf-door7 num to deliver 2583
08/15/06 13:39:19 cdf-caf.SM.DataGuard 9610: Releasing source file at node dcap://cdfcaf-backbone
08/15/06 13:39:19 cdf-caf.SM.FileManager 9610: Deleted a real state from file 2719196; 7449740 decRefCount 1
08/15/06 13:39:19 cdf-caf.SM.FileManager 9610: CFID 7449740 becoming disposable
08/15/06 13:39:19 cdf-caf.SM.FileManager 9610: there are 2 real states and 0 zombies
08/15/06 13:39:19 cdf-caf.SM.FileCachedInDB 9610: File 2719196 acquired cached file ID 7856370
08/15/06 13:39:19 cdf-caf.SM.DBS WorkQMan 9610: Notifying client of work completion
08/15/06 13:39:19 cdf-caf.SM.DBS WorkQMan 9610: Activating next item in the queue, if any
08/15/06 13:39:19 cdf-caf.SM.FileReceiverProjectProxy 9610: Trying to give file xd027507.000abhd0 to project 99952
08/15/06 13:39:19 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:20 cdf-caf.reid_cdf-caf_x6nx5h_205665_2517.PollProcess.Worker 17405: Notifing, timeout set to 1 min.
08/15/06 13:39:22 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:23 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:23 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Thread 16459: Consumer ljn(demo:1) requests registering. 
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Novelty flag: 0
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Consumer already exists
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Umer 91209 described as SAM Consumer Process registers process
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Proc ljn(demo:1)@fcdfcaf927.fnal.gov[SAM Consumer Process](CID=91209) acquired CPID=2345618
08/15/06 13:39:24 cdf-caf.SM.cdf-caf 9610: Consumption is being enabled for project 100091 at node dcap://cdfcaf-door25 num files to deliver : 20
08/15/06 13:39:24 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:24 cdf-caf.SM.ProjectManager 9610: Project 100091 will now be able to use 1 cached files
08/15/06 13:39:24 cdf-caf.SM.FileManager 9610: 7508239 incRefCount 1
08/15/06 13:39:24 cdf-caf.SM.ProjectManager 9610: Project 100091 uses file 2574190 on dcap://cdfcaf-door25 num to deliver 19
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Skipping idle TO for process ljn(demo:1)@fcdfcaf927.fnal.gov[SAM Consumer Process](2345618)
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Proc fcdfcaf927.fnal.gov(CID=91209) acquired CPID=2345618
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Process 2345618 requests next file via CORBA callback
08/15/06 13:39:24 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: No files are available for process CPID 2345618 (ljn(demo:1)@fcdfcaf927.fnal.gov[SAM Consumer Process](2345618))
08/15/06 13:39:24 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:25 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:25 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.PollProcess.Worker 5262: Notifing, timeout set to 1 min.
08/15/06 13:39:25 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:25 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:26 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:26 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf919.fnal.gov[SAM Consumer Process](2345542) closes file bh02fe39.013ahmu0(4532252) 
08/15/06 13:39:26 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping idle TO for process genser(demo:1)@fcdfcaf919.fnal.gov[SAM Consumer Process](2345542)
08/15/06 13:39:26 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Release of file CFID 7852193 from project ID 100093 has been recorded in the database
08/15/06 13:39:26 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: All consumers have seen the good file bh02fe39.013ahmu0(4532252)  at dcap://cdfcaf-door4
08/15/06 13:39:26 cdf-caf.SM.cdf-caf 9610: Project 100093 releases file bh02fe39.013ahmu0 at node dcap://cdfcaf-door4
08/15/06 13:39:26 cdf-caf.SM.FileManager 9610: 7852193 decRefCount 1
08/15/06 13:39:26 cdf-caf.SM.FileManager 9610: CFID 7852193 becoming disposable
08/15/06 13:39:26 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100093 of group test releasing file 4532252
08/15/06 13:39:26 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100093
08/15/06 13:39:26 cdf-caf.SM.ProjectManager 9610: File 4532252 becomes disposable
08/15/06 13:39:26 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:26 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:26 cdf-caf.SM.ProjectManager 9610: Project 100093 will now be able to use 1 cached files
08/15/06 13:39:26 cdf-caf.SM.FileManager 9610: 7853604 incRefCount 0
08/15/06 13:39:26 cdf-caf.SM.ProjectManager 9610: Project 100093 uses file 4556791 on dcap://cdfcaf-door4 num to deliver 35
08/15/06 13:39:26 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Process 2345542 requests next file via CORBA callback
08/15/06 13:39:26 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: No files are available for process CPID 2345542 (genser(demo:1)@fcdfcaf919.fnal.gov[SAM Consumer Process](2345542))
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Thread 16470: Consumer ljn(demo:1) requests registering. 
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Novelty flag: 0
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Consumer already exists
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Umer 91210 described as SAM Consumer Process registers process
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf941.fnal.gov[SAM Consumer Process](CID=91210) acquired CPID=2345619
08/15/06 13:39:27 cdf-caf.SM.cdf-caf 9610: Consumption is being enabled for project 100092 at node dcap://cdfcaf-door16 num files to deliver : 20
08/15/06 13:39:27 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:27 cdf-caf.SM.ProjectManager 9610: Project 100092 will now be able to use 1 cached files
08/15/06 13:39:27 cdf-caf.SM.FileManager 9610: 7847361 incRefCount 1
08/15/06 13:39:27 cdf-caf.SM.ProjectManager 9610: Project 100092 uses file 4506253 on dcap://cdfcaf-door16 num to deliver 19
08/15/06 13:39:27 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Skipping idle TO for process ljn(demo:1)@fcdfcaf941.fnal.gov[SAM Consumer Process](2345619)
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc fcdfcaf941.fnal.gov(CID=91210) acquired CPID=2345619
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Process 2345619 requests next file via CORBA callback
08/15/06 13:39:27 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: No files are available for process CPID 2345619 (ljn(demo:1)@fcdfcaf941.fnal.gov[SAM Consumer Process](2345619))
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Thread 16459: Consumer ljn(demo:1) requests registering. 
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Thread 16470: Consumer ljn(demo:1) requests registering. 
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Novelty flag: 0
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Consumer already exists
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Novelty flag: 0
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Consumer already exists
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Umer 91209 described as SAM Consumer Process registers process
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Proc ljn(demo:1)@fcdfcaf898.fnal.gov[SAM Consumer Process](CID=91209) acquired CPID=2345620
08/15/06 13:39:28 cdf-caf.SM.cdf-caf 9610: Consumption is being enabled for project 100091 at node dcap://cdfcaf-door22 num files to deliver : 20
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Umer 91210 described as SAM Consumer Process registers process
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc ljn(demo:1)@fcdfcaf935.fnal.gov[SAM Consumer Process](CID=91210) acquired CPID=2345621
08/15/06 13:39:28 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100091 at dcap://cdfcaf-door22
08/15/06 13:39:28 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:28 cdf-caf.SM.FileManager 9610: 7506845 incRefCount 0
08/15/06 13:39:28 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:28 cdf-caf.SM.FileManager 9610: 7506845 incRefCount 1
08/15/06 13:39:28 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:28 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2569723 
08/15/06 13:39:28 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2569723 from CFID 7506845
08/15/06 13:39:28 cdf-caf.SM.FileManager 9610: 7506845 decRefCount 2
08/15/06 13:39:28 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Skipping idle TO for process ljn(demo:1)@fcdfcaf898.fnal.gov[SAM Consumer Process](2345620)
08/15/06 13:39:28 cdf-caf.SM.cdf-caf 9610: Consumption is being enabled for project 100092 at node dcap://cdfcaf-door3 num files to deliver : 20
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Proc fcdfcaf898.fnal.gov(CID=91209) acquired CPID=2345620
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Process 2345620 requests next file via CORBA callback
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: No files are available for process CPID 2345620 (ljn(demo:1)@fcdfcaf898.fnal.gov[SAM Consumer Process](2345620))
08/15/06 13:39:28 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, using it to satisfy consumer
08/15/06 13:39:28 cdf-caf.SM.ProjectManager 9610: Project 100092 will now be able to use 1 cached files
08/15/06 13:39:28 cdf-caf.SM.FileManager 9610: 7851458 incRefCount 1
08/15/06 13:39:28 cdf-caf.SM.ProjectManager 9610: Project 100092 uses file 4750365 on dcap://cdfcaf-door3 num to deliver 55
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Skipping idle TO for process ljn(demo:1)@fcdfcaf935.fnal.gov[SAM Consumer Process](2345621)
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Proc fcdfcaf935.fnal.gov(CID=91210) acquired CPID=2345621
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: Process 2345621 requests next file via CORBA callback
08/15/06 13:39:28 cdf-caf.ljn_cdf-caf_bhel0h_205664_30434.GPM 16470: No files are available for process CPID 2345621 (ljn(demo:1)@fcdfcaf935.fnal.gov[SAM Consumer Process](2345621))
08/15/06 13:39:29 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:29 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:29 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:30 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:32 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:32 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.jpursley_cdf-caf_xpmm0i_205557_23646.PollProcess.Worker 18829: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:35 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: System exception `COMM_FAILURE'
Reason: Connection refused
Completed: no
Minor code: 1330577418 (connect() failed)
08/15/06 13:39:35 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.GPM 20070: Proc vrusu@fcdfcaf981.fnal.gov[SAM Consumer Process](2343904) ends abnormally
08/15/06 13:39:35 cdf-caf.SM.ProjectManager 9610: There are now 4 umers for project 99889 at node dcap://cdfcaf-door6
08/15/06 13:39:35 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.GPM 20070: Telling cache manager that consumption lowers at node dcap://cdfcaf-door6 
08/15/06 13:39:36 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:37 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Proc ljn(demo:1)@fcdfcaf947.fnal.gov[SAM Consumer Process](2345458) closes file bd021e46.0050hel0(2569685) 
08/15/06 13:39:37 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Skipping idle TO for process ljn(demo:1)@fcdfcaf947.fnal.gov[SAM Consumer Process](2345458)
08/15/06 13:39:37 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Release of file CFID 7856239 from project ID 100091 has been recorded in the database
08/15/06 13:39:37 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: All consumers have seen the good file bd021e46.0050hel0(2569685)  at dcap://cdfcaf-door22
08/15/06 13:39:37 cdf-caf.SM.cdf-caf 9610: Project 100091 releases file bd021e46.0050hel0 at node dcap://cdfcaf-door22
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7856239 decRefCount 1
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: CFID 7856239 becoming disposable
08/15/06 13:39:37 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100091 of group test releasing file 2569685
08/15/06 13:39:37 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100091
08/15/06 13:39:37 cdf-caf.SM.ProjectManager 9610: File 2569685 becomes disposable
08/15/06 13:39:37 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:37 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100091 at dcap://cdfcaf-door22
08/15/06 13:39:37 cdf-caf.SM.ProjectManager 9610:  Found 2 hits, reaquired for ISX
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7506821 incRefCount 0
08/15/06 13:39:37 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7506821 incRefCount 1
08/15/06 13:39:37 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:37 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2569724 
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2569724 from CFID 7506821
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7506821 decRefCount 2
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7506844 incRefCount 0
08/15/06 13:39:37 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7506844 incRefCount 1
08/15/06 13:39:37 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:37 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2569725 
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2569725 from CFID 7506844
08/15/06 13:39:37 cdf-caf.SM.FileManager 9610: 7506844 decRefCount 2
08/15/06 13:39:37 cdf-caf.SM.ProjectManager 9610: 2 Total requests created, to satisfyConsumers
08/15/06 13:39:37 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Process 2345458 requests next file via CORBA callback
08/15/06 13:39:37 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: No files are available for process CPID 2345458 (ljn(demo:1)@fcdfcaf947.fnal.gov[SAM Consumer Process](2345458))
08/15/06 13:39:38 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:39 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:39 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:40 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Proc ljn(demo:1)@fcdfcaf925.fnal.gov[SAM Consumer Process](2345581) closes file bd0245ac.0220hel0(2569698) 
08/15/06 13:39:40 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Skipping idle TO for process ljn(demo:1)@fcdfcaf925.fnal.gov[SAM Consumer Process](2345581)
08/15/06 13:39:40 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Release of file CFID 7856292 from project ID 100091 has been recorded in the database
08/15/06 13:39:40 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: All consumers have seen the good file bd0245ac.0220hel0(2569698)  at dcap://cdfcaf-door21
08/15/06 13:39:40 cdf-caf.SM.cdf-caf 9610: Project 100091 releases file bd0245ac.0220hel0 at node dcap://cdfcaf-door21
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7856292 decRefCount 1
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: CFID 7856292 becoming disposable
08/15/06 13:39:40 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100091 of group test releasing file 2569698
08/15/06 13:39:40 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100091
08/15/06 13:39:40 cdf-caf.SM.ProjectManager 9610: File 2569698 becomes disposable
08/15/06 13:39:40 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:40 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100091 at dcap://cdfcaf-door21
08/15/06 13:39:40 cdf-caf.SM.ProjectManager 9610:  Found 3 hits, reaquired for ISX
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506795 incRefCount 0
08/15/06 13:39:40 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506795 incRefCount 1
08/15/06 13:39:40 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:40 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2569726 
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2569726 from CFID 7506795
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506795 decRefCount 2
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506822 incRefCount 0
08/15/06 13:39:40 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506822 incRefCount 1
08/15/06 13:39:40 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:40 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2569727 
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2569727 from CFID 7506822
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506822 decRefCount 2
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506818 incRefCount 0
08/15/06 13:39:40 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506818 incRefCount 1
08/15/06 13:39:40 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:40 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 2569728 
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: Created intra-station request for file 2569728 from CFID 7506818
08/15/06 13:39:40 cdf-caf.SM.FileManager 9610: 7506818 decRefCount 2
08/15/06 13:39:40 cdf-caf.SM.ProjectManager 9610: 3 Total requests created, to satisfyConsumers
08/15/06 13:39:40 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: Process 2345581 requests next file via CORBA callback
08/15/06 13:39:40 cdf-caf.ljn_cdf-caf_bhel0d_205664_30294.GPM 16459: No files are available for process CPID 2345581 (ljn(demo:1)@fcdfcaf925.fnal.gov[SAM Consumer Process](2345581))
08/15/06 13:39:40 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:40 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:41 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:43 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:43 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:43 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:45 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:46 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:46 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf590.fnal.gov[SAM Consumer Process](2345501) closes file bh030169.039chmu0(4580155) 
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping idle TO for process genser(demo:1)@fcdfcaf590.fnal.gov[SAM Consumer Process](2345501)
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Release of file CFID 7855969 from project ID 100093 has been recorded in the database
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: All consumers have seen the good file bh030169.039chmu0(4580155)  at dcap://cdfcaf-door23
08/15/06 13:39:47 cdf-caf.SM.cdf-caf 9610: Project 100093 releases file bh030169.039chmu0 at node dcap://cdfcaf-door23
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: 7855969 decRefCount 1
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: CFID 7855969 becoming disposable
08/15/06 13:39:47 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100093 of group test releasing file 4580155
08/15/06 13:39:47 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100093
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610: File 4580155 becomes disposable
08/15/06 13:39:47 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100093 at dcap://cdfcaf-door23
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: 7852993 incRefCount 0
08/15/06 13:39:47 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-door18
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: 7852993 incRefCount 1
08/15/06 13:39:47 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:47 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4541707 
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4541707 from CFID 7852993
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: 7852993 decRefCount 2
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Process 2345501 requests next file via CORBA callback
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: No files are available for process CPID 2345501 (genser(demo:1)@fcdfcaf590.fnal.gov[SAM Consumer Process](2345501))
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Proc genser(demo:1)@fcdfcaf345.fnal.gov[SAM Consumer Process](2344712) closes file s9000290.0002kbh2(6609408) 
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Skipping idle TO for process genser(demo:1)@fcdfcaf345.fnal.gov[SAM Consumer Process](2344712)
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Station DBProxy 10945: Warning, Db server became unreachable
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Station DBProxy 10945: Resolving Db Server Factory as SAMDbServer.cdfcafstation_prd:SAMDbServer
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Station DBProxy 10945: Obtaining servant of type Station
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Station DBProxy 10945: DbServer is alive 
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Release of file CFID 7855300 from project ID 100017 has been recorded in the database
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: All consumers have seen the good file s9000290.0002kbh2(6609408)  at dcap://cdfcaf-door25
08/15/06 13:39:47 cdf-caf.SM.cdf-caf 9610: Project 100017 releases file s9000290.0002kbh2 at node dcap://cdfcaf-door25
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: 7855300 decRefCount 1
08/15/06 13:39:47 cdf-caf.SM.FileManager 9610: CFID 7855300 becoming disposable
08/15/06 13:39:47 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100017 of group test releasing file 6609408
08/15/06 13:39:47 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100017
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610: File 6609408 becomes disposable
08/15/06 13:39:47 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100017 at dcap://cdfcaf-door25
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610:  Found 0 hits, reaquired for ISX
08/15/06 13:39:47 cdf-caf.SM.ProjectManager 9610: 0 Total requests created, to satisfyConsumers
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Project DBProxy 10945: Warning, Db server became unreachable
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Project DBProxy 10945: Resolving Db Server Factory as SAMDbServer.cdfcafstation_prd:SAMDbServer
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Project DBProxy 10945: Obtaining servant of type Project
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.Project DBProxy 10945: DbServer is alive 
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Process 2344712 requests next file via CORBA callback
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: No files are available for process CPID 2344712 (genser(demo:1)@fcdfcaf345.fnal.gov[SAM Consumer Process](2344712))
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Process CPID 2344712 will not wait until other processes finish
08/15/06 13:39:47 cdf-caf.genser_cdf-caf_skbh29_205654_7705.EndOfFileStream.Worker 10945: Notifing, timeout set to 1 min.
08/15/06 13:39:47 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:47 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:48 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:49 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:49 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:50 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:51 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.PollProcess.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:39:51 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Proc genser(demo:1)@fcdfcaf345.fnal.gov[SAM Consumer Process](2344712) ends normally
08/15/06 13:39:51 cdf-caf.SM.ProjectManager 9610: There are now 0 umers for project 100017 at node dcap://cdfcaf-door25
08/15/06 13:39:51 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Telling cache manager that consumption lowers at node dcap://cdfcaf-door25 
08/15/06 13:39:51 cdf-caf.genser_cdf-caf_skbh29_205654_7705.GPM 10945: Not all consumers have finished, delaying end of project /SAMStations/cdf-caf/genser_cdf-caf_skbh29_205654_7705:Project
08/15/06 13:39:51 cdf-caf.hays_cdf-caf_hays_bhel0h_lt196k_recovery_205648_27638.PollProcess.Worker 7470: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:52 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:53 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.PollProcess.Worker 17045: Notifing, timeout set to 1 min.
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf869.fnal.gov[SAM Consumer Process](2345564) closes file bh030152.0284hmu0(4580061) 
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping idle TO for process genser(demo:1)@fcdfcaf869.fnal.gov[SAM Consumer Process](2345564)
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Release of file CFID 7855977 from project ID 100093 has been recorded in the database
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: All consumers have seen the good file bh030152.0284hmu0(4580061)  at dcap://cdfcaf-door27
08/15/06 13:39:54 cdf-caf.SM.cdf-caf 9610: Project 100093 releases file bh030152.0284hmu0 at node dcap://cdfcaf-door27
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7855977 decRefCount 1
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: CFID 7855977 becoming disposable
08/15/06 13:39:54 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100093 of group test releasing file 4580061
08/15/06 13:39:54 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100093
08/15/06 13:39:54 cdf-caf.SM.ProjectManager 9610: File 4580061 becomes disposable
08/15/06 13:39:54 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:54 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100093 at dcap://cdfcaf-door27
08/15/06 13:39:54 cdf-caf.SM.ProjectManager 9610:  Found 2 hits, reaquired for ISX
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7828242 incRefCount 0
08/15/06 13:39:54 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7828242 incRefCount 1
08/15/06 13:39:54 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:54 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4541737 
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4541737 from CFID 7828242
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7828242 decRefCount 2
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7853045 incRefCount 0
08/15/06 13:39:54 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-door12
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7853045 incRefCount 1
08/15/06 13:39:54 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:54 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4541761 
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4541761 from CFID 7853045
08/15/06 13:39:54 cdf-caf.SM.FileManager 9610: 7853045 decRefCount 2
08/15/06 13:39:54 cdf-caf.SM.ProjectManager 9610: 2 Total requests created, to satisfyConsumers
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Process 2345564 requests next file via CORBA callback
08/15/06 13:39:54 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: No files are available for process CPID 2345564 (genser(demo:1)@fcdfcaf869.fnal.gov[SAM Consumer Process](2345564))
08/15/06 13:39:55 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Proc genser(demo:1)@fcdfcaf954.fnal.gov[SAM Consumer Process](2345543) closes file bh02ff77.006ahmu0(4556656) 
08/15/06 13:39:55 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Skipping idle TO for process genser(demo:1)@fcdfcaf954.fnal.gov[SAM Consumer Process](2345543)
08/15/06 13:39:55 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Release of file CFID 7856117 from project ID 100093 has been recorded in the database
08/15/06 13:39:55 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: All consumers have seen the good file bh02ff77.006ahmu0(4556656)  at dcap://cdfcaf-door19
08/15/06 13:39:55 cdf-caf.SM.cdf-caf 9610: Project 100093 releases file bh02ff77.006ahmu0 at node dcap://cdfcaf-door19
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7856117 decRefCount 1
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: CFID 7856117 becoming disposable
08/15/06 13:39:55 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100093 of group test releasing file 4556656
08/15/06 13:39:55 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100093
08/15/06 13:39:55 cdf-caf.SM.ProjectManager 9610: File 4556656 becomes disposable
08/15/06 13:39:55 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:55 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100093 at dcap://cdfcaf-door19
08/15/06 13:39:55 cdf-caf.SM.ProjectManager 9610:  Found 3 hits, reaquired for ISX
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7828244 incRefCount 0
08/15/06 13:39:55 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7828244 incRefCount 1
08/15/06 13:39:55 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:55 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4541780 
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4541780 from CFID 7828244
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7828244 decRefCount 2
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7853057 incRefCount 0
08/15/06 13:39:55 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-door21
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7853057 incRefCount 1
08/15/06 13:39:55 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:55 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4541799 
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4541799 from CFID 7853057
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7853057 decRefCount 2
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7853065 incRefCount 0
08/15/06 13:39:55 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-door18
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7853065 incRefCount 1
08/15/06 13:39:55 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:55 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4541824 
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4541824 from CFID 7853065
08/15/06 13:39:55 cdf-caf.SM.FileManager 9610: 7853065 decRefCount 2
08/15/06 13:39:55 cdf-caf.SM.ProjectManager 9610: 3 Total requests created, to satisfyConsumers
08/15/06 13:39:55 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: Process 2345543 requests next file via CORBA callback
08/15/06 13:39:55 cdf-caf.genser_cdf-caf_bhmu0h_205664_32091.GPM 17045: No files are available for process CPID 2345543 (genser(demo:1)@fcdfcaf954.fnal.gov[SAM Consumer Process](2345543))
08/15/06 13:39:56 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:56 cdf-caf.johnpaul_cdf-caf_johnpaul_blpc0h_recovery_205656_25466.PollProcess.Worker 11850: Notifing, timeout set to 1 min.
08/15/06 13:39:56 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:56 cdf-caf.johnpaul_cdf-caf_jpmm0h_205657_26681.GPM 12403: Proc johnpaul(demo:1)@fcdfcaf1051.fnal.gov[SAM Consumer Process](2345173) closes file jh02fccb.0059pmm0(4501929) 
08/15/06 13:39:56 cdf-caf.johnpaul_cdf-caf_jpmm0h_205657_26681.GPM 12403: Skipping idle TO for process johnpaul(demo:1)@fcdfcaf1051.fnal.gov[SAM Consumer Process](2345173)
08/15/06 13:39:57 cdf-caf.johnpaul_cdf-caf_jpmm0h_205657_26681.GPM 12403: Release of file CFID 7854840 from project ID 100052 has been recorded in the database
08/15/06 13:39:57 cdf-caf.johnpaul_cdf-caf_jpmm0h_205657_26681.GPM 12403: All consumers have seen the good file jh02fccb.0059pmm0(4501929)  at dcap://cdfcaf-door4
08/15/06 13:39:57 cdf-caf.SM.cdf-caf 9610: Project 100052 releases file jh02fccb.0059pmm0 at node dcap://cdfcaf-door4
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: 7854840 decRefCount 1
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: CFID 7854840 becoming disposable
08/15/06 13:39:57 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 100052 of group test releasing file 4501929
08/15/06 13:39:57 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 100052
08/15/06 13:39:57 cdf-caf.SM.ProjectManager 9610: File 4501929 becomes disposable
08/15/06 13:39:57 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:57 cdf-caf.SM.ProjectManager 9610: Nothing is cached for 100052 at dcap://cdfcaf-door4
08/15/06 13:39:57 cdf-caf.SM.ProjectManager 9610:  Found 1 hits, reaquired for ISX
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: 7788335 incRefCount 0
08/15/06 13:39:57 cdf-caf.SM.DataGuard 9610: Locking source file at node dcap://cdfcaf-backbone
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: 7788335 incRefCount 1
08/15/06 13:39:57 cdf-caf.SM.Repler 9610: Adding delivery unit containing 1 files
08/15/06 13:39:57 cdf-caf.SM.Repler 9610: The unit has intrastation (highest) priority: 4524177 
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: Created intra-station request for file 4524177 from CFID 7788335
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: 7788335 decRefCount 2
08/15/06 13:39:57 cdf-caf.SM.ProjectManager 9610: 1 Total requests created, to satisfyConsumers
08/15/06 13:39:57 cdf-caf.johnpaul_cdf-caf_jpmm0h_205657_26681.GPM 12403: Process 2345173 requests next file via CORBA callback
08/15/06 13:39:57 cdf-caf.johnpaul_cdf-caf_jpmm0h_205657_26681.GPM 12403: No files are available for process CPID 2345173 (johnpaul(demo:1)@fcdfcaf1051.fnal.gov[SAM Consumer Process](2345173))
08/15/06 13:39:57 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:57 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:57 cdf-caf.vrusu_cdf-caf_tewk1z--9--9-14Aug06-221622_205611_29550.PollProcess.Worker 20070: Notifing, timeout set to 1 min.
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Proc hays(demo:1)@fcdfcaf602.fnal.gov[SAM Consumer Process](2343108) closes file bh031af9.010chel0(5620126) 
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Skipping idle TO for process hays(demo:1)@fcdfcaf602.fnal.gov[SAM Consumer Process](2343108)
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Release of file CFID 7846176 from project ID 99938 has been recorded in the database
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: All consumers have seen the good file bh031af9.010chel0(5620126)  at dcap://cdfcaf-door20
08/15/06 13:39:57 cdf-caf.SM.cdf-caf 9610: Project 99938 releases file bh031af9.010chel0 at node dcap://cdfcaf-door20
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: 7846176 decRefCount 1
08/15/06 13:39:57 cdf-caf.SM.FileManager 9610: CFID 7846176 becoming disposable
08/15/06 13:39:57 cdf-caf.SM.BenefitMan 9610: Accounting benefits resulting from project 99938 of group test releasing file 5620126
08/15/06 13:39:57 cdf-caf.SM.BenefitMan 9610: Group test is receiving an actual benefit in the amount 1, type files consumed in the context of project 99938
08/15/06 13:39:57 cdf-caf.SM.ProjectManager 9610: File 5620126 becomes disposable
08/15/06 13:39:57 cdf-caf.SM.FileReceiverProjectProxy 9610: GPMProjectProxy:fileReleased
08/15/06 13:39:57 cdf-caf.SM.ProjectManager 9610: Consumers at dcap://cdfcaf-door20 for project 99938 are happy
08/15/06 13:39:57 cdf-caf.jpursley_cdf-caf_chdl03_205648_28031.PollProcess.Worker 7551: Notifing, timeout set to 1 min.
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Process 2343108 requests next file via CORBA callback
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: No files are available for process CPID 2343108 (hays(demo:1)@fcdfcaf602.fnal.gov[SAM Consumer Process](2343108))
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Process CPID 2343108 will not wait until other processes finish
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.EndOfFileStream.Worker 5262: Notifing, timeout set to 1 min.
08/15/06 13:39:57 cdf-caf.hays_cdf-caf_hays_bhel0h_lt200k_recovery_205653_6953.PollProcess.Worker 10302: Notifing, timeout set to 1 min.
08/15/06 13:39:58 cdf-caf.hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117.GPM 5262: Not all consumers have finished, delaying end of project /SAMStations/cdf-caf/hays_cdf-caf_hays_bhel0h_ge203k_recovery_205644_21117:Project