Thread-18486::INFO::2011-01-18 19:43:01,482::dispatcher::101::irs::Run and protect: connectStorageServer, Return response: {'status': {'message': 'OK', 'code': 0}, 'statuslist': [{'status': 0, 'id': 'd83b5a6b-6f4d-4dce-a1ab-c6b4e3f5aea9'}, {'status': 0, 'id': '9c2c49c8-058c-4b3c-8787-46ce98afeefc'}, {'status': 0, 'id': '772094ef-c575-4a17-b929-3663c3a8123c'}, {'status': 0, 'id': '73889fa1-11b6-4d61-9148-e84d868c9c5f'}]} Thread-18487::INFO::2011-01-18 19:43:01,497::dispatcher::95::irs::Run and protect: connectStoragePool, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e hostID=1 scsiKey=6e314f2e-203e-4814-9d34-ced6a238c98e msdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 masterVersion=2) Thread-18487::DEBUG::2011-01-18 19:43:01,497::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: moving from state init -> state preparing Thread-18487::DEBUG::2011-01-18 19:43:01,498::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a acquire exclusive (120000) Thread-18487::DEBUG::2011-01-18 19:43:01,498::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18487::DEBUG::2011-01-18 19:43:01,498::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted locked to '8ed1216c-cc25-4c7e-99ff-e5f71c5e712a' Thread-18487::DEBUG::2011-01-18 19:43:01,499::resource::524::irs::Owner 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18487::DEBUG::2011-01-18 19:43:01,499::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (exclusive) Thread-18487::DEBUG::2011-01-18 19:43:01,499::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: ref 1 aborting False Thread-18487::INFO::2011-01-18 19:43:01,500::sp::394::irs::(SP.connect) Connect host #1 to the storage pool 6e314f2e-203e-4814-9d34-ced6a238c98e with master domain: 5f225bd7-893f-4585-b75d-391629b8c6d5 (ver = 2) Thread-18487::DEBUG::2011-01-18 19:43:01,500::misc::701::SamplingMethod::Trying to enter rescan Thread-18487::DEBUG::2011-01-18 19:43:01,500::misc::704::SamplingMethod::Performing rescan Thread-18487::DEBUG::2011-01-18 19:43:01,500::misc::99::irs::'/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:01,747::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:01,748::misc::713::SamplingMethod::Returning last result for rescan Thread-18487::DEBUG::2011-01-18 19:43:01,748::misc::99::irs::'/usr/bin/sudo -n /bin/dd of=/sys/class/scsi_host/host19/scan' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:01,800::misc::122::irs::SUCCESS: = '0+1 records in\n0+1 records out\n5 bytes (5 B) copied, 0.000267 seconds, 18.7 kB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:01,810::misc::291::irs::(validateDDBytes) err: ['0+1 records in', '0+1 records out', '5 bytes (5 B) copied, 0.000267 seconds, 18.7 kB/s'], size: 5 Thread-18487::DEBUG::2011-01-18 19:43:01,811::misc::99::irs::'/usr/bin/sudo -n /bin/dd of=/sys/class/scsi_host/host18/scan' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:01,858::misc::122::irs::SUCCESS: = '0+1 records in\n0+1 records out\n5 bytes (5 B) copied, 0.000336 seconds, 14.9 kB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:01,859::misc::291::irs::(validateDDBytes) err: ['0+1 records in', '0+1 records out', '5 bytes (5 B) copied, 0.000336 seconds, 14.9 kB/s'], size: 5 Thread-18487::DEBUG::2011-01-18 19:43:01,859::misc::99::irs::'/usr/bin/sudo -n /bin/dd of=/sys/class/scsi_host/host17/scan' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:01,902::misc::122::irs::SUCCESS: = '0+1 records in\n0+1 records out\n5 bytes (5 B) copied, 0.000279 seconds, 17.9 kB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:01,902::misc::291::irs::(validateDDBytes) err: ['0+1 records in', '0+1 records out', '5 bytes (5 B) copied, 0.000279 seconds, 17.9 kB/s'], size: 5 Thread-18487::DEBUG::2011-01-18 19:43:01,903::misc::99::irs::'/usr/bin/sudo -n /bin/dd of=/sys/class/scsi_host/host16/scan' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:01,945::misc::122::irs::SUCCESS: = '0+1 records in\n0+1 records out\n5 bytes (5 B) copied, 0.000254 seconds, 19.7 kB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:01,946::misc::291::irs::(validateDDBytes) err: ['0+1 records in', '0+1 records out', '5 bytes (5 B) copied, 0.000254 seconds, 19.7 kB/s'], size: 5 Thread-18487::DEBUG::2011-01-18 19:43:01,946::misc::99::irs::'/usr/bin/sudo -n /bin/dd of=/sys/class/scsi_host/host1/scan' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:02,304::misc::122::irs::SUCCESS: = '0+1 records in\n0+1 records out\n5 bytes (5 B) copied, 0.315755 seconds, 0.0 kB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:02,304::misc::291::irs::(validateDDBytes) err: ['0+1 records in', '0+1 records out', '5 bytes (5 B) copied, 0.315755 seconds, 0.0 kB/s'], size: 5 Thread-18487::DEBUG::2011-01-18 19:43:02,305::misc::99::irs::'/usr/bin/sudo -n /bin/dd of=/sys/class/scsi_host/host0/scan' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:02,821::misc::122::irs::SUCCESS: = '0+1 records in\n0+1 records out\n5 bytes (5 B) copied, 0.477384 seconds, 0.0 kB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:02,822::misc::291::irs::(validateDDBytes) err: ['0+1 records in', '0+1 records out', '5 bytes (5 B) copied, 0.477384 seconds, 0.0 kB/s'], size: 5 Thread-18487::DEBUG::2011-01-18 19:43:02,822::misc::99::irs::'/usr/bin/sudo -n /sbin/multipath' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:03,438::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:03,438::misc::99::irs::'/usr/bin/sudo -n /sbin/dmsetup ls --target multipath' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:03,479::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:03,481::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgscan --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } "' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:04,880::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:04,882::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgscan --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } "' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:06,046::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:06,047::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_name,vg_uuid,attr,vg_size,vg_free,vg_extent_size,vg_extent_count,tags --nosuffix --units b' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:07,083::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:07,085::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_name,name,attr,lv_size,devices,tags --units b --nosuffix' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:08,115::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:08,116::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_name,vg_uuid,pv_name,pv_uuid,dev_size,pv_pe_count,pv_pe_alloc_count --units b --nosuffix' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:14,802::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:14,810::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:14,954::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:14,954::vg::505::irs::LVS ACCESS: {'ids': '-wi---', 'master': '-wi---', 'inbox': '-wi---', 'outbox': '-wi---', 'leases': '-wi---', 'metadata': '-wi---'} Thread-18487::DEBUG::2011-01-18 19:43:14,955::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,145::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,146::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,191::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,192::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings d36e088c-e33f-41c9-9799-60f27d683f24/metadata d36e088c-e33f-41c9-9799-60f27d683f24/leases d36e088c-e33f-41c9-9799-60f27d683f24/ids d36e088c-e33f-41c9-9799-60f27d683f24/inbox d36e088c-e33f-41c9-9799-60f27d683f24/outbox d36e088c-e33f-41c9-9799-60f27d683f24/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,325::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,325::vg::505::irs::LVS ACCESS: {'ids': '-wi---', 'master': '-wi---', 'inbox': '-wi---', 'outbox': '-wi---', 'leases': '-wi---', 'metadata': '-wi---'} Thread-18487::DEBUG::2011-01-18 19:43:15,326::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y d36e088c-e33f-41c9-9799-60f27d683f24/metadata d36e088c-e33f-41c9-9799-60f27d683f24/leases d36e088c-e33f-41c9-9799-60f27d683f24/ids d36e088c-e33f-41c9-9799-60f27d683f24/inbox d36e088c-e33f-41c9-9799-60f27d683f24/outbox d36e088c-e33f-41c9-9799-60f27d683f24/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,482::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,483::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,522::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,524::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings 5f225bd7-893f-4585-b75d-391629b8c6d5/metadata 5f225bd7-893f-4585-b75d-391629b8c6d5/leases 5f225bd7-893f-4585-b75d-391629b8c6d5/ids 5f225bd7-893f-4585-b75d-391629b8c6d5/inbox 5f225bd7-893f-4585-b75d-391629b8c6d5/outbox 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,652::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,653::vg::505::irs::LVS ACCESS: {'ids': '-wi---', 'master': '-wi---', 'inbox': '-wi---', 'outbox': '-wi---', 'leases': '-wi---', 'metadata': '-wi---'} Thread-18487::DEBUG::2011-01-18 19:43:15,653::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y 5f225bd7-893f-4585-b75d-391629b8c6d5/metadata 5f225bd7-893f-4585-b75d-391629b8c6d5/leases 5f225bd7-893f-4585-b75d-391629b8c6d5/ids 5f225bd7-893f-4585-b75d-391629b8c6d5/inbox 5f225bd7-893f-4585-b75d-391629b8c6d5/outbox 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,824::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,825::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:15,864::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:15,866::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:16,002::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:16,002::vg::505::irs::LVS ACCESS: {'ids': '-wi---', 'master': '-wi---', 'inbox': '-wi---', 'outbox': '-wi---', 'leases': '-wi---', 'metadata': '-wi---'} Thread-18487::DEBUG::2011-01-18 19:43:16,003::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:16,175::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:16,176::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:16,215::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:16,216::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:16,561::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:16,561::vg::505::irs::LVS ACCESS: {'ids': '-wi---', 'master': '-wi---', 'inbox': '-wi---', 'outbox': '-wi---', 'leases': '-wi---', 'metadata': '-wi---'} Thread-18487::DEBUG::2011-01-18 19:43:16,562::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:16,937::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:16,937::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:16,977::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:16,978::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata count=1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,009::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000437 seconds, 4.7 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,010::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000437 seconds, 4.7 MB/s'], size: 2048 Thread-18487::DEBUG::2011-01-18 19:43:17,010::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_3', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE18,uuid:Qgf46A-WY12-2WRV-PrRt-wlBf-dG5l-Y0CiR2,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE19,uuid:I9Af7U-Xs1p-25wD-eipC-Fidg-XxVv-g51Ql4,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE16,uuid:Nvl4M2-De3J-JsKJ-JkBe-GZ6s-AjKD-lcInZA,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE17,uuid:bLZC8w-2nd6-mSQL-l7bf-qTMV-V0zG-2AjV5E,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE23,uuid:6a4K6m-i3eH-fMq3-o87l-7Vrd-u85A-gukoFD,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE22,uuid:Bq8FkT-8D7Z-QeDV-eZzx-RGR3-UzBm-xdyAgL,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE21,uuid:Vnwbgp-85vv-DFdc-LxUu-kPBu-pkQ3-jsIHqv,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE20,uuid:WqzA8s-xBVm-fjUO-1mxU-s8GQ-BTji-sWHK8S,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=u7udFg-03KL-F8eg-BQhY-TAJA-bV0h-ylO1p8', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=8fd1c0112168759eac1d4afe75228b2ee79efc2f'] Thread-18487::DEBUG::2011-01-18 19:43:17,011::metadata::89::irs::metadata.__validate() __cksum(md) = 8fd1c0112168759eac1d4afe75228b2ee79efc2f Thread-18487::DEBUG::2011-01-18 19:43:17,011::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata count=1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,043::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000944 seconds, 2.2 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,043::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000944 seconds, 2.2 MB/s'], size: 2048 Thread-18487::DEBUG::2011-01-18 19:43:17,044::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_4', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE25,uuid:oT9Njr-43C6-OFn2-Pb1m-OHmv-q1ko-qWVZfU,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE24,uuid:zAhT6X-lhHA-0tpM-y8Ir-qdYz-cToH-QS34Qd,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE26,uuid:iai1Ih-p3aO-aJfa-m0Vu-bbUI-Bzmt-faQpU3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE27,uuid:Po2nTz-ZVf1-9CUn-XrvV-KFvh-bVc0-0UlRfc,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE28,uuid:7RfWRw-dleE-FJGk-unwH-mCIt-vjvO-cFlwEV,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE29,uuid:o0eNOA-eXTU-lOuo-1pOl-S9Kc-t3SS-qmqoxq,pestart:0,pecount:95,mapoffset:475', 'ROLE=Regular', 'SDUUID=d36e088c-e33f-41c9-9799-60f27d683f24', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=Rg9Ok4-Ts62-7x69-dnoq-vXMJ-1kxr-7V4hzD', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=506390723e870e52d768c8a93509b36b71d536b4'] Thread-18487::DEBUG::2011-01-18 19:43:17,044::metadata::89::irs::metadata.__validate() __cksum(md) = 506390723e870e52d768c8a93509b36b71d536b4 Thread-18487::DEBUG::2011-01-18 19:43:17,045::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,076::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00088 seconds, 2.3 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,076::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00088 seconds, 2.3 MB/s'], size: 2048 Thread-18487::DEBUG::2011-01-18 19:43:17,076::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] Thread-18487::DEBUG::2011-01-18 19:43:17,077::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a Thread-18487::DEBUG::2011-01-18 19:43:17,078::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata count=1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,109::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000921 seconds, 2.2 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,109::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000921 seconds, 2.2 MB/s'], size: 2048 Thread-18487::DEBUG::2011-01-18 19:43:17,109::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_5', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE30,uuid:6OMUem-Ea8u-ePsj-ZtiI-PS2g-9lar-vDE1yw,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE31,uuid:rp1dI7-UPsb-ZzJX-eptN-usNA-7bhM-O2aeC0,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE32,uuid:REuolt-m2qg-IguX-yQ6Q-a88i-QbOk-KfxuNR,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE33,uuid:auCyUI-Qzi4-nPej-g5ji-3O7c-PNdD-YSr4HX,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE34,uuid:nxQIzE-gINr-2WGk-fBFz-xWdc-VKpc-0AkgEu,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE35,uuid:9rYRaB-6vqa-jeNi-8d70-Olyy-x5FR-Sfd9rm,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE36,uuid:aj40O1-nJLf-RfMK-vPfA-zy3M-CGZP-gFOulR,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE37,uuid:vCUrIv-sXPe-09Ze-EYzV-cj0C-67iG-ukcW5V,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=YlGdeL-gaDB-Es97-ogbJ-3LdW-crm3-jWw9cH', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=f0ac78701aec46eb830881e3c6db5e3fa21ea53c'] Thread-18487::DEBUG::2011-01-18 19:43:17,110::metadata::89::irs::metadata.__validate() __cksum(md) = f0ac78701aec46eb830881e3c6db5e3fa21ea53c Thread-18487::DEBUG::2011-01-18 19:43:17,111::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata count=1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,142::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000901 seconds, 2.3 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,142::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000901 seconds, 2.3 MB/s'], size: 2048 Thread-18487::DEBUG::2011-01-18 19:43:17,142::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=None', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE0,uuid:JhuxXz-oY2f-VTKM-jZw1-vjeb-1yfc-4DEMhe,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE1,uuid:3aUVw3-VXRN-GbIT-jnEQ-RmUc-Kqcf-cj2Q3x,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE2,uuid:OFmc1C-VUM2-UeEr-4PaC-e2G4-YjTo-0aIgd3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE3,uuid:kyzPWM-1lW2-zYaO-2BIR-W66P-XrsG-fpehsp,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE4,uuid:EacnTZ-z822-xe9v-9t6A-1u3S-t96k-bOlSQM,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE5,uuid:N8Yas4-g1Rl-y3qt-Zb1d-t4ty-y8Iv-5LxYUR,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE6,uuid:aAF0AR-v83k-qND9-ZwAN-3p89-o9p0-rAF1zi,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE7,uuid:Qf3LTH-Ai55-3Lp0-FKFJ-zmfX-yyf8-yEyqIf,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=zSkJHd-z2vi-SfdH-OmXK-HHD2-HSSF-I7j139', 'MASTER_VERSION=0', '_SHA_CKSUM=6ac9d8deed2c8198ad87a15fde0e9be690649fe9'] Thread-18487::DEBUG::2011-01-18 19:43:17,143::metadata::89::irs::metadata.__validate() __cksum(md) = 6ac9d8deed2c8198ad87a15fde0e9be690649fe9 Thread-18487::DEBUG::2011-01-18 19:43:17,150::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,181::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000907 seconds, 2.3 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,181::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000907 seconds, 2.3 MB/s'], size: 2048 Thread-18487::DEBUG::2011-01-18 19:43:17,182::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] Thread-18487::DEBUG::2011-01-18 19:43:17,182::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a Thread-18487::DEBUG::2011-01-18 19:43:17,183::sp::1325::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e old domains {} master dom list ['a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active', '5f225bd7-893f-4585-b75d-391629b8c6d5:Active', 'd36e088c-e33f-41c9-9799-60f27d683f24:Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active'] Thread-18487::DEBUG::2011-01-18 19:43:17,183::sp::1349::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e add domain a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18487::DEBUG::2011-01-18 19:43:17,183::sp::1530::irs::a34b5c63-e7ce-41e7-a4fc-9336c22c8737 stat None Thread-18493::INFO::2011-01-18 19:43:17,184::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:43:17,184::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,185::sp::1349::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e add domain a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18487::DEBUG::2011-01-18 19:43:17,187::sp::1530::irs::a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 stat None Thread-18494::INFO::2011-01-18 19:43:17,188::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:43:17,189::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,189::sp::1349::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e add domain 5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18487::DEBUG::2011-01-18 19:43:17,207::sp::1530::irs::5f225bd7-893f-4585-b75d-391629b8c6d5 stat None Thread-18495::INFO::2011-01-18 19:43:17,211::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:43:17,212::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,212::sp::1349::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e add domain d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18487::DEBUG::2011-01-18 19:43:17,213::sp::1530::irs::d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 stat None Thread-18496::INFO::2011-01-18 19:43:17,216::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18487::DEBUG::2011-01-18 19:43:17,217::sp::1349::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e add domain d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::DEBUG::2011-01-18 19:43:17,218::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,218::sp::1530::irs::d36e088c-e33f-41c9-9799-60f27d683f24 stat None Thread-18487::DEBUG::2011-01-18 19:43:17,222::sp::1354::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e new domains {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active'} Thread-18497::INFO::2011-01-18 19:43:17,222::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18487::INFO::2011-01-18 19:43:17,224::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18497::DEBUG::2011-01-18 19:43:17,225::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,227::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/master' (cwd None) Thread-18493::DEBUG::2011-01-18 19:43:17,227::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:43:17,252::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:43:17,253::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:43:17,260::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:43:17,271::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,388::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,389::vg::505::irs::LVS ACCESS: {'ids': '-wi-a-', 'master': '-wi-a-', 'inbox': '-wi-a-', 'outbox': '-wi-a-', 'leases': '-wi-a-', 'metadata': '-wi-a-'} Thread-18487::DEBUG::2011-01-18 19:43:17,390::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox a34b5c63-e7ce-41e7-a4fc-9336c22c8737/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,546::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,546::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,585::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,587::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_name a34b5c63-e7ce-41e7-a4fc-9336c22c8737' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:17,955::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:17,956::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE18' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:18,136::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:18,138::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE19' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:18,354::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:18,355::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE16' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:18,549::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:18,551::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE17' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:18,729::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:18,731::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE23' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:18,909::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:18,910::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE22' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,090::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:19,091::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE21' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,270::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:19,271::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE20' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,460::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:19,461::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_uuid,vg_size,vg_free,vg_extent_size,vg_extent_count,attr --nosuffix --units b a34b5c63-e7ce-41e7-a4fc-9336c22c8737' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,593::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::INFO::2011-01-18 19:43:19,594::sp::949::irs::(SP.__rebuild) Linking SD a34b5c63-e7ce-41e7-a4fc-9336c22c8737 to /rhev/data-center/mnt/blockSD/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18487::DEBUG::2011-01-18 19:43:19,595::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings d36e088c-e33f-41c9-9799-60f27d683f24/metadata d36e088c-e33f-41c9-9799-60f27d683f24/leases d36e088c-e33f-41c9-9799-60f27d683f24/ids d36e088c-e33f-41c9-9799-60f27d683f24/inbox d36e088c-e33f-41c9-9799-60f27d683f24/outbox d36e088c-e33f-41c9-9799-60f27d683f24/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,740::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:19,741::vg::505::irs::LVS ACCESS: {'ids': '-wi-a-', 'master': '-wi-a-', 'inbox': '-wi-a-', 'outbox': '-wi-a-', 'leases': '-wi-a-', 'metadata': '-wi-a-'} Thread-18487::DEBUG::2011-01-18 19:43:19,742::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y d36e088c-e33f-41c9-9799-60f27d683f24/metadata d36e088c-e33f-41c9-9799-60f27d683f24/leases d36e088c-e33f-41c9-9799-60f27d683f24/ids d36e088c-e33f-41c9-9799-60f27d683f24/inbox d36e088c-e33f-41c9-9799-60f27d683f24/outbox d36e088c-e33f-41c9-9799-60f27d683f24/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,861::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:19,862::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:19,900::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:19,902::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_name d36e088c-e33f-41c9-9799-60f27d683f24' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:20,246::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:20,247::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE25' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:20,402::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:20,403::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE24' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:20,574::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:20,818::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE26' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:20,978::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:20,979::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE27' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:21,927::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:21,930::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE28' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:22,106::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:22,108::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE29' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:22,264::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:22,266::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_uuid,vg_size,vg_free,vg_extent_size,vg_extent_count,attr --nosuffix --units b d36e088c-e33f-41c9-9799-60f27d683f24' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:22,396::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::INFO::2011-01-18 19:43:22,397::sp::949::irs::(SP.__rebuild) Linking SD d36e088c-e33f-41c9-9799-60f27d683f24 to /rhev/data-center/mnt/blockSD/d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18487::DEBUG::2011-01-18 19:43:22,398::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings 5f225bd7-893f-4585-b75d-391629b8c6d5/metadata 5f225bd7-893f-4585-b75d-391629b8c6d5/leases 5f225bd7-893f-4585-b75d-391629b8c6d5/ids 5f225bd7-893f-4585-b75d-391629b8c6d5/inbox 5f225bd7-893f-4585-b75d-391629b8c6d5/outbox 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:22,539::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:22,540::vg::505::irs::LVS ACCESS: {'ids': '-wi-a-', 'master': '-wi-a-', 'inbox': '-wi-a-', 'outbox': '-wi-a-', 'leases': '-wi-a-', 'metadata': '-wi-a-'} Thread-18487::DEBUG::2011-01-18 19:43:22,541::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y 5f225bd7-893f-4585-b75d-391629b8c6d5/metadata 5f225bd7-893f-4585-b75d-391629b8c6d5/leases 5f225bd7-893f-4585-b75d-391629b8c6d5/ids 5f225bd7-893f-4585-b75d-391629b8c6d5/inbox 5f225bd7-893f-4585-b75d-391629b8c6d5/outbox 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:22,674::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:22,675::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:22,714::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:22,716::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_name 5f225bd7-893f-4585-b75d-391629b8c6d5' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:23,058::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:23,060::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE12' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:23,239::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:23,241::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE13' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:23,421::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:23,422::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE10' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:23,602::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:23,604::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE11' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:23,793::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:23,794::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE14' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:23,985::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:23,987::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE15' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:24,167::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:24,168::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE8' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:24,348::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:24,349::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE9' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:24,529::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:24,530::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_uuid,vg_size,vg_free,vg_extent_size,vg_extent_count,attr --nosuffix --units b 5f225bd7-893f-4585-b75d-391629b8c6d5' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:24,696::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::INFO::2011-01-18 19:43:24,696::sp::949::irs::(SP.__rebuild) Linking SD 5f225bd7-893f-4585-b75d-391629b8c6d5 to /rhev/data-center/mnt/blockSD/5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18487::DEBUG::2011-01-18 19:43:24,697::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:24,828::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:24,829::vg::505::irs::LVS ACCESS: {'ids': '-wi-a-', 'master': '-wi-a-', 'inbox': '-wi-a-', 'outbox': '-wi-a-', 'leases': '-wi-a-', 'metadata': '-wi-a-'} Thread-18487::DEBUG::2011-01-18 19:43:24,830::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:24,962::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:24,963::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:25,002::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:25,003::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_name d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:25,346::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:25,347::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE30' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:25,524::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:25,525::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE31' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:25,705::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:25,706::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE32' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:25,883::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:25,885::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE33' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:26,087::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:26,088::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE34' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:26,267::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:26,268::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE35' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:26,445::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:26,447::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE36' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:26,651::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:26,653::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE37' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:26,850::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:26,852::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_uuid,vg_size,vg_free,vg_extent_size,vg_extent_count,attr --nosuffix --units b d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:26,993::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::INFO::2011-01-18 19:43:26,993::sp::949::irs::(SP.__rebuild) Linking SD d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 to /rhev/data-center/mnt/blockSD/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18487::DEBUG::2011-01-18 19:43:26,994::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o name,attr --noheadings a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/master' (cwd None) Thread-18493::INFO::2011-01-18 19:43:27,234::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:43:27,235::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:43:27,257::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:43:27,258::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:43:27,258::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:43:27,261::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:43:27,265::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:43:27,266::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:43:27,274::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:43:27,275::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:43:27,281::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:43:27,303::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:43:27,306::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:43:27,316::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:43:27,320::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:27,335::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:27,335::vg::505::irs::LVS ACCESS: {'ids': '-wi-a-', 'master': '-wi-a-', 'inbox': '-wi-a-', 'outbox': '-wi-a-', 'leases': '-wi-a-', 'metadata': '-wi-a-'} Thread-18487::DEBUG::2011-01-18 19:43:27,336::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:27,670::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:27,671::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/master' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:27,711::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:27,712::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE16|/dev/mapper/1REDHAT_SCALE17|/dev/mapper/1REDHAT_SCALE18|/dev/mapper/1REDHAT_SCALE19|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE20|/dev/mapper/1REDHAT_SCALE21|/dev/mapper/1REDHAT_SCALE22|/dev/mapper/1REDHAT_SCALE23|/dev/mapper/1REDHAT_SCALE24|/dev/mapper/1REDHAT_SCALE25|/dev/mapper/1REDHAT_SCALE26|/dev/mapper/1REDHAT_SCALE27|/dev/mapper/1REDHAT_SCALE28|/dev/mapper/1REDHAT_SCALE29|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE30|/dev/mapper/1REDHAT_SCALE31|/dev/mapper/1REDHAT_SCALE32|/dev/mapper/1REDHAT_SCALE33|/dev/mapper/1REDHAT_SCALE34|/dev/mapper/1REDHAT_SCALE35|/dev/mapper/1REDHAT_SCALE36|/dev/mapper/1REDHAT_SCALE37|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_name a36cbc28-c9d3-4a98-ac45-3fb661bf39c4' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:28,057::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:28,058::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE0' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:28,559::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::DEBUG::2011-01-18 19:43:28,560::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE1' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:29,336::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:29,338::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE2' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:30,128::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:30,129::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE3' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:30,925::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:30,927::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE4' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:31,698::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:31,700::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE5' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:32,491::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:32,492::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE6' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:33,290::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:33,291::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o pv_uuid,dev_size,vg_uuid,pv_pe_count,pv_pe_alloc_count --units b --nosuffix /dev/mapper/1REDHAT_SCALE7' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:34,063::misc::122::irs::SUCCESS: = " Couldn't find device with uuid hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN.\n Couldn't find device with uuid yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0.\n"; = 0 Thread-18487::DEBUG::2011-01-18 19:43:34,064::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE0|/dev/mapper/1REDHAT_SCALE1|/dev/mapper/1REDHAT_SCALE2|/dev/mapper/1REDHAT_SCALE3|/dev/mapper/1REDHAT_SCALE4|/dev/mapper/1REDHAT_SCALE5|/dev/mapper/1REDHAT_SCALE6|/dev/mapper/1REDHAT_SCALE7%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --noheadings -o vg_uuid,vg_size,vg_free,vg_extent_size,vg_extent_count,attr --nosuffix --units b a36cbc28-c9d3-4a98-ac45-3fb661bf39c4' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:34,396::misc::122::irs::SUCCESS: = ''; = 0 Thread-18487::INFO::2011-01-18 19:43:34,397::sp::949::irs::(SP.__rebuild) Linking SD a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 to /rhev/data-center/mnt/blockSD/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18487::DEBUG::2011-01-18 19:43:34,398::threadPool::26::irs::(threadPool:init) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 Thread-18487::DEBUG::2011-01-18 19:43:34,403::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/outbox iflag=direct bs=512 count=8 skip=8' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:34,436::misc::122::irs::SUCCESS: = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0024 seconds, 1.7 MB/s\n'; = 0 Thread-18487::INFO::2011-01-18 19:43:34,460::storage_mailbox::328::irs::HSM_MailMonitor sending mail to SPM - ['dd', 'of=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] Thread-18487::DEBUG::2011-01-18 19:43:34,461::misc::99::irs::'dd of=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox oflag=direct conv=notrunc bs=512 seek=8' (cwd None) Thread-18487::DEBUG::2011-01-18 19:43:34,494::misc::122::irs::SUCCESS: = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.002364 seconds, 1.7 MB/s\n'; = 0 Thread-18487::DEBUG::2011-01-18 19:43:34,495::storage_mailbox::171::irs::HSM_MailboxMonitor created for pool 6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18487::DEBUG::2011-01-18 19:43:34,496::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: finished: True Thread-18487::DEBUG::2011-01-18 19:43:34,496::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: moving from state preparing -> state finished Thread-18487::DEBUG::2011-01-18 19:43:34,496::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18487::DEBUG::2011-01-18 19:43:34,497::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a releasing Thread-18487::DEBUG::2011-01-18 19:43:34,497::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18487::DEBUG::2011-01-18 19:43:34,497::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18487::DEBUG::2011-01-18 19:43:34,497::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18487::DEBUG::2011-01-18 19:43:34,498::resource::503::irs::Owner 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18487::DEBUG::2011-01-18 19:43:34,498::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18487::DEBUG::2011-01-18 19:43:34,498::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18487::DEBUG::2011-01-18 19:43:34,499::task::577::irs::Task 8ed1216c-cc25-4c7e-99ff-e5f71c5e712a: ref 0 aborting False Thread-18487::INFO::2011-01-18 19:43:34,499::dispatcher::101::irs::Run and protect: connectStoragePool, Return response: {'status': {'message': 'OK', 'code': 0}} Thread-18504::INFO::2011-01-18 19:43:35,326::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18504::DEBUG::2011-01-18 19:43:35,326::task::577::irs::Task 9b52e1ed-ec68-437b-8d7e-ea73c005bb2d: moving from state init -> state preparing Thread-18504::DEBUG::2011-01-18 19:43:35,327::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18504::DEBUG::2011-01-18 19:43:35,358::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000388 seconds, 5.3 MB/s\n'; = 0 Thread-18504::DEBUG::2011-01-18 19:43:35,358::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000388 seconds, 5.3 MB/s'], size: 2048 Thread-18504::DEBUG::2011-01-18 19:43:35,358::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] Thread-18504::DEBUG::2011-01-18 19:43:35,359::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a Thread-18504::DEBUG::2011-01-18 19:43:35,359::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=Free spmLver=3 spmId=-1 Thread-18504::DEBUG::2011-01-18 19:43:35,360::task::577::irs::Task 9b52e1ed-ec68-437b-8d7e-ea73c005bb2d: finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 3}} Thread-18504::DEBUG::2011-01-18 19:43:35,360::task::577::irs::Task 9b52e1ed-ec68-437b-8d7e-ea73c005bb2d: moving from state preparing -> state finished Thread-18504::DEBUG::2011-01-18 19:43:35,360::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18504::DEBUG::2011-01-18 19:43:35,361::task::577::irs::Task 9b52e1ed-ec68-437b-8d7e-ea73c005bb2d: ref 0 aborting False Thread-18504::INFO::2011-01-18 19:43:35,361::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 3}} Thread-18505::INFO::2011-01-18 19:43:35,377::dispatcher::95::irs::Run and protect: spmStart, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e prevID=-1 prevLVER=3 recoveryMode=0 scsiFencing=false maxHostID=250) Thread-18505::DEBUG::2011-01-18 19:43:35,378::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: moving from state init -> state preparing Thread-18505::DEBUG::2011-01-18 19:43:35,378::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6251522c-ae06-452d-8562-43fd86ca717b acquire shared (120000) Thread-18505::DEBUG::2011-01-18 19:43:35,378::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18505::DEBUG::2011-01-18 19:43:35,379::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6251522c-ae06-452d-8562-43fd86ca717b' Thread-18505::DEBUG::2011-01-18 19:43:35,379::resource::524::irs::Owner 6251522c-ae06-452d-8562-43fd86ca717b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18505::DEBUG::2011-01-18 19:43:35,379::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18505::DEBUG::2011-01-18 19:43:35,380::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: ref 1 aborting False Thread-18505::DEBUG::2011-01-18 19:43:35,380::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: Prepare: 1 jobs exist, move to acquiring Thread-18505::DEBUG::2011-01-18 19:43:35,380::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: moving from state preparing -> state acquiring Thread-18505::DEBUG::2011-01-18 19:43:35,381::task::478::irs::TaskResourcesList.allGranted: check for {'Storage!6e314f2e-203e-4814-9d34-ced6a238c98e': } owned {'Storage!6e314f2e-203e-4814-9d34-ced6a238c98e': ('Storage', '6e314f2e-203e-4814-9d34-ced6a238c98e', 'shared')} Thread-18505::DEBUG::2011-01-18 19:43:35,381::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: moving from state acquiring -> state queued Thread-18505::DEBUG::2011-01-18 19:43:35,381::taskManager::38::irs::(TaskManager:queue) queueing task: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18505::DEBUG::2011-01-18 19:43:35,381::taskManager::45::irs::(TaskManager:queue) task queued: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18505::DEBUG::2011-01-18 19:43:35,382::task::1292::irs::(task:prepare) returning Thread-18505::DEBUG::2011-01-18 19:43:35,382::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: ref 0 aborting False Thread-18505::INFO::2011-01-18 19:43:35,382::dispatcher::101::irs::Run and protect: spmStart, Return response: {'status': {'message': 'OK', 'code': 0}, 'uuid': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-9::DEBUG::2011-01-18 19:43:35,390::threadPool::48::irs::(threadPool:setRunningTask) Number of running tasks: 1 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,391::threadPool::192::irs::Task: 6251522c-ae06-452d-8562-43fd86ca717b running: > with: None 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,391::task::1304::irs::(task:commit) Commiting task: 6251522c-ae06-452d-8562-43fd86ca717b 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,391::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: moving from state queued -> state running 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,392::task::1009::irs::Task.run: running job 0: spmStart: > (args: ('6e314f2e-203e-4814-9d34-ced6a238c98e', -1, '3', 0, 'false', 250) kwargs: {}) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,392::task::321::irs::Job.run: running spmStart: > (args: ('6e314f2e-203e-4814-9d34-ced6a238c98e', -1, '3', 0, 'false', 250) kwargs: {}) callback None 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,392::spm::370::irs::(SPM.start) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,393::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,424::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000399 seconds, 5.1 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,424::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000399 seconds, 5.1 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,424::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,425::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,425::sp::1325::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e old domains {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active'} master dom list ['a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active', '5f225bd7-893f-4585-b75d-391629b8c6d5:Active', 'd36e088c-e33f-41c9-9799-60f27d683f24:Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,426::sp::1354::irs::SP.refreshDomains: sp 6e314f2e-203e-4814-9d34-ced6a238c98e new domains {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active'} 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,426::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,458::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0009 seconds, 2.3 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,458::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0009 seconds, 2.3 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,459::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,459::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,460::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,492::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000919 seconds, 2.2 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,492::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000919 seconds, 2.2 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,493::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,493::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,494::sp::172::irs::Acquiring domain lock for domain 5f225bd7-893f-4585-b75d-391629b8c6d5 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,494::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,526::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000894 seconds, 2.3 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,526::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000894 seconds, 2.3 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,527::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,527::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,528::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,560::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000877 seconds, 2.3 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,560::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000877 seconds, 2.3 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,560::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,561::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,562::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,593::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000881 seconds, 2.3 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,594::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000881 seconds, 2.3 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,594::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,595::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,595::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,627::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000864 seconds, 2.4 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,628::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000864 seconds, 2.4 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,628::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=3', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=-1', '_SHA_CKSUM=7b46ee434eb847e094154a4aa1f1ae7daa19791a'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,628::metadata::89::irs::metadata.__validate() __cksum(md) = 7b46ee434eb847e094154a4aa1f1ae7daa19791a 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,629::sp::190::irs::sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5, id=1, lease=/rhev/data-center/mnt/blockSD/5f225bd7-893f-4585-b75d-391629b8c6d5/dom_md/leases, lockRenewalIntervalSec=5, leaseTimeMs=60000, ioOpTimeoutMs=10000, leaseFailRetry=3 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:35,629::misc::99::irs::'/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c1 -n0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 5f225bd7-893f-4585-b75d-391629b8c6d5 1 5 /rhev/data-center/mnt/blockSD/5f225bd7-893f-4585-b75d-391629b8c6d5/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) Thread-18506::INFO::2011-01-18 19:43:36,391::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18506::DEBUG::2011-01-18 19:43:36,392::task::577::irs::Task 45595d05-2e33-4376-8db5-d435a5d54cff: moving from state init -> state preparing Thread-18506::DEBUG::2011-01-18 19:43:36,392::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18506::DEBUG::2011-01-18 19:43:36,392::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18506::DEBUG::2011-01-18 19:43:36,393::task::577::irs::Task 45595d05-2e33-4376-8db5-d435a5d54cff: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18506::DEBUG::2011-01-18 19:43:36,393::task::577::irs::Task 45595d05-2e33-4376-8db5-d435a5d54cff: moving from state preparing -> state finished Thread-18506::DEBUG::2011-01-18 19:43:36,393::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18506::DEBUG::2011-01-18 19:43:36,394::task::577::irs::Task 45595d05-2e33-4376-8db5-d435a5d54cff: ref 0 aborting False Thread-18506::INFO::2011-01-18 19:43:36,394::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18507::INFO::2011-01-18 19:43:36,626::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18507::DEBUG::2011-01-18 19:43:36,626::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: moving from state init -> state preparing Thread-18507::DEBUG::2011-01-18 19:43:36,626::resource::157::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after incref ref 2 Thread-18507::DEBUG::2011-01-18 19:43:36,627::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fc8db4fd-f295-44fb-8853-234358939a84 acquire shared (120000) Thread-18507::DEBUG::2011-01-18 19:43:36,627::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate shared Thread-18507::DEBUG::2011-01-18 19:43:36,627::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fc8db4fd-f295-44fb-8853-234358939a84' Thread-18507::DEBUG::2011-01-18 19:43:36,627::resource::524::irs::Owner fc8db4fd-f295-44fb-8853-234358939a84: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18507::DEBUG::2011-01-18 19:43:36,628::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18507::DEBUG::2011-01-18 19:43:36,628::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: ref 1 aborting False Thread-18507::DEBUG::2011-01-18 19:43:36,628::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0516819953918', 'lastCheck': 1295372607.286531, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0515201091766', 'lastCheck': 1295372607.310034, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0507259368896', 'lastCheck': 1295372607.307584, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0538680553436', 'lastCheck': 1295372607.318749, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0493791103363', 'lastCheck': 1295372607.323281, 'valid': True, 'code': 0}} Thread-18507::DEBUG::2011-01-18 19:43:36,629::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: moving from state preparing -> state finished Thread-18507::DEBUG::2011-01-18 19:43:36,629::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18507::DEBUG::2011-01-18 19:43:36,629::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fc8db4fd-f295-44fb-8853-234358939a84 releasing Thread-18507::DEBUG::2011-01-18 19:43:36,630::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release ['6251522c-ae06-452d-8562-43fd86ca717b'] Thread-18507::DEBUG::2011-01-18 19:43:36,630::resource::503::irs::Owner fc8db4fd-f295-44fb-8853-234358939a84: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18507::DEBUG::2011-01-18 19:43:36,630::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18507::DEBUG::2011-01-18 19:43:36,631::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 1 Thread-18507::DEBUG::2011-01-18 19:43:36,631::task::577::irs::Task fc8db4fd-f295-44fb-8853-234358939a84: ref 0 aborting False Thread-18507::INFO::2011-01-18 19:43:36,631::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0516819953918', 'lastCheck': 1295372607.286531, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0507259368896', 'lastCheck': 1295372607.307584, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0493791103363', 'lastCheck': 1295372607.323281, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0538680553436', 'lastCheck': 1295372607.318749, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0515201091766', 'lastCheck': 1295372607.310034, 'valid': True, 'code': 0}} Thread-18493::INFO::2011-01-18 19:43:37,285::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:43:37,286::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:43:37,307::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:43:37,308::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:43:37,311::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:43:37,312::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:43:37,318::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:43:37,319::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:43:37,323::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:43:37,324::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:43:37,327::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:43:37,351::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:43:37,351::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:43:37,361::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:43:37,364::misc::122::irs::SUCCESS: = ''; = 0 Thread-18509::INFO::2011-01-18 19:43:37,404::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18509::DEBUG::2011-01-18 19:43:37,404::task::577::irs::Task 2950ddd2-df38-4bc1-9e62-48cef34ca2a2: moving from state init -> state preparing Thread-18509::DEBUG::2011-01-18 19:43:37,405::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18509::DEBUG::2011-01-18 19:43:37,405::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18509::DEBUG::2011-01-18 19:43:37,405::task::577::irs::Task 2950ddd2-df38-4bc1-9e62-48cef34ca2a2: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18509::DEBUG::2011-01-18 19:43:37,406::task::577::irs::Task 2950ddd2-df38-4bc1-9e62-48cef34ca2a2: moving from state preparing -> state finished Thread-18509::DEBUG::2011-01-18 19:43:37,406::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18509::DEBUG::2011-01-18 19:43:37,406::task::577::irs::Task 2950ddd2-df38-4bc1-9e62-48cef34ca2a2: ref 0 aborting False Thread-18509::INFO::2011-01-18 19:43:37,406::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18510::INFO::2011-01-18 19:43:38,415::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18510::DEBUG::2011-01-18 19:43:38,415::task::577::irs::Task 1df6fa5b-83d7-4442-bafa-0a96d7582183: moving from state init -> state preparing Thread-18510::DEBUG::2011-01-18 19:43:38,415::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18510::DEBUG::2011-01-18 19:43:38,415::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18510::DEBUG::2011-01-18 19:43:38,416::task::577::irs::Task 1df6fa5b-83d7-4442-bafa-0a96d7582183: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18510::DEBUG::2011-01-18 19:43:38,416::task::577::irs::Task 1df6fa5b-83d7-4442-bafa-0a96d7582183: moving from state preparing -> state finished Thread-18510::DEBUG::2011-01-18 19:43:38,416::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18510::DEBUG::2011-01-18 19:43:38,417::task::577::irs::Task 1df6fa5b-83d7-4442-bafa-0a96d7582183: ref 0 aborting False Thread-18510::INFO::2011-01-18 19:43:38,417::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18512::INFO::2011-01-18 19:43:39,426::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18512::DEBUG::2011-01-18 19:43:39,426::task::577::irs::Task 6eb0833b-a541-4665-9dd6-ff8a14a353f0: moving from state init -> state preparing Thread-18512::DEBUG::2011-01-18 19:43:39,426::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18512::DEBUG::2011-01-18 19:43:39,427::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18512::DEBUG::2011-01-18 19:43:39,427::task::577::irs::Task 6eb0833b-a541-4665-9dd6-ff8a14a353f0: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18512::DEBUG::2011-01-18 19:43:39,427::task::577::irs::Task 6eb0833b-a541-4665-9dd6-ff8a14a353f0: moving from state preparing -> state finished Thread-18512::DEBUG::2011-01-18 19:43:39,427::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18512::DEBUG::2011-01-18 19:43:39,428::task::577::irs::Task 6eb0833b-a541-4665-9dd6-ff8a14a353f0: ref 0 aborting False Thread-18512::INFO::2011-01-18 19:43:39,428::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18513::INFO::2011-01-18 19:43:40,437::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18513::DEBUG::2011-01-18 19:43:40,437::task::577::irs::Task dcbd531f-90e0-4bf2-ad73-013346a41d0d: moving from state init -> state preparing Thread-18513::DEBUG::2011-01-18 19:43:40,437::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18513::DEBUG::2011-01-18 19:43:40,438::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18513::DEBUG::2011-01-18 19:43:40,438::task::577::irs::Task dcbd531f-90e0-4bf2-ad73-013346a41d0d: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18513::DEBUG::2011-01-18 19:43:40,438::task::577::irs::Task dcbd531f-90e0-4bf2-ad73-013346a41d0d: moving from state preparing -> state finished Thread-18513::DEBUG::2011-01-18 19:43:40,438::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18513::DEBUG::2011-01-18 19:43:40,439::task::577::irs::Task dcbd531f-90e0-4bf2-ad73-013346a41d0d: ref 0 aborting False Thread-18513::INFO::2011-01-18 19:43:40,439::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18515::INFO::2011-01-18 19:43:41,448::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18515::DEBUG::2011-01-18 19:43:41,448::task::577::irs::Task 07775377-8001-463f-b1e7-bf4107e90054: moving from state init -> state preparing Thread-18515::DEBUG::2011-01-18 19:43:41,449::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18515::DEBUG::2011-01-18 19:43:41,449::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18515::DEBUG::2011-01-18 19:43:41,449::task::577::irs::Task 07775377-8001-463f-b1e7-bf4107e90054: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18515::DEBUG::2011-01-18 19:43:41,449::task::577::irs::Task 07775377-8001-463f-b1e7-bf4107e90054: moving from state preparing -> state finished Thread-18515::DEBUG::2011-01-18 19:43:41,450::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18515::DEBUG::2011-01-18 19:43:41,450::task::577::irs::Task 07775377-8001-463f-b1e7-bf4107e90054: ref 0 aborting False Thread-18515::INFO::2011-01-18 19:43:41,450::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18516::INFO::2011-01-18 19:43:42,459::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18516::DEBUG::2011-01-18 19:43:42,459::task::577::irs::Task 33c2268f-8ea8-4520-8e2f-4c6b3e079ce7: moving from state init -> state preparing Thread-18516::DEBUG::2011-01-18 19:43:42,460::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18516::DEBUG::2011-01-18 19:43:42,460::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18516::DEBUG::2011-01-18 19:43:42,460::task::577::irs::Task 33c2268f-8ea8-4520-8e2f-4c6b3e079ce7: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18516::DEBUG::2011-01-18 19:43:42,461::task::577::irs::Task 33c2268f-8ea8-4520-8e2f-4c6b3e079ce7: moving from state preparing -> state finished Thread-18516::DEBUG::2011-01-18 19:43:42,461::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18516::DEBUG::2011-01-18 19:43:42,461::task::577::irs::Task 33c2268f-8ea8-4520-8e2f-4c6b3e079ce7: ref 0 aborting False Thread-18516::INFO::2011-01-18 19:43:42,461::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18518::INFO::2011-01-18 19:43:43,470::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18518::DEBUG::2011-01-18 19:43:43,470::task::577::irs::Task d0adec74-5df5-4707-8672-2e2b05d665e9: moving from state init -> state preparing Thread-18518::DEBUG::2011-01-18 19:43:43,471::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18518::DEBUG::2011-01-18 19:43:43,471::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18518::DEBUG::2011-01-18 19:43:43,471::task::577::irs::Task d0adec74-5df5-4707-8672-2e2b05d665e9: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18518::DEBUG::2011-01-18 19:43:43,471::task::577::irs::Task d0adec74-5df5-4707-8672-2e2b05d665e9: moving from state preparing -> state finished Thread-18518::DEBUG::2011-01-18 19:43:43,472::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18518::DEBUG::2011-01-18 19:43:43,472::task::577::irs::Task d0adec74-5df5-4707-8672-2e2b05d665e9: ref 0 aborting False Thread-18518::INFO::2011-01-18 19:43:43,472::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18519::INFO::2011-01-18 19:43:44,481::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18519::DEBUG::2011-01-18 19:43:44,481::task::577::irs::Task 4b63d89d-fc6a-4d3f-a66e-fa59e5b0addd: moving from state init -> state preparing Thread-18519::DEBUG::2011-01-18 19:43:44,481::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18519::DEBUG::2011-01-18 19:43:44,482::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18519::DEBUG::2011-01-18 19:43:44,482::task::577::irs::Task 4b63d89d-fc6a-4d3f-a66e-fa59e5b0addd: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18519::DEBUG::2011-01-18 19:43:44,482::task::577::irs::Task 4b63d89d-fc6a-4d3f-a66e-fa59e5b0addd: moving from state preparing -> state finished Thread-18519::DEBUG::2011-01-18 19:43:44,483::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18519::DEBUG::2011-01-18 19:43:44,483::task::577::irs::Task 4b63d89d-fc6a-4d3f-a66e-fa59e5b0addd: ref 0 aborting False Thread-18519::INFO::2011-01-18 19:43:44,483::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18521::INFO::2011-01-18 19:43:45,492::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18521::DEBUG::2011-01-18 19:43:45,492::task::577::irs::Task 6f18159f-2ea0-4318-a7b9-bc2c383d3ca0: moving from state init -> state preparing Thread-18521::DEBUG::2011-01-18 19:43:45,493::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18521::DEBUG::2011-01-18 19:43:45,493::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18521::DEBUG::2011-01-18 19:43:45,493::task::577::irs::Task 6f18159f-2ea0-4318-a7b9-bc2c383d3ca0: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18521::DEBUG::2011-01-18 19:43:45,493::task::577::irs::Task 6f18159f-2ea0-4318-a7b9-bc2c383d3ca0: moving from state preparing -> state finished Thread-18521::DEBUG::2011-01-18 19:43:45,494::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18521::DEBUG::2011-01-18 19:43:45,494::task::577::irs::Task 6f18159f-2ea0-4318-a7b9-bc2c383d3ca0: ref 0 aborting False Thread-18521::INFO::2011-01-18 19:43:45,494::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18522::INFO::2011-01-18 19:43:46,503::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18522::DEBUG::2011-01-18 19:43:46,503::task::577::irs::Task 8ebb0ee6-2604-4940-894d-9a967e6a9a5b: moving from state init -> state preparing Thread-18522::DEBUG::2011-01-18 19:43:46,504::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18522::DEBUG::2011-01-18 19:43:46,504::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18522::DEBUG::2011-01-18 19:43:46,504::task::577::irs::Task 8ebb0ee6-2604-4940-894d-9a967e6a9a5b: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18522::DEBUG::2011-01-18 19:43:46,504::task::577::irs::Task 8ebb0ee6-2604-4940-894d-9a967e6a9a5b: moving from state preparing -> state finished Thread-18522::DEBUG::2011-01-18 19:43:46,505::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18522::DEBUG::2011-01-18 19:43:46,505::task::577::irs::Task 8ebb0ee6-2604-4940-894d-9a967e6a9a5b: ref 0 aborting False Thread-18522::INFO::2011-01-18 19:43:46,505::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18523::INFO::2011-01-18 19:43:46,778::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18523::DEBUG::2011-01-18 19:43:46,778::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: moving from state init -> state preparing Thread-18523::DEBUG::2011-01-18 19:43:46,779::resource::157::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after incref ref 2 Thread-18523::DEBUG::2011-01-18 19:43:46,779::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd acquire shared (120000) Thread-18523::DEBUG::2011-01-18 19:43:46,779::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate shared Thread-18523::DEBUG::2011-01-18 19:43:46,779::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd' Thread-18523::DEBUG::2011-01-18 19:43:46,780::resource::524::irs::Owner dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18523::DEBUG::2011-01-18 19:43:46,780::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18523::DEBUG::2011-01-18 19:43:46,780::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: ref 1 aborting False Thread-18523::DEBUG::2011-01-18 19:43:46,781::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0472922325134', 'lastCheck': 1295372617.3331251, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.046669960022', 'lastCheck': 1295372617.357748, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0499229431152', 'lastCheck': 1295372617.356777, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.048672914505', 'lastCheck': 1295372617.366889, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0449509620667', 'lastCheck': 1295372617.3678589, 'valid': True, 'code': 0}} Thread-18523::DEBUG::2011-01-18 19:43:46,781::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: moving from state preparing -> state finished Thread-18523::DEBUG::2011-01-18 19:43:46,781::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18523::DEBUG::2011-01-18 19:43:46,782::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd releasing Thread-18523::DEBUG::2011-01-18 19:43:46,782::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release ['6251522c-ae06-452d-8562-43fd86ca717b'] Thread-18523::DEBUG::2011-01-18 19:43:46,782::resource::503::irs::Owner dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18523::DEBUG::2011-01-18 19:43:46,782::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18523::DEBUG::2011-01-18 19:43:46,783::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 1 Thread-18523::DEBUG::2011-01-18 19:43:46,783::task::577::irs::Task dca6a6d2-fd5e-4bb9-b381-6b3328d8c4fd: ref 0 aborting False Thread-18523::INFO::2011-01-18 19:43:46,783::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0472922325134', 'lastCheck': 1295372617.3331251, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0499229431152', 'lastCheck': 1295372617.356777, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0449509620667', 'lastCheck': 1295372617.3678589, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.048672914505', 'lastCheck': 1295372617.366889, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.046669960022', 'lastCheck': 1295372617.357748, 'valid': True, 'code': 0}} Thread-18493::INFO::2011-01-18 19:43:47,332::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:43:47,333::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:43:47,356::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:43:47,357::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:43:47,357::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:43:47,360::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:43:47,367::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:43:47,368::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:43:47,371::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:43:47,372::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:43:47,374::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:43:47,400::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:43:47,400::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:43:47,410::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:43:47,411::misc::122::irs::SUCCESS: = ''; = 0 Thread-18525::INFO::2011-01-18 19:43:47,515::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18525::DEBUG::2011-01-18 19:43:47,515::task::577::irs::Task 1101380c-8094-404a-9044-b9baf76b9e4c: moving from state init -> state preparing Thread-18525::DEBUG::2011-01-18 19:43:47,515::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18525::DEBUG::2011-01-18 19:43:47,516::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18525::DEBUG::2011-01-18 19:43:47,516::task::577::irs::Task 1101380c-8094-404a-9044-b9baf76b9e4c: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18525::DEBUG::2011-01-18 19:43:47,516::task::577::irs::Task 1101380c-8094-404a-9044-b9baf76b9e4c: moving from state preparing -> state finished Thread-18525::DEBUG::2011-01-18 19:43:47,517::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18525::DEBUG::2011-01-18 19:43:47,517::task::577::irs::Task 1101380c-8094-404a-9044-b9baf76b9e4c: ref 0 aborting False Thread-18525::INFO::2011-01-18 19:43:47,517::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18526::INFO::2011-01-18 19:43:48,526::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18526::DEBUG::2011-01-18 19:43:48,526::task::577::irs::Task 3ae1e448-0221-488b-8e08-f4ab739eabc0: moving from state init -> state preparing Thread-18526::DEBUG::2011-01-18 19:43:48,527::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18526::DEBUG::2011-01-18 19:43:48,527::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18526::DEBUG::2011-01-18 19:43:48,527::task::577::irs::Task 3ae1e448-0221-488b-8e08-f4ab739eabc0: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18526::DEBUG::2011-01-18 19:43:48,527::task::577::irs::Task 3ae1e448-0221-488b-8e08-f4ab739eabc0: moving from state preparing -> state finished Thread-18526::DEBUG::2011-01-18 19:43:48,528::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18526::DEBUG::2011-01-18 19:43:48,528::task::577::irs::Task 3ae1e448-0221-488b-8e08-f4ab739eabc0: ref 0 aborting False Thread-18526::INFO::2011-01-18 19:43:48,528::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18528::INFO::2011-01-18 19:43:49,537::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18528::DEBUG::2011-01-18 19:43:49,537::task::577::irs::Task 02935778-d8e6-4412-9972-eada4194fa09: moving from state init -> state preparing Thread-18528::DEBUG::2011-01-18 19:43:49,538::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18528::DEBUG::2011-01-18 19:43:49,538::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18528::DEBUG::2011-01-18 19:43:49,538::task::577::irs::Task 02935778-d8e6-4412-9972-eada4194fa09: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18528::DEBUG::2011-01-18 19:43:49,539::task::577::irs::Task 02935778-d8e6-4412-9972-eada4194fa09: moving from state preparing -> state finished Thread-18528::DEBUG::2011-01-18 19:43:49,539::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18528::DEBUG::2011-01-18 19:43:49,539::task::577::irs::Task 02935778-d8e6-4412-9972-eada4194fa09: ref 0 aborting False Thread-18528::INFO::2011-01-18 19:43:49,539::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18529::INFO::2011-01-18 19:43:50,548::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18529::DEBUG::2011-01-18 19:43:50,548::task::577::irs::Task aa78fe54-3bec-46c1-a801-a231ab2f8065: moving from state init -> state preparing Thread-18529::DEBUG::2011-01-18 19:43:50,549::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18529::DEBUG::2011-01-18 19:43:50,549::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18529::DEBUG::2011-01-18 19:43:50,549::task::577::irs::Task aa78fe54-3bec-46c1-a801-a231ab2f8065: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18529::DEBUG::2011-01-18 19:43:50,550::task::577::irs::Task aa78fe54-3bec-46c1-a801-a231ab2f8065: moving from state preparing -> state finished Thread-18529::DEBUG::2011-01-18 19:43:50,550::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18529::DEBUG::2011-01-18 19:43:50,550::task::577::irs::Task aa78fe54-3bec-46c1-a801-a231ab2f8065: ref 0 aborting False Thread-18529::INFO::2011-01-18 19:43:50,550::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18531::INFO::2011-01-18 19:43:51,582::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18531::DEBUG::2011-01-18 19:43:51,582::task::577::irs::Task 24a01f3d-38e2-4fcc-a509-bc43ca59bfdf: moving from state init -> state preparing Thread-18531::DEBUG::2011-01-18 19:43:51,583::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18531::DEBUG::2011-01-18 19:43:51,583::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18531::DEBUG::2011-01-18 19:43:51,583::task::577::irs::Task 24a01f3d-38e2-4fcc-a509-bc43ca59bfdf: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18531::DEBUG::2011-01-18 19:43:51,584::task::577::irs::Task 24a01f3d-38e2-4fcc-a509-bc43ca59bfdf: moving from state preparing -> state finished Thread-18531::DEBUG::2011-01-18 19:43:51,584::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18531::DEBUG::2011-01-18 19:43:51,584::task::577::irs::Task 24a01f3d-38e2-4fcc-a509-bc43ca59bfdf: ref 0 aborting False Thread-18531::INFO::2011-01-18 19:43:51,584::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18532::INFO::2011-01-18 19:43:52,593::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18532::DEBUG::2011-01-18 19:43:52,593::task::577::irs::Task d2f85b4a-68ad-4f82-8779-ac0a7d3bfac6: moving from state init -> state preparing Thread-18532::DEBUG::2011-01-18 19:43:52,594::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18532::DEBUG::2011-01-18 19:43:52,594::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18532::DEBUG::2011-01-18 19:43:52,594::task::577::irs::Task d2f85b4a-68ad-4f82-8779-ac0a7d3bfac6: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18532::DEBUG::2011-01-18 19:43:52,595::task::577::irs::Task d2f85b4a-68ad-4f82-8779-ac0a7d3bfac6: moving from state preparing -> state finished Thread-18532::DEBUG::2011-01-18 19:43:52,595::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18532::DEBUG::2011-01-18 19:43:52,595::task::577::irs::Task d2f85b4a-68ad-4f82-8779-ac0a7d3bfac6: ref 0 aborting False Thread-18532::INFO::2011-01-18 19:43:52,595::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18534::INFO::2011-01-18 19:43:53,604::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18534::DEBUG::2011-01-18 19:43:53,604::task::577::irs::Task 70ba4e49-cfb9-4a26-af54-409212230071: moving from state init -> state preparing Thread-18534::DEBUG::2011-01-18 19:43:53,605::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18534::DEBUG::2011-01-18 19:43:53,605::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18534::DEBUG::2011-01-18 19:43:53,605::task::577::irs::Task 70ba4e49-cfb9-4a26-af54-409212230071: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18534::DEBUG::2011-01-18 19:43:53,606::task::577::irs::Task 70ba4e49-cfb9-4a26-af54-409212230071: moving from state preparing -> state finished Thread-18534::DEBUG::2011-01-18 19:43:53,606::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18534::DEBUG::2011-01-18 19:43:53,606::task::577::irs::Task 70ba4e49-cfb9-4a26-af54-409212230071: ref 0 aborting False Thread-18534::INFO::2011-01-18 19:43:53,606::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18535::INFO::2011-01-18 19:43:54,615::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18535::DEBUG::2011-01-18 19:43:54,615::task::577::irs::Task 8d819929-3485-4e80-810a-4d7f22060b20: moving from state init -> state preparing Thread-18535::DEBUG::2011-01-18 19:43:54,616::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18535::DEBUG::2011-01-18 19:43:54,616::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18535::DEBUG::2011-01-18 19:43:54,616::task::577::irs::Task 8d819929-3485-4e80-810a-4d7f22060b20: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18535::DEBUG::2011-01-18 19:43:54,617::task::577::irs::Task 8d819929-3485-4e80-810a-4d7f22060b20: moving from state preparing -> state finished Thread-18535::DEBUG::2011-01-18 19:43:54,617::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18535::DEBUG::2011-01-18 19:43:54,617::task::577::irs::Task 8d819929-3485-4e80-810a-4d7f22060b20: ref 0 aborting False Thread-18535::INFO::2011-01-18 19:43:54,617::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18537::INFO::2011-01-18 19:43:55,626::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18537::DEBUG::2011-01-18 19:43:55,807::task::577::irs::Task 94445cd2-d8e7-4dda-8cd9-ecea0dd69b33: moving from state init -> state preparing Thread-18537::DEBUG::2011-01-18 19:43:55,807::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18537::DEBUG::2011-01-18 19:43:55,807::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18537::DEBUG::2011-01-18 19:43:55,807::task::577::irs::Task 94445cd2-d8e7-4dda-8cd9-ecea0dd69b33: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18537::DEBUG::2011-01-18 19:43:55,808::task::577::irs::Task 94445cd2-d8e7-4dda-8cd9-ecea0dd69b33: moving from state preparing -> state finished Thread-18537::DEBUG::2011-01-18 19:43:55,808::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18537::DEBUG::2011-01-18 19:43:55,808::task::577::irs::Task 94445cd2-d8e7-4dda-8cd9-ecea0dd69b33: ref 0 aborting False Thread-18537::INFO::2011-01-18 19:43:55,809::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,260::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,260::sp::200::irs::Domain lock acquired successfully 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,260::spm::399::irs::spm lock acquired successfully 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,261::misc::501::irs::(misc.rotateFiles) dir: /var/log/vdsm/backup, prefixName: 5f225bd7-893f-4585-b75d-391629b8c6d5, versions: 30 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,266::misc::522::irs::(misc.rotateFiles) versions found: [16, 15, 14, 13, 12, 11, 10, 9, 8, 7, 6, 5, 4, 3, 2, 1, 0] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,273::blockSD::93::irs::(BlockSDMetadata._set) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_LVER=4', '_SHA_CKSUM=bdd56ceda6edf301b1a868f097368eee7b8c5456'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,273::misc::99::irs::'/bin/dd oflag=direct ibs=512 obs=2048 seek=0 of=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,306::misc::122::irs::SUCCESS: = '4+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00081 seconds, 2.5 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,306::misc::291::irs::(validateDDBytes) err: ['4+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00081 seconds, 2.5 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,307::misc::501::irs::(misc.rotateFiles) dir: /var/log/vdsm/backup, prefixName: 5f225bd7-893f-4585-b75d-391629b8c6d5, versions: 30 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,312::misc::522::irs::(misc.rotateFiles) versions found: [17, 16, 15, 14, 13, 12, 11, 10, 9, 8, 7, 6, 5, 4, 3, 2, 1, 0] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,320::blockSD::93::irs::(BlockSDMetadata._set) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,320::misc::99::irs::'/bin/dd oflag=direct ibs=512 obs=2048 seek=0 of=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,351::misc::122::irs::SUCCESS: = '4+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00041 seconds, 5.0 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,352::misc::291::irs::(validateDDBytes) err: ['4+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00041 seconds, 5.0 MB/s'], size: 2048 6251522c-ae06-452d-8562-43fd86ca717b::INFO::2011-01-18 19:43:56,352::vg::541::irs::setrwLV master RW True 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,353::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o attr --noheadings 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,505::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,506::vg::527::irs::ACCESS WR: lv master -wi-a- 6251522c-ae06-452d-8562-43fd86ca717b::INFO::2011-01-18 19:43:56,506::vg::613::irs::activate master RW True 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,507::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " -o attr --noheadings 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,639::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,640::vg::527::irs::ACCESS WR: lv master -wi-a- 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,640::misc::99::irs::'/usr/bin/sudo -n /usr/sbin/lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] write_cache_state=0 filter = [ \\"a%/dev/mapper/1REDHAT_SCALE10|/dev/mapper/1REDHAT_SCALE11|/dev/mapper/1REDHAT_SCALE12|/dev/mapper/1REDHAT_SCALE13|/dev/mapper/1REDHAT_SCALE14|/dev/mapper/1REDHAT_SCALE15|/dev/mapper/1REDHAT_SCALE8|/dev/mapper/1REDHAT_SCALE9%\\", \\"r%.*%\\" ] } backup { retain_min = 50 retain_days = 0 } " --available y 5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,773::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,774::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,812::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,813::misc::99::irs::'/usr/bin/sudo -n /sbin/e2fsck -p /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18538::INFO::2011-01-18 19:43:56,818::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18538::DEBUG::2011-01-18 19:43:56,819::task::577::irs::Task e50dd27f-8b77-467f-b5a6-ff715ae782cb: moving from state init -> state preparing Thread-18538::DEBUG::2011-01-18 19:43:56,819::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18538::DEBUG::2011-01-18 19:43:56,819::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18538::DEBUG::2011-01-18 19:43:56,820::task::577::irs::Task e50dd27f-8b77-467f-b5a6-ff715ae782cb: finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18538::DEBUG::2011-01-18 19:43:56,820::task::577::irs::Task e50dd27f-8b77-467f-b5a6-ff715ae782cb: moving from state preparing -> state finished Thread-18538::DEBUG::2011-01-18 19:43:56,820::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18538::DEBUG::2011-01-18 19:43:56,821::task::577::irs::Task e50dd27f-8b77-467f-b5a6-ff715ae782cb: ref 0 aborting False Thread-18538::INFO::2011-01-18 19:43:56,821::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,869::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,869::misc::99::irs::'/usr/bin/sudo -n /sbin/tune2fs -j /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::WARNING::2011-01-18 19:43:56,912::misc::124::irs::FAILED: = 'The filesystem already has a journal.\n'; = 1 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,912::misc::99::irs::'/usr/bin/sudo -n /bin/mount /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/master /rhev/data-center/mnt/blockSD/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) Thread-18539::INFO::2011-01-18 19:43:56,932::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18539::DEBUG::2011-01-18 19:43:56,933::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: moving from state init -> state preparing Thread-18539::DEBUG::2011-01-18 19:43:56,934::resource::157::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after incref ref 2 Thread-18539::DEBUG::2011-01-18 19:43:56,934::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5e63f552-708e-470e-aa5b-7978e3b5fe8e acquire shared (120000) Thread-18539::DEBUG::2011-01-18 19:43:56,935::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate shared Thread-18539::DEBUG::2011-01-18 19:43:56,935::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5e63f552-708e-470e-aa5b-7978e3b5fe8e' Thread-18539::DEBUG::2011-01-18 19:43:56,935::resource::524::irs::Owner 5e63f552-708e-470e-aa5b-7978e3b5fe8e: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18539::DEBUG::2011-01-18 19:43:56,936::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18539::DEBUG::2011-01-18 19:43:56,936::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: ref 1 aborting False Thread-18539::DEBUG::2011-01-18 19:43:56,937::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0473020076752', 'lastCheck': 1295372627.3801351, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0470280647278', 'lastCheck': 1295372627.4045291, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0502021312714', 'lastCheck': 1295372627.4060581, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0479588508606', 'lastCheck': 1295372627.4148719, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0444810390472', 'lastCheck': 1295372627.41536, 'valid': True, 'code': 0}} Thread-18539::DEBUG::2011-01-18 19:43:56,937::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: moving from state preparing -> state finished Thread-18539::DEBUG::2011-01-18 19:43:56,938::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18539::DEBUG::2011-01-18 19:43:56,938::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5e63f552-708e-470e-aa5b-7978e3b5fe8e releasing Thread-18539::DEBUG::2011-01-18 19:43:56,938::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release ['6251522c-ae06-452d-8562-43fd86ca717b'] Thread-18539::DEBUG::2011-01-18 19:43:56,938::resource::503::irs::Owner 5e63f552-708e-470e-aa5b-7978e3b5fe8e: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18539::DEBUG::2011-01-18 19:43:56,939::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18539::DEBUG::2011-01-18 19:43:56,939::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 1 Thread-18539::DEBUG::2011-01-18 19:43:56,939::task::577::irs::Task 5e63f552-708e-470e-aa5b-7978e3b5fe8e: ref 0 aborting False Thread-18539::INFO::2011-01-18 19:43:56,940::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0473020076752', 'lastCheck': 1295372627.3801351, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0502021312714', 'lastCheck': 1295372627.4060581, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0444810390472', 'lastCheck': 1295372627.41536, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0479588508606', 'lastCheck': 1295372627.4148719, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0470280647278', 'lastCheck': 1295372627.4045291, 'valid': True, 'code': 0}} 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,963::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:56,963::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/5f225bd7-893f-4585-b75d-391629b8c6d5/master' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,002::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::INFO::2011-01-18 19:43:57,004::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,006::threadPool::26::irs::(threadPool:init) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,012::storage_mailbox::482::irs::SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/outbox', 'oflag=direct', 'conv=notrunc', 'bs=512'] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,012::misc::99::irs::'dd of=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/outbox oflag=direct conv=notrunc bs=512' (cwd None) Thread-18493::INFO::2011-01-18 19:43:57,380::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:43:57,380::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:43:57,404::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:43:57,405::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:43:57,405::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:43:57,409::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:43:57,415::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::INFO::2011-01-18 19:43:57,415::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::DEBUG::2011-01-18 19:43:57,417::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:43:57,417::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:43:57,422::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:43:57,446::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:43:57,449::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:43:57,461::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:43:57,467::misc::122::irs::SUCCESS: = ''; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,575::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.53138 seconds, 1.9 MB/s\n'; = 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,590::storage_mailbox::488::irs::SPM_MailMonitor created for pool 6e314f2e-203e-4814-9d34-ced6a238c98e Dummy-18546::DEBUG::2011-01-18 19:43:57,591::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,591::spm::444::irs::(SPM.start) ended. 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,594::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: moving from state running -> state finished 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,595::resource::670::irs::Owner.releaseAll requests [] resources [] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,595::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6251522c-ae06-452d-8562-43fd86ca717b releasing 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,595::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,596::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,596::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,596::resource::503::irs::Owner 6251522c-ae06-452d-8562-43fd86ca717b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,597::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,597::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,597::task::1017::irs::Task.run: exit - success: result 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,598::task::577::irs::Task 6251522c-ae06-452d-8562-43fd86ca717b: ref 0 aborting False 6251522c-ae06-452d-8562-43fd86ca717b::DEBUG::2011-01-18 19:43:57,598::threadPool::48::irs::(threadPool:setRunningTask) Number of running tasks: 0 Thread-18547::INFO::2011-01-18 19:43:57,830::dispatcher::95::irs::Run and protect: getTaskStatus, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18547::DEBUG::2011-01-18 19:43:57,830::task::577::irs::Task 17ae26b9-301a-4b59-bc95-e39a41f54e49: moving from state init -> state preparing Thread-18547::DEBUG::2011-01-18 19:43:57,830::taskManager::78::irs::(TaskManager:getTaskStatus) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18547::DEBUG::2011-01-18 19:43:57,831::taskManager::81::irs::(TaskManager:getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfuly', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'} Thread-18547::DEBUG::2011-01-18 19:43:57,831::task::577::irs::Task 17ae26b9-301a-4b59-bc95-e39a41f54e49: finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfuly', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18547::DEBUG::2011-01-18 19:43:57,831::task::577::irs::Task 17ae26b9-301a-4b59-bc95-e39a41f54e49: moving from state preparing -> state finished Thread-18547::DEBUG::2011-01-18 19:43:57,832::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18547::DEBUG::2011-01-18 19:43:57,832::task::577::irs::Task 17ae26b9-301a-4b59-bc95-e39a41f54e49: ref 0 aborting False Thread-18547::INFO::2011-01-18 19:43:57,832::dispatcher::101::irs::Run and protect: getTaskStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'taskStatus': {'code': 0, 'message': '1 jobs completed successfuly', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '6251522c-ae06-452d-8562-43fd86ca717b'}} Thread-18548::INFO::2011-01-18 19:43:57,841::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18548::DEBUG::2011-01-18 19:43:57,842::task::577::irs::Task 84164811-a66b-41a3-bff8-1bbf32f90cd6: moving from state init -> state preparing Thread-18548::DEBUG::2011-01-18 19:43:57,842::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18548::DEBUG::2011-01-18 19:43:57,879::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000971 seconds, 2.1 MB/s\n'; = 0 Thread-18548::DEBUG::2011-01-18 19:43:57,879::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000971 seconds, 2.1 MB/s'], size: 2048 Thread-18548::DEBUG::2011-01-18 19:43:57,880::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18548::DEBUG::2011-01-18 19:43:57,880::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18548::DEBUG::2011-01-18 19:43:57,881::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18548::DEBUG::2011-01-18 19:43:57,881::task::577::irs::Task 84164811-a66b-41a3-bff8-1bbf32f90cd6: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18548::DEBUG::2011-01-18 19:43:57,882::task::577::irs::Task 84164811-a66b-41a3-bff8-1bbf32f90cd6: moving from state preparing -> state finished Thread-18548::DEBUG::2011-01-18 19:43:57,882::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18548::DEBUG::2011-01-18 19:43:57,882::task::577::irs::Task 84164811-a66b-41a3-bff8-1bbf32f90cd6: ref 0 aborting False Thread-18548::INFO::2011-01-18 19:43:57,883::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18549::INFO::2011-01-18 19:43:57,892::dispatcher::95::irs::Run and protect: clearTask, args: ( taskID=6251522c-ae06-452d-8562-43fd86ca717b) Thread-18549::DEBUG::2011-01-18 19:43:57,892::task::577::irs::Task 3158b0d8-3bbb-4447-bb13-c14a69e035b5: moving from state init -> state preparing Thread-18549::DEBUG::2011-01-18 19:43:57,893::taskManager::142::irs::(TaskManager:clearTask) Entry. taskID: 6251522c-ae06-452d-8562-43fd86ca717b Thread-18549::DEBUG::2011-01-18 19:43:57,893::taskManager::147::irs::(TaskManager:clearTask) Return. Thread-18549::DEBUG::2011-01-18 19:43:57,893::task::577::irs::Task 3158b0d8-3bbb-4447-bb13-c14a69e035b5: finished: None Thread-18549::DEBUG::2011-01-18 19:43:57,893::task::577::irs::Task 3158b0d8-3bbb-4447-bb13-c14a69e035b5: moving from state preparing -> state finished Thread-18549::DEBUG::2011-01-18 19:43:57,894::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18549::DEBUG::2011-01-18 19:43:57,894::task::577::irs::Task 3158b0d8-3bbb-4447-bb13-c14a69e035b5: ref 0 aborting False Thread-18549::INFO::2011-01-18 19:43:57,894::dispatcher::101::irs::Run and protect: clearTask, Return response: {'status': {'message': 'OK', 'code': 0}} Thread-18550::INFO::2011-01-18 19:43:57,911::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18550::DEBUG::2011-01-18 19:43:57,911::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: moving from state init -> state preparing Thread-18550::DEBUG::2011-01-18 19:43:57,912::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9 acquire shared (120000) Thread-18550::DEBUG::2011-01-18 19:43:57,912::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18550::DEBUG::2011-01-18 19:43:57,913::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4f1d6d15-a713-41d0-88a0-7689ed8bf5f9' Thread-18550::DEBUG::2011-01-18 19:43:57,913::resource::524::irs::Owner 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18550::DEBUG::2011-01-18 19:43:57,913::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18550::DEBUG::2011-01-18 19:43:57,914::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: ref 1 aborting False Thread-18550::INFO::2011-01-18 19:43:57,914::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18550::DEBUG::2011-01-18 19:43:57,915::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18550::DEBUG::2011-01-18 19:43:57,916::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: moving from state preparing -> state finished Thread-18550::DEBUG::2011-01-18 19:43:57,916::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18550::DEBUG::2011-01-18 19:43:57,916::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9 releasing Thread-18550::DEBUG::2011-01-18 19:43:57,917::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18550::DEBUG::2011-01-18 19:43:57,917::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18550::DEBUG::2011-01-18 19:43:57,917::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18550::DEBUG::2011-01-18 19:43:57,918::resource::503::irs::Owner 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18550::DEBUG::2011-01-18 19:43:57,918::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18550::DEBUG::2011-01-18 19:43:57,919::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18550::DEBUG::2011-01-18 19:43:57,919::task::577::irs::Task 4f1d6d15-a713-41d0-88a0-7689ed8bf5f9: ref 0 aborting False Thread-18550::INFO::2011-01-18 19:43:57,919::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18551::INFO::2011-01-18 19:43:57,983::dispatcher::95::irs::Run and protect: getAllTasksInfo, args: () Thread-18551::DEBUG::2011-01-18 19:43:57,983::task::577::irs::Task a1f75906-2468-41af-9965-7d2c711902a6: moving from state init -> state preparing Thread-18551::DEBUG::2011-01-18 19:43:57,984::taskManager::164::irs::(TaskManager:getAllTasksInfo) Entry. Thread-18551::DEBUG::2011-01-18 19:43:57,984::taskManager::169::irs::(TaskManager:getAllTasksInfo) Return. Response: {} Thread-18551::DEBUG::2011-01-18 19:43:57,984::task::577::irs::Task a1f75906-2468-41af-9965-7d2c711902a6: finished: {'allTasksInfo': {}} Thread-18551::DEBUG::2011-01-18 19:43:57,985::task::577::irs::Task a1f75906-2468-41af-9965-7d2c711902a6: moving from state preparing -> state finished Thread-18551::DEBUG::2011-01-18 19:43:57,985::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18551::DEBUG::2011-01-18 19:43:57,985::task::577::irs::Task a1f75906-2468-41af-9965-7d2c711902a6: ref 0 aborting False Thread-18551::INFO::2011-01-18 19:43:57,986::dispatcher::101::irs::Run and protect: getAllTasksInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'allTasksInfo': {}} Thread-18552::INFO::2011-01-18 19:43:57,996::dispatcher::95::irs::Run and protect: getAllTasksInfo, args: () Thread-18552::DEBUG::2011-01-18 19:43:57,996::task::577::irs::Task 8185781a-65b1-4664-bce7-ae5e36dd77ef: moving from state init -> state preparing Thread-18552::DEBUG::2011-01-18 19:43:57,996::taskManager::164::irs::(TaskManager:getAllTasksInfo) Entry. Thread-18552::DEBUG::2011-01-18 19:43:57,997::taskManager::169::irs::(TaskManager:getAllTasksInfo) Return. Response: {} Thread-18552::DEBUG::2011-01-18 19:43:57,997::task::577::irs::Task 8185781a-65b1-4664-bce7-ae5e36dd77ef: finished: {'allTasksInfo': {}} Thread-18552::DEBUG::2011-01-18 19:43:57,997::task::577::irs::Task 8185781a-65b1-4664-bce7-ae5e36dd77ef: moving from state preparing -> state finished Thread-18552::DEBUG::2011-01-18 19:43:57,997::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18552::DEBUG::2011-01-18 19:43:57,998::task::577::irs::Task 8185781a-65b1-4664-bce7-ae5e36dd77ef: ref 0 aborting False Thread-18552::INFO::2011-01-18 19:43:57,998::dispatcher::101::irs::Run and protect: getAllTasksInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'allTasksInfo': {}} Dummy-18546::DEBUG::2011-01-18 19:43:58,134::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510585 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:00,148::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:00,684::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503402 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:02,697::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:03,229::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500853 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:05,242::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:05,785::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511663 seconds, 2.0 MB/s\n'; = 0 Thread-18557::INFO::2011-01-18 19:44:07,100::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18557::DEBUG::2011-01-18 19:44:07,101::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: moving from state init -> state preparing Thread-18557::DEBUG::2011-01-18 19:44:07,101::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fc439f55-d55b-4780-b689-666da3adb0e0 acquire shared (120000) Thread-18557::DEBUG::2011-01-18 19:44:07,101::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18557::DEBUG::2011-01-18 19:44:07,102::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fc439f55-d55b-4780-b689-666da3adb0e0' Thread-18557::DEBUG::2011-01-18 19:44:07,102::resource::524::irs::Owner fc439f55-d55b-4780-b689-666da3adb0e0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18557::DEBUG::2011-01-18 19:44:07,102::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18557::DEBUG::2011-01-18 19:44:07,103::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: ref 1 aborting False Thread-18557::DEBUG::2011-01-18 19:44:07,103::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0468559265137', 'lastCheck': 1295372637.426719, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0460820198059', 'lastCheck': 1295372637.449971, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0481159687042', 'lastCheck': 1295372637.4540091, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0568249225616', 'lastCheck': 1295372637.471709, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0481588840485', 'lastCheck': 1295372637.4637749, 'valid': True, 'code': 0}} Thread-18557::DEBUG::2011-01-18 19:44:07,103::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: moving from state preparing -> state finished Thread-18557::DEBUG::2011-01-18 19:44:07,104::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18557::DEBUG::2011-01-18 19:44:07,104::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fc439f55-d55b-4780-b689-666da3adb0e0 releasing Thread-18557::DEBUG::2011-01-18 19:44:07,104::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18557::DEBUG::2011-01-18 19:44:07,104::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18557::DEBUG::2011-01-18 19:44:07,105::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18557::DEBUG::2011-01-18 19:44:07,105::resource::503::irs::Owner fc439f55-d55b-4780-b689-666da3adb0e0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18557::DEBUG::2011-01-18 19:44:07,105::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18557::DEBUG::2011-01-18 19:44:07,106::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18557::DEBUG::2011-01-18 19:44:07,106::task::577::irs::Task fc439f55-d55b-4780-b689-666da3adb0e0: ref 0 aborting False Thread-18557::INFO::2011-01-18 19:44:07,106::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0468559265137', 'lastCheck': 1295372637.426719, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0481159687042', 'lastCheck': 1295372637.4540091, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0481588840485', 'lastCheck': 1295372637.4637749, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0568249225616', 'lastCheck': 1295372637.471709, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0460820198059', 'lastCheck': 1295372637.449971, 'valid': True, 'code': 0}} Thread-18493::INFO::2011-01-18 19:44:07,425::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:44:07,426::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:44:07,450::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:44:07,451::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:44:07,454::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:44:07,455::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:44:07,463::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:44:07,464::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:44:07,466::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:44:07,470::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:44:07,471::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:44:07,491::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:44:07,493::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata count=1' (cwd None) Thread-18495::DEBUG::2011-01-18 19:44:07,495::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:07,505::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:07,506::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata count=1' (cwd None) Thread-18496::DEBUG::2011-01-18 19:44:07,512::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:44:07,514::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata count=1' (cwd None) Thread-18494::DEBUG::2011-01-18 19:44:07,525::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000457 seconds, 4.5 MB/s\n'; = 0 Thread-18494::DEBUG::2011-01-18 19:44:07,526::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000457 seconds, 4.5 MB/s'], size: 2048 Thread-18494::DEBUG::2011-01-18 19:44:07,526::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=None', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE0,uuid:JhuxXz-oY2f-VTKM-jZw1-vjeb-1yfc-4DEMhe,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE1,uuid:3aUVw3-VXRN-GbIT-jnEQ-RmUc-Kqcf-cj2Q3x,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE2,uuid:OFmc1C-VUM2-UeEr-4PaC-e2G4-YjTo-0aIgd3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE3,uuid:kyzPWM-1lW2-zYaO-2BIR-W66P-XrsG-fpehsp,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE4,uuid:EacnTZ-z822-xe9v-9t6A-1u3S-t96k-bOlSQM,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE5,uuid:N8Yas4-g1Rl-y3qt-Zb1d-t4ty-y8Iv-5LxYUR,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE6,uuid:aAF0AR-v83k-qND9-ZwAN-3p89-o9p0-rAF1zi,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE7,uuid:Qf3LTH-Ai55-3Lp0-FKFJ-zmfX-yyf8-yEyqIf,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=zSkJHd-z2vi-SfdH-OmXK-HHD2-HSSF-I7j139', 'MASTER_VERSION=0', '_SHA_CKSUM=6ac9d8deed2c8198ad87a15fde0e9be690649fe9'] Thread-18494::DEBUG::2011-01-18 19:44:07,526::metadata::89::irs::metadata.__validate() __cksum(md) = 6ac9d8deed2c8198ad87a15fde0e9be690649fe9 Thread-18497::DEBUG::2011-01-18 19:44:07,540::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000938 seconds, 2.2 MB/s\n'; = 0 Thread-18497::DEBUG::2011-01-18 19:44:07,541::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000938 seconds, 2.2 MB/s'], size: 2048 Thread-18497::DEBUG::2011-01-18 19:44:07,541::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_4', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE25,uuid:oT9Njr-43C6-OFn2-Pb1m-OHmv-q1ko-qWVZfU,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE24,uuid:zAhT6X-lhHA-0tpM-y8Ir-qdYz-cToH-QS34Qd,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE26,uuid:iai1Ih-p3aO-aJfa-m0Vu-bbUI-Bzmt-faQpU3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE27,uuid:Po2nTz-ZVf1-9CUn-XrvV-KFvh-bVc0-0UlRfc,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE28,uuid:7RfWRw-dleE-FJGk-unwH-mCIt-vjvO-cFlwEV,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE29,uuid:o0eNOA-eXTU-lOuo-1pOl-S9Kc-t3SS-qmqoxq,pestart:0,pecount:95,mapoffset:475', 'ROLE=Regular', 'SDUUID=d36e088c-e33f-41c9-9799-60f27d683f24', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=Rg9Ok4-Ts62-7x69-dnoq-vXMJ-1kxr-7V4hzD', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=506390723e870e52d768c8a93509b36b71d536b4'] Thread-18497::DEBUG::2011-01-18 19:44:07,541::metadata::89::irs::metadata.__validate() __cksum(md) = 506390723e870e52d768c8a93509b36b71d536b4 Thread-18496::DEBUG::2011-01-18 19:44:07,546::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000859 seconds, 2.4 MB/s\n'; = 0 Thread-18496::DEBUG::2011-01-18 19:44:07,547::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000859 seconds, 2.4 MB/s'], size: 2048 Thread-18496::DEBUG::2011-01-18 19:44:07,547::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_5', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE30,uuid:6OMUem-Ea8u-ePsj-ZtiI-PS2g-9lar-vDE1yw,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE31,uuid:rp1dI7-UPsb-ZzJX-eptN-usNA-7bhM-O2aeC0,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE32,uuid:REuolt-m2qg-IguX-yQ6Q-a88i-QbOk-KfxuNR,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE33,uuid:auCyUI-Qzi4-nPej-g5ji-3O7c-PNdD-YSr4HX,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE34,uuid:nxQIzE-gINr-2WGk-fBFz-xWdc-VKpc-0AkgEu,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE35,uuid:9rYRaB-6vqa-jeNi-8d70-Olyy-x5FR-Sfd9rm,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE36,uuid:aj40O1-nJLf-RfMK-vPfA-zy3M-CGZP-gFOulR,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE37,uuid:vCUrIv-sXPe-09Ze-EYzV-cj0C-67iG-ukcW5V,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=YlGdeL-gaDB-Es97-ogbJ-3LdW-crm3-jWw9cH', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=f0ac78701aec46eb830881e3c6db5e3fa21ea53c'] Thread-18496::DEBUG::2011-01-18 19:44:07,547::metadata::89::irs::metadata.__validate() __cksum(md) = f0ac78701aec46eb830881e3c6db5e3fa21ea53c Dummy-18546::DEBUG::2011-01-18 19:44:07,799::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18559::INFO::2011-01-18 19:44:07,986::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18559::DEBUG::2011-01-18 19:44:07,987::task::577::irs::Task d75247af-23be-4ade-a3b3-57bd173d7000: moving from state init -> state preparing Thread-18559::DEBUG::2011-01-18 19:44:07,988::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18559::DEBUG::2011-01-18 19:44:08,020::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s\n'; = 0 Thread-18559::DEBUG::2011-01-18 19:44:08,020::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s'], size: 2048 Thread-18559::DEBUG::2011-01-18 19:44:08,021::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18559::DEBUG::2011-01-18 19:44:08,021::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18559::DEBUG::2011-01-18 19:44:08,022::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18559::DEBUG::2011-01-18 19:44:08,022::task::577::irs::Task d75247af-23be-4ade-a3b3-57bd173d7000: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18559::DEBUG::2011-01-18 19:44:08,023::task::577::irs::Task d75247af-23be-4ade-a3b3-57bd173d7000: moving from state preparing -> state finished Thread-18559::DEBUG::2011-01-18 19:44:08,023::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18559::DEBUG::2011-01-18 19:44:08,023::task::577::irs::Task d75247af-23be-4ade-a3b3-57bd173d7000: ref 0 aborting False Thread-18559::INFO::2011-01-18 19:44:08,024::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18560::INFO::2011-01-18 19:44:08,035::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18560::DEBUG::2011-01-18 19:44:08,035::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: moving from state init -> state preparing Thread-18560::DEBUG::2011-01-18 19:44:08,036::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2c6d499e-e6d0-4aff-999b-ab1afd6022c6 acquire shared (120000) Thread-18560::DEBUG::2011-01-18 19:44:08,036::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18560::DEBUG::2011-01-18 19:44:08,036::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2c6d499e-e6d0-4aff-999b-ab1afd6022c6' Thread-18560::DEBUG::2011-01-18 19:44:08,037::resource::524::irs::Owner 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18560::DEBUG::2011-01-18 19:44:08,037::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18560::DEBUG::2011-01-18 19:44:08,037::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: ref 1 aborting False Thread-18560::INFO::2011-01-18 19:44:08,038::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18560::DEBUG::2011-01-18 19:44:08,038::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18560::DEBUG::2011-01-18 19:44:08,039::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: moving from state preparing -> state finished Thread-18560::DEBUG::2011-01-18 19:44:08,039::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18560::DEBUG::2011-01-18 19:44:08,039::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2c6d499e-e6d0-4aff-999b-ab1afd6022c6 releasing Thread-18560::DEBUG::2011-01-18 19:44:08,040::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18560::DEBUG::2011-01-18 19:44:08,040::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18560::DEBUG::2011-01-18 19:44:08,040::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18560::DEBUG::2011-01-18 19:44:08,041::resource::503::irs::Owner 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18560::DEBUG::2011-01-18 19:44:08,041::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18560::DEBUG::2011-01-18 19:44:08,041::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18560::DEBUG::2011-01-18 19:44:08,041::task::577::irs::Task 2c6d499e-e6d0-4aff-999b-ab1afd6022c6: ref 0 aborting False Thread-18560::INFO::2011-01-18 19:44:08,042::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:44:08,333::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501744 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:10,346::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:10,883::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503544 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:12,895::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:13,432::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504422 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:15,446::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:15,990::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511606 seconds, 2.0 MB/s\n'; = 0 Thread-18565::INFO::2011-01-18 19:44:17,265::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18565::DEBUG::2011-01-18 19:44:17,266::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: moving from state init -> state preparing Thread-18565::DEBUG::2011-01-18 19:44:17,266::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e67a8abe-1f57-4cb2-be07-73976c9c062a acquire shared (120000) Thread-18565::DEBUG::2011-01-18 19:44:17,266::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18565::DEBUG::2011-01-18 19:44:17,266::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e67a8abe-1f57-4cb2-be07-73976c9c062a' Thread-18565::DEBUG::2011-01-18 19:44:17,267::resource::524::irs::Owner e67a8abe-1f57-4cb2-be07-73976c9c062a: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18565::DEBUG::2011-01-18 19:44:17,267::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18565::DEBUG::2011-01-18 19:44:17,267::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: ref 1 aborting False Thread-18565::DEBUG::2011-01-18 19:44:17,268::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464458465576', 'lastCheck': 1295372647.472297, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0807120800018', 'lastCheck': 1295372647.530612, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0474629402161', 'lastCheck': 1295372647.501332, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0816750526428', 'lastCheck': 1295372647.552536, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0823860168457', 'lastCheck': 1295372647.545254, 'valid': True, 'code': 0}} Thread-18565::DEBUG::2011-01-18 19:44:17,268::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: moving from state preparing -> state finished Thread-18565::DEBUG::2011-01-18 19:44:17,268::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18565::DEBUG::2011-01-18 19:44:17,269::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e67a8abe-1f57-4cb2-be07-73976c9c062a releasing Thread-18565::DEBUG::2011-01-18 19:44:17,269::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18565::DEBUG::2011-01-18 19:44:17,269::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18565::DEBUG::2011-01-18 19:44:17,269::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18565::DEBUG::2011-01-18 19:44:17,270::resource::503::irs::Owner e67a8abe-1f57-4cb2-be07-73976c9c062a: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18565::DEBUG::2011-01-18 19:44:17,270::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18565::DEBUG::2011-01-18 19:44:17,270::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18565::DEBUG::2011-01-18 19:44:17,271::task::577::irs::Task e67a8abe-1f57-4cb2-be07-73976c9c062a: ref 0 aborting False Thread-18565::INFO::2011-01-18 19:44:17,271::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464458465576', 'lastCheck': 1295372647.472297, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0474629402161', 'lastCheck': 1295372647.501332, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0823860168457', 'lastCheck': 1295372647.545254, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0816750526428', 'lastCheck': 1295372647.552536, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0807120800018', 'lastCheck': 1295372647.530612, 'valid': True, 'code': 0}} Thread-18493::INFO::2011-01-18 19:44:17,471::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:44:17,472::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:44:17,501::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:44:17,502::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:44:17,512::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:44:17,529::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:44:17,530::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:44:17,541::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 19:44:17,545::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:44:17,546::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:44:17,552::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:44:17,553::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:44:17,576::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:17,587::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:44:17,599::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:18,003::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18567::INFO::2011-01-18 19:44:18,095::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18567::DEBUG::2011-01-18 19:44:18,096::task::577::irs::Task ceefc631-bd30-4da7-8e4f-17bae0378412: moving from state init -> state preparing Thread-18567::DEBUG::2011-01-18 19:44:18,096::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18567::DEBUG::2011-01-18 19:44:18,128::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s\n'; = 0 Thread-18567::DEBUG::2011-01-18 19:44:18,129::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s'], size: 2048 Thread-18567::DEBUG::2011-01-18 19:44:18,129::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18567::DEBUG::2011-01-18 19:44:18,129::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18567::DEBUG::2011-01-18 19:44:18,130::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18567::DEBUG::2011-01-18 19:44:18,130::task::577::irs::Task ceefc631-bd30-4da7-8e4f-17bae0378412: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18567::DEBUG::2011-01-18 19:44:18,131::task::577::irs::Task ceefc631-bd30-4da7-8e4f-17bae0378412: moving from state preparing -> state finished Thread-18567::DEBUG::2011-01-18 19:44:18,131::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18567::DEBUG::2011-01-18 19:44:18,131::task::577::irs::Task ceefc631-bd30-4da7-8e4f-17bae0378412: ref 0 aborting False Thread-18567::INFO::2011-01-18 19:44:18,132::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18568::INFO::2011-01-18 19:44:18,140::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18568::DEBUG::2011-01-18 19:44:18,140::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: moving from state init -> state preparing Thread-18568::DEBUG::2011-01-18 19:44:18,141::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 86378c48-a5d2-4ca7-b77b-c545f65da0dd acquire shared (120000) Thread-18568::DEBUG::2011-01-18 19:44:18,141::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18568::DEBUG::2011-01-18 19:44:18,141::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '86378c48-a5d2-4ca7-b77b-c545f65da0dd' Thread-18568::DEBUG::2011-01-18 19:44:18,142::resource::524::irs::Owner 86378c48-a5d2-4ca7-b77b-c545f65da0dd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18568::DEBUG::2011-01-18 19:44:18,142::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18568::DEBUG::2011-01-18 19:44:18,142::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: ref 1 aborting False Thread-18568::INFO::2011-01-18 19:44:18,143::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18568::DEBUG::2011-01-18 19:44:18,144::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18568::DEBUG::2011-01-18 19:44:18,144::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: moving from state preparing -> state finished Thread-18568::DEBUG::2011-01-18 19:44:18,145::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18568::DEBUG::2011-01-18 19:44:18,145::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 86378c48-a5d2-4ca7-b77b-c545f65da0dd releasing Thread-18568::DEBUG::2011-01-18 19:44:18,145::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18568::DEBUG::2011-01-18 19:44:18,145::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18568::DEBUG::2011-01-18 19:44:18,146::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18568::DEBUG::2011-01-18 19:44:18,146::resource::503::irs::Owner 86378c48-a5d2-4ca7-b77b-c545f65da0dd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18568::DEBUG::2011-01-18 19:44:18,146::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18568::DEBUG::2011-01-18 19:44:18,147::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18568::DEBUG::2011-01-18 19:44:18,147::task::577::irs::Task 86378c48-a5d2-4ca7-b77b-c545f65da0dd: ref 0 aborting False Thread-18568::INFO::2011-01-18 19:44:18,147::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:44:18,537::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502323 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:20,552::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:21,087::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503247 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:23,102::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:23,637::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503532 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:25,649::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:26,193::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512687 seconds, 2.0 MB/s\n'; = 0 Thread-18573::INFO::2011-01-18 19:44:27,427::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18573::DEBUG::2011-01-18 19:44:27,428::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: moving from state init -> state preparing Thread-18573::DEBUG::2011-01-18 19:44:27,428::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df acquire shared (120000) Thread-18573::DEBUG::2011-01-18 19:44:27,428::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18573::DEBUG::2011-01-18 19:44:27,429::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '18ce6bec-1a9e-40bc-a7ab-237c59e3b6df' Thread-18573::DEBUG::2011-01-18 19:44:27,429::resource::524::irs::Owner 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18573::DEBUG::2011-01-18 19:44:27,429::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18573::DEBUG::2011-01-18 19:44:27,429::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: ref 1 aborting False Thread-18573::DEBUG::2011-01-18 19:44:27,430::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0459160804749', 'lastCheck': 1295372657.51775, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0513319969177', 'lastCheck': 1295372657.581208, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049751996994', 'lastCheck': 1295372657.5506091, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0507159233093', 'lastCheck': 1295372657.602814, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0461211204529', 'lastCheck': 1295372657.5910461, 'valid': True, 'code': 0}} Thread-18573::DEBUG::2011-01-18 19:44:27,430::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: moving from state preparing -> state finished Thread-18573::DEBUG::2011-01-18 19:44:27,430::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18573::DEBUG::2011-01-18 19:44:27,431::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df releasing Thread-18573::DEBUG::2011-01-18 19:44:27,431::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18573::DEBUG::2011-01-18 19:44:27,431::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18573::DEBUG::2011-01-18 19:44:27,432::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18573::DEBUG::2011-01-18 19:44:27,432::resource::503::irs::Owner 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18573::DEBUG::2011-01-18 19:44:27,432::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18573::DEBUG::2011-01-18 19:44:27,432::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18573::DEBUG::2011-01-18 19:44:27,433::task::577::irs::Task 18ce6bec-1a9e-40bc-a7ab-237c59e3b6df: ref 0 aborting False Thread-18573::INFO::2011-01-18 19:44:27,433::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0459160804749', 'lastCheck': 1295372657.51775, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049751996994', 'lastCheck': 1295372657.5506091, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0461211204529', 'lastCheck': 1295372657.5910461, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0507159233093', 'lastCheck': 1295372657.602814, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0513319969177', 'lastCheck': 1295372657.581208, 'valid': True, 'code': 0}} Thread-18493::INFO::2011-01-18 19:44:27,516::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:44:27,517::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:44:27,552::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:44:27,552::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:44:27,556::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:44:27,580::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:44:27,581::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:44:27,591::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:44:27,592::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:44:27,593::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:44:27,603::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:44:27,604::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:44:27,624::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:27,632::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:44:27,644::misc::122::irs::SUCCESS: = ''; = 0 Thread-18575::INFO::2011-01-18 19:44:28,202::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18575::DEBUG::2011-01-18 19:44:28,202::task::577::irs::Task 4760aec5-1fb3-496c-90b0-aba2bc16e439: moving from state init -> state preparing Thread-18575::DEBUG::2011-01-18 19:44:28,202::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:28,207::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18575::DEBUG::2011-01-18 19:44:28,235::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000474 seconds, 4.3 MB/s\n'; = 0 Thread-18575::DEBUG::2011-01-18 19:44:28,235::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000474 seconds, 4.3 MB/s'], size: 2048 Thread-18575::DEBUG::2011-01-18 19:44:28,236::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18575::DEBUG::2011-01-18 19:44:28,236::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18575::DEBUG::2011-01-18 19:44:28,237::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18575::DEBUG::2011-01-18 19:44:28,237::task::577::irs::Task 4760aec5-1fb3-496c-90b0-aba2bc16e439: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18575::DEBUG::2011-01-18 19:44:28,238::task::577::irs::Task 4760aec5-1fb3-496c-90b0-aba2bc16e439: moving from state preparing -> state finished Thread-18575::DEBUG::2011-01-18 19:44:28,238::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18575::DEBUG::2011-01-18 19:44:28,238::task::577::irs::Task 4760aec5-1fb3-496c-90b0-aba2bc16e439: ref 0 aborting False Thread-18575::INFO::2011-01-18 19:44:28,239::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18576::INFO::2011-01-18 19:44:28,248::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18576::DEBUG::2011-01-18 19:44:28,248::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: moving from state init -> state preparing Thread-18576::DEBUG::2011-01-18 19:44:28,248::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 57c34212-556d-4d30-a4b3-7777ed82eb2b acquire shared (120000) Thread-18576::DEBUG::2011-01-18 19:44:28,249::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18576::DEBUG::2011-01-18 19:44:28,249::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '57c34212-556d-4d30-a4b3-7777ed82eb2b' Thread-18576::DEBUG::2011-01-18 19:44:28,249::resource::524::irs::Owner 57c34212-556d-4d30-a4b3-7777ed82eb2b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18576::DEBUG::2011-01-18 19:44:28,250::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18576::DEBUG::2011-01-18 19:44:28,250::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: ref 1 aborting False Thread-18576::INFO::2011-01-18 19:44:28,250::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18576::DEBUG::2011-01-18 19:44:28,251::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18576::DEBUG::2011-01-18 19:44:28,252::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: moving from state preparing -> state finished Thread-18576::DEBUG::2011-01-18 19:44:28,252::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18576::DEBUG::2011-01-18 19:44:28,252::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 57c34212-556d-4d30-a4b3-7777ed82eb2b releasing Thread-18576::DEBUG::2011-01-18 19:44:28,252::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18576::DEBUG::2011-01-18 19:44:28,253::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18576::DEBUG::2011-01-18 19:44:28,253::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18576::DEBUG::2011-01-18 19:44:28,253::resource::503::irs::Owner 57c34212-556d-4d30-a4b3-7777ed82eb2b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18576::DEBUG::2011-01-18 19:44:28,254::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18576::DEBUG::2011-01-18 19:44:28,254::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18576::DEBUG::2011-01-18 19:44:28,254::task::577::irs::Task 57c34212-556d-4d30-a4b3-7777ed82eb2b: ref 0 aborting False Thread-18576::INFO::2011-01-18 19:44:28,255::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:44:28,743::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503359 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:30,755::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:31,291::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503615 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:33,303::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:33,836::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501467 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:35,851::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:36,393::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510134 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:44:37,561::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:44:37,562::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18581::INFO::2011-01-18 19:44:37,593::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18581::DEBUG::2011-01-18 19:44:37,594::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: moving from state init -> state preparing Thread-18581::DEBUG::2011-01-18 19:44:37,594::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0752472-7272-4eb6-bfc6-1dc9847254a8 acquire shared (120000) Thread-18581::DEBUG::2011-01-18 19:44:37,595::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18581::DEBUG::2011-01-18 19:44:37,595::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c0752472-7272-4eb6-bfc6-1dc9847254a8' Thread-18581::DEBUG::2011-01-18 19:44:37,595::resource::524::irs::Owner c0752472-7272-4eb6-bfc6-1dc9847254a8: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18581::DEBUG::2011-01-18 19:44:37,595::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18581::DEBUG::2011-01-18 19:44:37,596::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: ref 1 aborting False Thread-18581::DEBUG::2011-01-18 19:44:37,596::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0458559989929', 'lastCheck': 1295372667.562691, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473599433899', 'lastCheck': 1295372667.6282139, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0496988296509', 'lastCheck': 1295372667.6015489, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0460801124573', 'lastCheck': 1295372667.6489501, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0456399917603', 'lastCheck': 1295372667.636554, 'valid': True, 'code': 0}} Thread-18581::DEBUG::2011-01-18 19:44:37,597::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: moving from state preparing -> state finished Thread-18581::DEBUG::2011-01-18 19:44:37,597::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18581::DEBUG::2011-01-18 19:44:37,597::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0752472-7272-4eb6-bfc6-1dc9847254a8 releasing Thread-18581::DEBUG::2011-01-18 19:44:37,597::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18581::DEBUG::2011-01-18 19:44:37,598::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18581::DEBUG::2011-01-18 19:44:37,598::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18581::DEBUG::2011-01-18 19:44:37,598::resource::503::irs::Owner c0752472-7272-4eb6-bfc6-1dc9847254a8: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18581::DEBUG::2011-01-18 19:44:37,598::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18581::DEBUG::2011-01-18 19:44:37,599::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18581::DEBUG::2011-01-18 19:44:37,599::task::577::irs::Task c0752472-7272-4eb6-bfc6-1dc9847254a8: ref 0 aborting False Thread-18581::INFO::2011-01-18 19:44:37,599::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0458559989929', 'lastCheck': 1295372667.562691, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0496988296509', 'lastCheck': 1295372667.6015489, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0456399917603', 'lastCheck': 1295372667.636554, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0460801124573', 'lastCheck': 1295372667.6489501, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473599433899', 'lastCheck': 1295372667.6282139, 'valid': True, 'code': 0}} Thread-18495::INFO::2011-01-18 19:44:37,602::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:44:37,603::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:44:37,603::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:44:37,627::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:44:37,628::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:44:37,636::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:44:37,637::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:44:37,643::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:44:37,649::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:44:37,650::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:44:37,668::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:37,680::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:44:37,690::misc::122::irs::SUCCESS: = ''; = 0 Thread-18583::INFO::2011-01-18 19:44:38,308::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18583::DEBUG::2011-01-18 19:44:38,309::task::577::irs::Task c1507eb8-c676-4f21-8167-89cb82848d92: moving from state init -> state preparing Thread-18583::DEBUG::2011-01-18 19:44:38,309::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18583::DEBUG::2011-01-18 19:44:38,341::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.001095 seconds, 1.9 MB/s\n'; = 0 Thread-18583::DEBUG::2011-01-18 19:44:38,342::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.001095 seconds, 1.9 MB/s'], size: 2048 Thread-18583::DEBUG::2011-01-18 19:44:38,342::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18583::DEBUG::2011-01-18 19:44:38,343::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18583::DEBUG::2011-01-18 19:44:38,343::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18583::DEBUG::2011-01-18 19:44:38,344::task::577::irs::Task c1507eb8-c676-4f21-8167-89cb82848d92: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18583::DEBUG::2011-01-18 19:44:38,344::task::577::irs::Task c1507eb8-c676-4f21-8167-89cb82848d92: moving from state preparing -> state finished Thread-18583::DEBUG::2011-01-18 19:44:38,344::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18583::DEBUG::2011-01-18 19:44:38,344::task::577::irs::Task c1507eb8-c676-4f21-8167-89cb82848d92: ref 0 aborting False Thread-18583::INFO::2011-01-18 19:44:38,345::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18584::INFO::2011-01-18 19:44:38,354::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18584::DEBUG::2011-01-18 19:44:38,354::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: moving from state init -> state preparing Thread-18584::DEBUG::2011-01-18 19:44:38,354::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 08adbcb0-831d-42be-9d26-208ada3a64c9 acquire shared (120000) Thread-18584::DEBUG::2011-01-18 19:44:38,355::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18584::DEBUG::2011-01-18 19:44:38,355::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '08adbcb0-831d-42be-9d26-208ada3a64c9' Thread-18584::DEBUG::2011-01-18 19:44:38,355::resource::524::irs::Owner 08adbcb0-831d-42be-9d26-208ada3a64c9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18584::DEBUG::2011-01-18 19:44:38,356::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18584::DEBUG::2011-01-18 19:44:38,356::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: ref 1 aborting False Thread-18584::INFO::2011-01-18 19:44:38,357::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18584::DEBUG::2011-01-18 19:44:38,357::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18584::DEBUG::2011-01-18 19:44:38,358::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: moving from state preparing -> state finished Thread-18584::DEBUG::2011-01-18 19:44:38,358::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18584::DEBUG::2011-01-18 19:44:38,358::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 08adbcb0-831d-42be-9d26-208ada3a64c9 releasing Thread-18584::DEBUG::2011-01-18 19:44:38,358::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18584::DEBUG::2011-01-18 19:44:38,359::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18584::DEBUG::2011-01-18 19:44:38,359::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18584::DEBUG::2011-01-18 19:44:38,359::resource::503::irs::Owner 08adbcb0-831d-42be-9d26-208ada3a64c9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18584::DEBUG::2011-01-18 19:44:38,360::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18584::DEBUG::2011-01-18 19:44:38,360::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18584::DEBUG::2011-01-18 19:44:38,360::task::577::irs::Task 08adbcb0-831d-42be-9d26-208ada3a64c9: ref 0 aborting False Thread-18584::INFO::2011-01-18 19:44:38,360::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:44:38,405::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:38,939::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501755 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:40,953::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:41,493::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.508164 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:43,506::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:44,041::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50337 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:46,055::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:46,601::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514115 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:44:47,613::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:44:47,614::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:44:47,651::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:44:47,651::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:44:47,654::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:44:47,672::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:44:47,673::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:44:47,684::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:44:47,685::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:44:47,690::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:44:47,695::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:44:47,696::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:44:47,713::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:47,728::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:44:47,736::misc::122::irs::SUCCESS: = ''; = 0 Thread-18589::INFO::2011-01-18 19:44:47,758::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18589::DEBUG::2011-01-18 19:44:47,758::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: moving from state init -> state preparing Thread-18589::DEBUG::2011-01-18 19:44:47,759::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 96d971e7-8e2b-4b2c-b28e-364c19aea95c acquire shared (120000) Thread-18589::DEBUG::2011-01-18 19:44:47,759::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18589::DEBUG::2011-01-18 19:44:47,759::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '96d971e7-8e2b-4b2c-b28e-364c19aea95c' Thread-18589::DEBUG::2011-01-18 19:44:47,760::resource::524::irs::Owner 96d971e7-8e2b-4b2c-b28e-364c19aea95c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18589::DEBUG::2011-01-18 19:44:47,760::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18589::DEBUG::2011-01-18 19:44:47,760::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: ref 1 aborting False Thread-18589::DEBUG::2011-01-18 19:44:47,761::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0455501079559', 'lastCheck': 1295372687.659405, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0464339256287', 'lastCheck': 1295372687.71928, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0457890033722', 'lastCheck': 1295372687.696635, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0462028980255', 'lastCheck': 1295372687.7411499, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0476908683777', 'lastCheck': 1295372687.73155, 'valid': True, 'code': 0}} Thread-18589::DEBUG::2011-01-18 19:44:47,761::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: moving from state preparing -> state finished Thread-18589::DEBUG::2011-01-18 19:44:47,761::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18589::DEBUG::2011-01-18 19:44:47,762::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 96d971e7-8e2b-4b2c-b28e-364c19aea95c releasing Thread-18589::DEBUG::2011-01-18 19:44:47,762::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18589::DEBUG::2011-01-18 19:44:47,762::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18589::DEBUG::2011-01-18 19:44:47,762::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18589::DEBUG::2011-01-18 19:44:47,763::resource::503::irs::Owner 96d971e7-8e2b-4b2c-b28e-364c19aea95c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18589::DEBUG::2011-01-18 19:44:47,763::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18589::DEBUG::2011-01-18 19:44:47,763::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18589::DEBUG::2011-01-18 19:44:47,764::task::577::irs::Task 96d971e7-8e2b-4b2c-b28e-364c19aea95c: ref 0 aborting False Thread-18589::INFO::2011-01-18 19:44:47,764::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0455501079559', 'lastCheck': 1295372687.659405, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0457890033722', 'lastCheck': 1295372687.696635, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0476908683777', 'lastCheck': 1295372687.73155, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0462028980255', 'lastCheck': 1295372687.7411499, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0464339256287', 'lastCheck': 1295372687.71928, 'valid': True, 'code': 0}} Thread-18591::INFO::2011-01-18 19:44:48,413::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18591::DEBUG::2011-01-18 19:44:48,414::task::577::irs::Task af840f27-de95-4e7d-b382-070b4c35e71d: moving from state init -> state preparing Thread-18591::DEBUG::2011-01-18 19:44:48,414::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18591::DEBUG::2011-01-18 19:44:48,446::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00089 seconds, 2.3 MB/s\n'; = 0 Thread-18591::DEBUG::2011-01-18 19:44:48,447::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00089 seconds, 2.3 MB/s'], size: 2048 Thread-18591::DEBUG::2011-01-18 19:44:48,447::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18591::DEBUG::2011-01-18 19:44:48,447::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18591::DEBUG::2011-01-18 19:44:48,448::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18591::DEBUG::2011-01-18 19:44:48,448::task::577::irs::Task af840f27-de95-4e7d-b382-070b4c35e71d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18591::DEBUG::2011-01-18 19:44:48,449::task::577::irs::Task af840f27-de95-4e7d-b382-070b4c35e71d: moving from state preparing -> state finished Thread-18591::DEBUG::2011-01-18 19:44:48,449::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18591::DEBUG::2011-01-18 19:44:48,449::task::577::irs::Task af840f27-de95-4e7d-b382-070b4c35e71d: ref 0 aborting False Thread-18591::INFO::2011-01-18 19:44:48,450::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18592::INFO::2011-01-18 19:44:48,458::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18592::DEBUG::2011-01-18 19:44:48,459::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: moving from state init -> state preparing Thread-18592::DEBUG::2011-01-18 19:44:48,459::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 95f7fab1-1b07-480a-b716-6be267d4a247 acquire shared (120000) Thread-18592::DEBUG::2011-01-18 19:44:48,459::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18592::DEBUG::2011-01-18 19:44:48,460::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '95f7fab1-1b07-480a-b716-6be267d4a247' Thread-18592::DEBUG::2011-01-18 19:44:48,460::resource::524::irs::Owner 95f7fab1-1b07-480a-b716-6be267d4a247: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18592::DEBUG::2011-01-18 19:44:48,460::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18592::DEBUG::2011-01-18 19:44:48,460::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: ref 1 aborting False Thread-18592::INFO::2011-01-18 19:44:48,461::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18592::DEBUG::2011-01-18 19:44:48,462::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18592::DEBUG::2011-01-18 19:44:48,462::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: moving from state preparing -> state finished Thread-18592::DEBUG::2011-01-18 19:44:48,462::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18592::DEBUG::2011-01-18 19:44:48,462::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 95f7fab1-1b07-480a-b716-6be267d4a247 releasing Thread-18592::DEBUG::2011-01-18 19:44:48,463::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18592::DEBUG::2011-01-18 19:44:48,463::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18592::DEBUG::2011-01-18 19:44:48,463::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18592::DEBUG::2011-01-18 19:44:48,464::resource::503::irs::Owner 95f7fab1-1b07-480a-b716-6be267d4a247: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18592::DEBUG::2011-01-18 19:44:48,464::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18592::DEBUG::2011-01-18 19:44:48,464::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18592::DEBUG::2011-01-18 19:44:48,465::task::577::irs::Task 95f7fab1-1b07-480a-b716-6be267d4a247: ref 0 aborting False Thread-18592::INFO::2011-01-18 19:44:48,465::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:44:48,614::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:49,149::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502565 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:51,162::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:51,695::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501087 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:53,710::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:54,246::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503752 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:44:56,261::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:56,804::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511493 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:44:57,658::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:44:57,659::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:44:57,699::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:44:57,708::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:44:57,709::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:44:57,719::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:44:57,720::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:44:57,731::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:44:57,732::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:44:57,741::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:44:57,742::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:44:57,748::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:44:57,763::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:44:57,774::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:44:57,783::misc::122::irs::SUCCESS: = ''; = 0 Thread-18597::INFO::2011-01-18 19:44:57,919::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18597::DEBUG::2011-01-18 19:44:57,919::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: moving from state init -> state preparing Thread-18597::DEBUG::2011-01-18 19:44:57,920::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a59768bb-b2be-49fd-906f-7ae89c18897c acquire shared (120000) Thread-18597::DEBUG::2011-01-18 19:44:57,920::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18597::DEBUG::2011-01-18 19:44:57,920::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a59768bb-b2be-49fd-906f-7ae89c18897c' Thread-18597::DEBUG::2011-01-18 19:44:57,920::resource::524::irs::Owner a59768bb-b2be-49fd-906f-7ae89c18897c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18597::DEBUG::2011-01-18 19:44:57,921::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18597::DEBUG::2011-01-18 19:44:57,921::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: ref 1 aborting False Thread-18597::DEBUG::2011-01-18 19:44:57,921::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451979637146', 'lastCheck': 1295372697.7040319, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0493249893188', 'lastCheck': 1295372697.7682331, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0454928874969', 'lastCheck': 1295372697.7543349, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0467660427094', 'lastCheck': 1295372697.787709, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0464859008789', 'lastCheck': 1295372697.777349, 'valid': True, 'code': 0}} Thread-18597::DEBUG::2011-01-18 19:44:57,922::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: moving from state preparing -> state finished Thread-18597::DEBUG::2011-01-18 19:44:57,922::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18597::DEBUG::2011-01-18 19:44:57,922::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a59768bb-b2be-49fd-906f-7ae89c18897c releasing Thread-18597::DEBUG::2011-01-18 19:44:57,923::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18597::DEBUG::2011-01-18 19:44:57,923::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18597::DEBUG::2011-01-18 19:44:57,923::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18597::DEBUG::2011-01-18 19:44:57,923::resource::503::irs::Owner a59768bb-b2be-49fd-906f-7ae89c18897c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18597::DEBUG::2011-01-18 19:44:57,924::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18597::DEBUG::2011-01-18 19:44:57,924::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18597::DEBUG::2011-01-18 19:44:57,924::task::577::irs::Task a59768bb-b2be-49fd-906f-7ae89c18897c: ref 0 aborting False Thread-18597::INFO::2011-01-18 19:44:57,925::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451979637146', 'lastCheck': 1295372697.7040319, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0454928874969', 'lastCheck': 1295372697.7543349, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0464859008789', 'lastCheck': 1295372697.777349, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0467660427094', 'lastCheck': 1295372697.787709, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0493249893188', 'lastCheck': 1295372697.7682331, 'valid': True, 'code': 0}} Thread-18599::INFO::2011-01-18 19:44:58,516::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18599::DEBUG::2011-01-18 19:44:58,517::task::577::irs::Task d8c638a3-f68e-4969-a12b-e3904fe14cfc: moving from state init -> state preparing Thread-18599::DEBUG::2011-01-18 19:44:58,517::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18599::DEBUG::2011-01-18 19:44:58,549::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000804 seconds, 2.5 MB/s\n'; = 0 Thread-18599::DEBUG::2011-01-18 19:44:58,549::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000804 seconds, 2.5 MB/s'], size: 2048 Thread-18599::DEBUG::2011-01-18 19:44:58,550::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18599::DEBUG::2011-01-18 19:44:58,550::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18599::DEBUG::2011-01-18 19:44:58,551::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18599::DEBUG::2011-01-18 19:44:58,551::task::577::irs::Task d8c638a3-f68e-4969-a12b-e3904fe14cfc: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18599::DEBUG::2011-01-18 19:44:58,551::task::577::irs::Task d8c638a3-f68e-4969-a12b-e3904fe14cfc: moving from state preparing -> state finished Thread-18599::DEBUG::2011-01-18 19:44:58,552::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18599::DEBUG::2011-01-18 19:44:58,552::task::577::irs::Task d8c638a3-f68e-4969-a12b-e3904fe14cfc: ref 0 aborting False Thread-18599::INFO::2011-01-18 19:44:58,552::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18600::INFO::2011-01-18 19:44:58,560::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18600::DEBUG::2011-01-18 19:44:58,561::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: moving from state init -> state preparing Thread-18600::DEBUG::2011-01-18 19:44:58,561::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dcf6fb79-4749-4c78-a879-faf51e63f391 acquire shared (120000) Thread-18600::DEBUG::2011-01-18 19:44:58,561::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18600::DEBUG::2011-01-18 19:44:58,562::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'dcf6fb79-4749-4c78-a879-faf51e63f391' Thread-18600::DEBUG::2011-01-18 19:44:58,562::resource::524::irs::Owner dcf6fb79-4749-4c78-a879-faf51e63f391: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18600::DEBUG::2011-01-18 19:44:58,562::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18600::DEBUG::2011-01-18 19:44:58,563::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: ref 1 aborting False Thread-18600::INFO::2011-01-18 19:44:58,563::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18600::DEBUG::2011-01-18 19:44:58,564::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18600::DEBUG::2011-01-18 19:44:58,564::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: moving from state preparing -> state finished Thread-18600::DEBUG::2011-01-18 19:44:58,564::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18600::DEBUG::2011-01-18 19:44:58,565::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dcf6fb79-4749-4c78-a879-faf51e63f391 releasing Thread-18600::DEBUG::2011-01-18 19:44:58,565::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18600::DEBUG::2011-01-18 19:44:58,565::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18600::DEBUG::2011-01-18 19:44:58,565::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18600::DEBUG::2011-01-18 19:44:58,566::resource::503::irs::Owner dcf6fb79-4749-4c78-a879-faf51e63f391: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18600::DEBUG::2011-01-18 19:44:58,566::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18600::DEBUG::2011-01-18 19:44:58,566::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18600::DEBUG::2011-01-18 19:44:58,567::task::577::irs::Task dcf6fb79-4749-4c78-a879-faf51e63f391: ref 0 aborting False Thread-18600::INFO::2011-01-18 19:44:58,567::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:44:58,818::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:44:59,350::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500944 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:01,362::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:01,896::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502182 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:03,910::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:04,444::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502053 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:06,459::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:07,001::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510236 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:45:07,703::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:45:07,704::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:45:07,744::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:45:07,753::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:45:07,754::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:45:07,768::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:45:07,769::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:45:07,777::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:45:07,778::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:45:07,788::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:45:07,789::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:45:07,793::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:45:07,815::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:45:07,819::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:45:07,830::misc::122::irs::SUCCESS: = ''; = 0 Thread-18605::INFO::2011-01-18 19:45:08,092::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18605::DEBUG::2011-01-18 19:45:08,092::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: moving from state init -> state preparing Thread-18605::DEBUG::2011-01-18 19:45:08,093::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2319b016-54ac-4977-bee8-5bcc8c05bd09 acquire shared (120000) Thread-18605::DEBUG::2011-01-18 19:45:08,093::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18605::DEBUG::2011-01-18 19:45:08,093::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2319b016-54ac-4977-bee8-5bcc8c05bd09' Thread-18605::DEBUG::2011-01-18 19:45:08,093::resource::524::irs::Owner 2319b016-54ac-4977-bee8-5bcc8c05bd09: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18605::DEBUG::2011-01-18 19:45:08,094::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18605::DEBUG::2011-01-18 19:45:08,094::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: ref 1 aborting False Thread-18605::DEBUG::2011-01-18 19:45:08,094::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450558662415', 'lastCheck': 1295372707.7489049, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0520510673523', 'lastCheck': 1295372707.8199151, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0455491542816', 'lastCheck': 1295372707.799401, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466980934143', 'lastCheck': 1295372707.834615, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0461308956146', 'lastCheck': 1295372707.823036, 'valid': True, 'code': 0}} Thread-18605::DEBUG::2011-01-18 19:45:08,095::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: moving from state preparing -> state finished Thread-18605::DEBUG::2011-01-18 19:45:08,095::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18605::DEBUG::2011-01-18 19:45:08,095::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2319b016-54ac-4977-bee8-5bcc8c05bd09 releasing Thread-18605::DEBUG::2011-01-18 19:45:08,096::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18605::DEBUG::2011-01-18 19:45:08,096::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18605::DEBUG::2011-01-18 19:45:08,096::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18605::DEBUG::2011-01-18 19:45:08,096::resource::503::irs::Owner 2319b016-54ac-4977-bee8-5bcc8c05bd09: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18605::DEBUG::2011-01-18 19:45:08,097::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18605::DEBUG::2011-01-18 19:45:08,097::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18605::DEBUG::2011-01-18 19:45:08,097::task::577::irs::Task 2319b016-54ac-4977-bee8-5bcc8c05bd09: ref 0 aborting False Thread-18605::INFO::2011-01-18 19:45:08,098::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450558662415', 'lastCheck': 1295372707.7489049, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0455491542816', 'lastCheck': 1295372707.799401, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0461308956146', 'lastCheck': 1295372707.823036, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466980934143', 'lastCheck': 1295372707.834615, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0520510673523', 'lastCheck': 1295372707.8199151, 'valid': True, 'code': 0}} Thread-18607::INFO::2011-01-18 19:45:08,639::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18607::DEBUG::2011-01-18 19:45:08,639::task::577::irs::Task 6ca5855d-7d75-4fd2-b75b-1cca3d61c9f7: moving from state init -> state preparing Thread-18607::DEBUG::2011-01-18 19:45:08,640::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18607::DEBUG::2011-01-18 19:45:08,672::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000419 seconds, 4.9 MB/s\n'; = 0 Thread-18607::DEBUG::2011-01-18 19:45:08,672::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000419 seconds, 4.9 MB/s'], size: 2048 Thread-18607::DEBUG::2011-01-18 19:45:08,673::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18607::DEBUG::2011-01-18 19:45:08,673::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18607::DEBUG::2011-01-18 19:45:08,674::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18607::DEBUG::2011-01-18 19:45:08,674::task::577::irs::Task 6ca5855d-7d75-4fd2-b75b-1cca3d61c9f7: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18607::DEBUG::2011-01-18 19:45:08,674::task::577::irs::Task 6ca5855d-7d75-4fd2-b75b-1cca3d61c9f7: moving from state preparing -> state finished Thread-18607::DEBUG::2011-01-18 19:45:08,675::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18607::DEBUG::2011-01-18 19:45:08,675::task::577::irs::Task 6ca5855d-7d75-4fd2-b75b-1cca3d61c9f7: ref 0 aborting False Thread-18607::INFO::2011-01-18 19:45:08,675::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18608::INFO::2011-01-18 19:45:08,683::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18608::DEBUG::2011-01-18 19:45:08,684::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: moving from state init -> state preparing Thread-18608::DEBUG::2011-01-18 19:45:08,684::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7c60f149-220f-4b8c-bc7f-b0b798422151 acquire shared (120000) Thread-18608::DEBUG::2011-01-18 19:45:08,684::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18608::DEBUG::2011-01-18 19:45:08,685::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '7c60f149-220f-4b8c-bc7f-b0b798422151' Thread-18608::DEBUG::2011-01-18 19:45:08,685::resource::524::irs::Owner 7c60f149-220f-4b8c-bc7f-b0b798422151: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18608::DEBUG::2011-01-18 19:45:08,685::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18608::DEBUG::2011-01-18 19:45:08,686::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: ref 1 aborting False Thread-18608::INFO::2011-01-18 19:45:08,686::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18608::DEBUG::2011-01-18 19:45:08,687::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18608::DEBUG::2011-01-18 19:45:08,687::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: moving from state preparing -> state finished Thread-18608::DEBUG::2011-01-18 19:45:08,687::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18608::DEBUG::2011-01-18 19:45:08,688::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7c60f149-220f-4b8c-bc7f-b0b798422151 releasing Thread-18608::DEBUG::2011-01-18 19:45:08,688::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18608::DEBUG::2011-01-18 19:45:08,688::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18608::DEBUG::2011-01-18 19:45:08,688::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18608::DEBUG::2011-01-18 19:45:08,689::resource::503::irs::Owner 7c60f149-220f-4b8c-bc7f-b0b798422151: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18608::DEBUG::2011-01-18 19:45:08,689::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18608::DEBUG::2011-01-18 19:45:08,689::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18608::DEBUG::2011-01-18 19:45:08,690::task::577::irs::Task 7c60f149-220f-4b8c-bc7f-b0b798422151: ref 0 aborting False Thread-18608::INFO::2011-01-18 19:45:08,690::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:45:09,014::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:09,547::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501547 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:11,560::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:12,092::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500605 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:14,105::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:14,639::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502118 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:16,652::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:17,195::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509855 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:45:17,748::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:45:17,749::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:45:17,789::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:45:17,798::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:45:17,799::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:45:17,820::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:45:17,821::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:45:17,823::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:45:17,825::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:45:17,834::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:45:17,835::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:45:17,839::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:45:17,864::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:45:17,865::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:45:17,876::misc::122::irs::SUCCESS: = ''; = 0 Thread-18613::INFO::2011-01-18 19:45:18,254::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18613::DEBUG::2011-01-18 19:45:18,254::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: moving from state init -> state preparing Thread-18613::DEBUG::2011-01-18 19:45:18,254::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 09b31bae-16fb-4df1-9954-241a6446f54b acquire shared (120000) Thread-18613::DEBUG::2011-01-18 19:45:18,255::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18613::DEBUG::2011-01-18 19:45:18,255::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '09b31bae-16fb-4df1-9954-241a6446f54b' Thread-18613::DEBUG::2011-01-18 19:45:18,255::resource::524::irs::Owner 09b31bae-16fb-4df1-9954-241a6446f54b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18613::DEBUG::2011-01-18 19:45:18,256::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18613::DEBUG::2011-01-18 19:45:18,256::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: ref 1 aborting False Thread-18613::DEBUG::2011-01-18 19:45:18,256::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450949668884', 'lastCheck': 1295372717.7939329, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0492970943451', 'lastCheck': 1295372717.8691571, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.046863079071', 'lastCheck': 1295372717.8457651, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0472848415375', 'lastCheck': 1295372717.8811879, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.04678606987', 'lastCheck': 1295372717.869844, 'valid': True, 'code': 0}} Thread-18613::DEBUG::2011-01-18 19:45:18,257::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: moving from state preparing -> state finished Thread-18613::DEBUG::2011-01-18 19:45:18,257::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18613::DEBUG::2011-01-18 19:45:18,257::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 09b31bae-16fb-4df1-9954-241a6446f54b releasing Thread-18613::DEBUG::2011-01-18 19:45:18,257::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18613::DEBUG::2011-01-18 19:45:18,258::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18613::DEBUG::2011-01-18 19:45:18,258::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18613::DEBUG::2011-01-18 19:45:18,258::resource::503::irs::Owner 09b31bae-16fb-4df1-9954-241a6446f54b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18613::DEBUG::2011-01-18 19:45:18,259::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18613::DEBUG::2011-01-18 19:45:18,259::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18613::DEBUG::2011-01-18 19:45:18,259::task::577::irs::Task 09b31bae-16fb-4df1-9954-241a6446f54b: ref 0 aborting False Thread-18613::INFO::2011-01-18 19:45:18,260::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450949668884', 'lastCheck': 1295372717.7939329, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.046863079071', 'lastCheck': 1295372717.8457651, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.04678606987', 'lastCheck': 1295372717.869844, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0472848415375', 'lastCheck': 1295372717.8811879, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0492970943451', 'lastCheck': 1295372717.8691571, 'valid': True, 'code': 0}} Thread-18615::INFO::2011-01-18 19:45:18,776::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18615::DEBUG::2011-01-18 19:45:18,776::task::577::irs::Task 1af4cd04-28dd-46d8-91b8-168c9aca7f26: moving from state init -> state preparing Thread-18615::DEBUG::2011-01-18 19:45:18,777::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18615::DEBUG::2011-01-18 19:45:18,808::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000431 seconds, 4.8 MB/s\n'; = 0 Thread-18615::DEBUG::2011-01-18 19:45:18,808::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000431 seconds, 4.8 MB/s'], size: 2048 Thread-18615::DEBUG::2011-01-18 19:45:18,809::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18615::DEBUG::2011-01-18 19:45:18,809::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18615::DEBUG::2011-01-18 19:45:18,810::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18615::DEBUG::2011-01-18 19:45:18,810::task::577::irs::Task 1af4cd04-28dd-46d8-91b8-168c9aca7f26: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18615::DEBUG::2011-01-18 19:45:18,811::task::577::irs::Task 1af4cd04-28dd-46d8-91b8-168c9aca7f26: moving from state preparing -> state finished Thread-18615::DEBUG::2011-01-18 19:45:18,811::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18615::DEBUG::2011-01-18 19:45:18,811::task::577::irs::Task 1af4cd04-28dd-46d8-91b8-168c9aca7f26: ref 0 aborting False Thread-18615::INFO::2011-01-18 19:45:18,811::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18616::INFO::2011-01-18 19:45:18,820::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18616::DEBUG::2011-01-18 19:45:18,820::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: moving from state init -> state preparing Thread-18616::DEBUG::2011-01-18 19:45:18,821::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb acquire shared (120000) Thread-18616::DEBUG::2011-01-18 19:45:18,821::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18616::DEBUG::2011-01-18 19:45:18,821::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb' Thread-18616::DEBUG::2011-01-18 19:45:18,821::resource::524::irs::Owner e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18616::DEBUG::2011-01-18 19:45:18,822::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18616::DEBUG::2011-01-18 19:45:18,822::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: ref 1 aborting False Thread-18616::INFO::2011-01-18 19:45:18,822::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18616::DEBUG::2011-01-18 19:45:18,823::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18616::DEBUG::2011-01-18 19:45:18,824::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: moving from state preparing -> state finished Thread-18616::DEBUG::2011-01-18 19:45:18,824::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18616::DEBUG::2011-01-18 19:45:18,824::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb releasing Thread-18616::DEBUG::2011-01-18 19:45:18,824::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18616::DEBUG::2011-01-18 19:45:18,825::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18616::DEBUG::2011-01-18 19:45:18,825::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18616::DEBUG::2011-01-18 19:45:18,825::resource::503::irs::Owner e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18616::DEBUG::2011-01-18 19:45:18,826::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18616::DEBUG::2011-01-18 19:45:18,826::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18616::DEBUG::2011-01-18 19:45:18,826::task::577::irs::Task e3a84ff6-cdc0-4351-bdb2-56a809f1c3eb: ref 0 aborting False Thread-18616::INFO::2011-01-18 19:45:18,826::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:45:19,208::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:19,743::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503572 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:21,756::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:22,288::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500484 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:24,303::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:24,837::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502388 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:26,850::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:27,391::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509559 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:45:27,793::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:45:27,794::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:45:27,833::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:45:27,849::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:45:27,850::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:45:27,869::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:45:27,870::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:45:27,870::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:45:27,874::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:45:27,881::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:45:27,882::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:45:27,891::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:45:27,910::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:45:27,916::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:45:27,922::misc::122::irs::SUCCESS: = ''; = 0 Thread-18621::INFO::2011-01-18 19:45:28,425::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18621::DEBUG::2011-01-18 19:45:28,426::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: moving from state init -> state preparing Thread-18621::DEBUG::2011-01-18 19:45:28,426::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138 acquire shared (120000) Thread-18621::DEBUG::2011-01-18 19:45:28,426::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18621::DEBUG::2011-01-18 19:45:28,427::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138' Thread-18621::DEBUG::2011-01-18 19:45:28,427::resource::524::irs::Owner b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18621::DEBUG::2011-01-18 19:45:28,427::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18621::DEBUG::2011-01-18 19:45:28,427::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: ref 1 aborting False Thread-18621::DEBUG::2011-01-18 19:45:28,428::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.044399023056', 'lastCheck': 1295372727.8382461, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.101378917694', 'lastCheck': 1295372727.970278, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.120700120926', 'lastCheck': 1295372727.9705441, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0906569957733', 'lastCheck': 1295372727.9715309, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.100737810135', 'lastCheck': 1295372727.9710529, 'valid': True, 'code': 0}} Thread-18621::DEBUG::2011-01-18 19:45:28,428::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: moving from state preparing -> state finished Thread-18621::DEBUG::2011-01-18 19:45:28,429::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18621::DEBUG::2011-01-18 19:45:28,429::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138 releasing Thread-18621::DEBUG::2011-01-18 19:45:28,429::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18621::DEBUG::2011-01-18 19:45:28,429::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18621::DEBUG::2011-01-18 19:45:28,430::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18621::DEBUG::2011-01-18 19:45:28,430::resource::503::irs::Owner b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18621::DEBUG::2011-01-18 19:45:28,430::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18621::DEBUG::2011-01-18 19:45:28,430::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18621::DEBUG::2011-01-18 19:45:28,431::task::577::irs::Task b3d09f9f-9ce7-494f-b6c0-7b9b8b7a3138: ref 0 aborting False Thread-18621::INFO::2011-01-18 19:45:28,431::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.044399023056', 'lastCheck': 1295372727.8382461, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.120700120926', 'lastCheck': 1295372727.9705441, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.100737810135', 'lastCheck': 1295372727.9710529, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0906569957733', 'lastCheck': 1295372727.9715309, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.101378917694', 'lastCheck': 1295372727.970278, 'valid': True, 'code': 0}} Thread-18623::INFO::2011-01-18 19:45:28,881::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18623::DEBUG::2011-01-18 19:45:28,882::task::577::irs::Task 9aa17d80-83b0-42c1-bfe5-999e48955cf0: moving from state init -> state preparing Thread-18623::DEBUG::2011-01-18 19:45:28,882::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18623::DEBUG::2011-01-18 19:45:28,914::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0004 seconds, 5.1 MB/s\n'; = 0 Thread-18623::DEBUG::2011-01-18 19:45:28,914::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0004 seconds, 5.1 MB/s'], size: 2048 Thread-18623::DEBUG::2011-01-18 19:45:28,915::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18623::DEBUG::2011-01-18 19:45:28,915::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18623::DEBUG::2011-01-18 19:45:28,916::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18623::DEBUG::2011-01-18 19:45:28,916::task::577::irs::Task 9aa17d80-83b0-42c1-bfe5-999e48955cf0: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18623::DEBUG::2011-01-18 19:45:28,916::task::577::irs::Task 9aa17d80-83b0-42c1-bfe5-999e48955cf0: moving from state preparing -> state finished Thread-18623::DEBUG::2011-01-18 19:45:28,917::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18623::DEBUG::2011-01-18 19:45:28,917::task::577::irs::Task 9aa17d80-83b0-42c1-bfe5-999e48955cf0: ref 0 aborting False Thread-18623::INFO::2011-01-18 19:45:28,917::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18624::INFO::2011-01-18 19:45:28,925::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18624::DEBUG::2011-01-18 19:45:28,925::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: moving from state init -> state preparing Thread-18624::DEBUG::2011-01-18 19:45:28,926::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 66a192dc-5705-4bb8-8d73-2c244ef2b8fb acquire shared (120000) Thread-18624::DEBUG::2011-01-18 19:45:28,926::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18624::DEBUG::2011-01-18 19:45:28,926::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '66a192dc-5705-4bb8-8d73-2c244ef2b8fb' Thread-18624::DEBUG::2011-01-18 19:45:28,926::resource::524::irs::Owner 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18624::DEBUG::2011-01-18 19:45:28,927::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18624::DEBUG::2011-01-18 19:45:28,927::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: ref 1 aborting False Thread-18624::INFO::2011-01-18 19:45:28,928::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18624::DEBUG::2011-01-18 19:45:28,928::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18624::DEBUG::2011-01-18 19:45:28,929::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: moving from state preparing -> state finished Thread-18624::DEBUG::2011-01-18 19:45:28,929::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18624::DEBUG::2011-01-18 19:45:28,929::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 66a192dc-5705-4bb8-8d73-2c244ef2b8fb releasing Thread-18624::DEBUG::2011-01-18 19:45:28,930::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18624::DEBUG::2011-01-18 19:45:28,930::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18624::DEBUG::2011-01-18 19:45:28,930::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18624::DEBUG::2011-01-18 19:45:28,930::resource::503::irs::Owner 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18624::DEBUG::2011-01-18 19:45:28,931::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18624::DEBUG::2011-01-18 19:45:28,931::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18624::DEBUG::2011-01-18 19:45:28,931::task::577::irs::Task 66a192dc-5705-4bb8-8d73-2c244ef2b8fb: ref 0 aborting False Thread-18624::INFO::2011-01-18 19:45:28,932::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:45:29,405::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:29,940::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503215 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:31,954::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:32,487::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50176 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:34,501::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:35,039::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506883 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:37,053::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:37,597::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512726 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:45:37,837::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:45:37,838::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:45:37,878::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:45:37,969::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 19:45:37,970::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 19:45:37,970::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:45:37,971::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::INFO::2011-01-18 19:45:37,971::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::DEBUG::2011-01-18 19:45:37,971::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 19:45:37,975::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:45:37,976::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:45:38,014::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:45:38,015::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:45:38,020::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:45:38,024::misc::122::irs::SUCCESS: = ''; = 0 Thread-18629::INFO::2011-01-18 19:45:38,595::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18629::DEBUG::2011-01-18 19:45:38,596::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: moving from state init -> state preparing Thread-18629::DEBUG::2011-01-18 19:45:38,596::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c7cd8752-23c7-4086-8303-741ce80d0b7c acquire shared (120000) Thread-18629::DEBUG::2011-01-18 19:45:38,596::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18629::DEBUG::2011-01-18 19:45:38,596::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c7cd8752-23c7-4086-8303-741ce80d0b7c' Thread-18629::DEBUG::2011-01-18 19:45:38,597::resource::524::irs::Owner c7cd8752-23c7-4086-8303-741ce80d0b7c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18629::DEBUG::2011-01-18 19:45:38,597::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18629::DEBUG::2011-01-18 19:45:38,597::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: ref 1 aborting False Thread-18629::DEBUG::2011-01-18 19:45:38,598::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0442328453064', 'lastCheck': 1295372737.8820839, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0557570457458', 'lastCheck': 1295372738.0258701, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0492930412292', 'lastCheck': 1295372738.0191481, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0502641201019', 'lastCheck': 1295372738.02127, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0574789047241', 'lastCheck': 1295372738.028646, 'valid': True, 'code': 0}} Thread-18629::DEBUG::2011-01-18 19:45:38,598::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: moving from state preparing -> state finished Thread-18629::DEBUG::2011-01-18 19:45:38,598::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18629::DEBUG::2011-01-18 19:45:38,599::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c7cd8752-23c7-4086-8303-741ce80d0b7c releasing Thread-18629::DEBUG::2011-01-18 19:45:38,599::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18629::DEBUG::2011-01-18 19:45:38,599::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18629::DEBUG::2011-01-18 19:45:38,599::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18629::DEBUG::2011-01-18 19:45:38,600::resource::503::irs::Owner c7cd8752-23c7-4086-8303-741ce80d0b7c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18629::DEBUG::2011-01-18 19:45:38,600::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18629::DEBUG::2011-01-18 19:45:38,600::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18629::DEBUG::2011-01-18 19:45:38,600::task::577::irs::Task c7cd8752-23c7-4086-8303-741ce80d0b7c: ref 0 aborting False Thread-18629::INFO::2011-01-18 19:45:38,601::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0442328453064', 'lastCheck': 1295372737.8820839, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0492930412292', 'lastCheck': 1295372738.0191481, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0574789047241', 'lastCheck': 1295372738.028646, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0502641201019', 'lastCheck': 1295372738.02127, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0557570457458', 'lastCheck': 1295372738.0258701, 'valid': True, 'code': 0}} Thread-18631::INFO::2011-01-18 19:45:38,986::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18631::DEBUG::2011-01-18 19:45:38,986::task::577::irs::Task 0dea74e2-52fc-48d0-ad83-1c64a00ffe3e: moving from state init -> state preparing Thread-18631::DEBUG::2011-01-18 19:45:38,987::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18631::DEBUG::2011-01-18 19:45:39,019::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000914 seconds, 2.2 MB/s\n'; = 0 Thread-18631::DEBUG::2011-01-18 19:45:39,020::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000914 seconds, 2.2 MB/s'], size: 2048 Thread-18631::DEBUG::2011-01-18 19:45:39,020::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18631::DEBUG::2011-01-18 19:45:39,020::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18631::DEBUG::2011-01-18 19:45:39,021::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18631::DEBUG::2011-01-18 19:45:39,021::task::577::irs::Task 0dea74e2-52fc-48d0-ad83-1c64a00ffe3e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18631::DEBUG::2011-01-18 19:45:39,022::task::577::irs::Task 0dea74e2-52fc-48d0-ad83-1c64a00ffe3e: moving from state preparing -> state finished Thread-18631::DEBUG::2011-01-18 19:45:39,022::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18631::DEBUG::2011-01-18 19:45:39,022::task::577::irs::Task 0dea74e2-52fc-48d0-ad83-1c64a00ffe3e: ref 0 aborting False Thread-18631::INFO::2011-01-18 19:45:39,023::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18632::INFO::2011-01-18 19:45:39,031::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18632::DEBUG::2011-01-18 19:45:39,031::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: moving from state init -> state preparing Thread-18632::DEBUG::2011-01-18 19:45:39,032::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d13acca1-1300-4760-8adb-0b7898a266bd acquire shared (120000) Thread-18632::DEBUG::2011-01-18 19:45:39,032::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18632::DEBUG::2011-01-18 19:45:39,032::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd13acca1-1300-4760-8adb-0b7898a266bd' Thread-18632::DEBUG::2011-01-18 19:45:39,032::resource::524::irs::Owner d13acca1-1300-4760-8adb-0b7898a266bd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18632::DEBUG::2011-01-18 19:45:39,033::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18632::DEBUG::2011-01-18 19:45:39,033::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: ref 1 aborting False Thread-18632::INFO::2011-01-18 19:45:39,033::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18632::DEBUG::2011-01-18 19:45:39,034::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18632::DEBUG::2011-01-18 19:45:39,035::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: moving from state preparing -> state finished Thread-18632::DEBUG::2011-01-18 19:45:39,035::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18632::DEBUG::2011-01-18 19:45:39,035::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d13acca1-1300-4760-8adb-0b7898a266bd releasing Thread-18632::DEBUG::2011-01-18 19:45:39,035::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18632::DEBUG::2011-01-18 19:45:39,036::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18632::DEBUG::2011-01-18 19:45:39,036::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18632::DEBUG::2011-01-18 19:45:39,036::resource::503::irs::Owner d13acca1-1300-4760-8adb-0b7898a266bd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18632::DEBUG::2011-01-18 19:45:39,036::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18632::DEBUG::2011-01-18 19:45:39,037::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18632::DEBUG::2011-01-18 19:45:39,037::task::577::irs::Task d13acca1-1300-4760-8adb-0b7898a266bd: ref 0 aborting False Thread-18632::INFO::2011-01-18 19:45:39,037::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:45:39,612::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:40,147::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503954 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:42,159::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:42,694::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501895 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:44,708::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:45,245::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503916 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:47,258::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:47,799::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509421 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:45:47,881::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:45:47,882::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:45:47,922::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:45:48,018::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:45:48,019::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:45:48,021::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:45:48,022::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:45:48,026::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:45:48,027::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:45:48,030::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:45:48,032::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:45:48,060::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:45:48,062::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:45:48,070::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:45:48,071::misc::122::irs::SUCCESS: = ''; = 0 Thread-18637::INFO::2011-01-18 19:45:48,772::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18637::DEBUG::2011-01-18 19:45:48,772::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: moving from state init -> state preparing Thread-18637::DEBUG::2011-01-18 19:45:48,772::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c acquire shared (120000) Thread-18637::DEBUG::2011-01-18 19:45:48,773::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18637::DEBUG::2011-01-18 19:45:48,773::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c' Thread-18637::DEBUG::2011-01-18 19:45:48,773::resource::524::irs::Owner dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18637::DEBUG::2011-01-18 19:45:48,774::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18637::DEBUG::2011-01-18 19:45:48,774::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: ref 1 aborting False Thread-18637::DEBUG::2011-01-18 19:45:48,774::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452551841736', 'lastCheck': 1295372747.9271071, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0483899116516', 'lastCheck': 1295372748.074286, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0488078594208', 'lastCheck': 1295372748.0676529, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463180541992', 'lastCheck': 1295372748.067476, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462718009949', 'lastCheck': 1295372748.0763049, 'valid': True, 'code': 0}} Thread-18637::DEBUG::2011-01-18 19:45:48,775::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: moving from state preparing -> state finished Thread-18637::DEBUG::2011-01-18 19:45:48,775::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18637::DEBUG::2011-01-18 19:45:48,775::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c releasing Thread-18637::DEBUG::2011-01-18 19:45:48,775::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18637::DEBUG::2011-01-18 19:45:48,776::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18637::DEBUG::2011-01-18 19:45:48,776::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18637::DEBUG::2011-01-18 19:45:48,776::resource::503::irs::Owner dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18637::DEBUG::2011-01-18 19:45:48,777::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18637::DEBUG::2011-01-18 19:45:48,777::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18637::DEBUG::2011-01-18 19:45:48,777::task::577::irs::Task dfc67371-71f6-4ce7-a11a-2dbcd0fa8f0c: ref 0 aborting False Thread-18637::INFO::2011-01-18 19:45:48,778::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452551841736', 'lastCheck': 1295372747.9271071, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0488078594208', 'lastCheck': 1295372748.0676529, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462718009949', 'lastCheck': 1295372748.0763049, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463180541992', 'lastCheck': 1295372748.067476, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0483899116516', 'lastCheck': 1295372748.074286, 'valid': True, 'code': 0}} Thread-18639::INFO::2011-01-18 19:45:49,089::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18639::DEBUG::2011-01-18 19:45:49,090::task::577::irs::Task 1759edfd-b84a-4dd6-b51e-3ab691ea8639: moving from state init -> state preparing Thread-18639::DEBUG::2011-01-18 19:45:49,090::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18639::DEBUG::2011-01-18 19:45:49,122::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000892 seconds, 2.3 MB/s\n'; = 0 Thread-18639::DEBUG::2011-01-18 19:45:49,123::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000892 seconds, 2.3 MB/s'], size: 2048 Thread-18639::DEBUG::2011-01-18 19:45:49,123::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18639::DEBUG::2011-01-18 19:45:49,124::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18639::DEBUG::2011-01-18 19:45:49,124::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18639::DEBUG::2011-01-18 19:45:49,125::task::577::irs::Task 1759edfd-b84a-4dd6-b51e-3ab691ea8639: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18639::DEBUG::2011-01-18 19:45:49,125::task::577::irs::Task 1759edfd-b84a-4dd6-b51e-3ab691ea8639: moving from state preparing -> state finished Thread-18639::DEBUG::2011-01-18 19:45:49,125::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18639::DEBUG::2011-01-18 19:45:49,126::task::577::irs::Task 1759edfd-b84a-4dd6-b51e-3ab691ea8639: ref 0 aborting False Thread-18639::INFO::2011-01-18 19:45:49,126::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18640::INFO::2011-01-18 19:45:49,134::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18640::DEBUG::2011-01-18 19:45:49,135::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: moving from state init -> state preparing Thread-18640::DEBUG::2011-01-18 19:45:49,135::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5cf42e98-5f44-4f44-a275-2d460fcfe3a3 acquire shared (120000) Thread-18640::DEBUG::2011-01-18 19:45:49,136::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18640::DEBUG::2011-01-18 19:45:49,136::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5cf42e98-5f44-4f44-a275-2d460fcfe3a3' Thread-18640::DEBUG::2011-01-18 19:45:49,136::resource::524::irs::Owner 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18640::DEBUG::2011-01-18 19:45:49,136::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18640::DEBUG::2011-01-18 19:45:49,137::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: ref 1 aborting False Thread-18640::INFO::2011-01-18 19:45:49,137::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18640::DEBUG::2011-01-18 19:45:49,138::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18640::DEBUG::2011-01-18 19:45:49,138::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: moving from state preparing -> state finished Thread-18640::DEBUG::2011-01-18 19:45:49,138::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18640::DEBUG::2011-01-18 19:45:49,139::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5cf42e98-5f44-4f44-a275-2d460fcfe3a3 releasing Thread-18640::DEBUG::2011-01-18 19:45:49,139::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18640::DEBUG::2011-01-18 19:45:49,139::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18640::DEBUG::2011-01-18 19:45:49,140::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18640::DEBUG::2011-01-18 19:45:49,140::resource::503::irs::Owner 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18640::DEBUG::2011-01-18 19:45:49,140::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18640::DEBUG::2011-01-18 19:45:49,140::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18640::DEBUG::2011-01-18 19:45:49,141::task::577::irs::Task 5cf42e98-5f44-4f44-a275-2d460fcfe3a3: ref 0 aborting False Thread-18640::INFO::2011-01-18 19:45:49,141::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:45:49,814::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:50,348::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502546 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:52,362::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:52,896::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501113 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:54,910::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:45:55,444::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502127 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:57,458::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:45:57,927::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:45:57,928::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:45:57,975::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:45:58,011::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.520507 seconds, 2.0 MB/s\n'; = 0 Thread-18496::INFO::2011-01-18 19:45:58,066::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18495::INFO::2011-01-18 19:45:58,067::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18496::DEBUG::2011-01-18 19:45:58,067::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:45:58,068::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:45:58,074::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:45:58,075::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:45:58,078::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:45:58,079::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 19:45:58,109::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:45:58,111::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:45:58,120::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:45:58,120::misc::122::irs::SUCCESS: = ''; = 0 Thread-18645::INFO::2011-01-18 19:45:58,939::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18645::DEBUG::2011-01-18 19:45:58,939::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: moving from state init -> state preparing Thread-18645::DEBUG::2011-01-18 19:45:58,940::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe acquire shared (120000) Thread-18645::DEBUG::2011-01-18 19:45:58,940::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18645::DEBUG::2011-01-18 19:45:58,940::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4a97ed0c-cc85-4114-9a9e-ea4d31f997fe' Thread-18645::DEBUG::2011-01-18 19:45:58,940::resource::524::irs::Owner 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18645::DEBUG::2011-01-18 19:45:58,941::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18645::DEBUG::2011-01-18 19:45:58,941::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: ref 1 aborting False Thread-18645::DEBUG::2011-01-18 19:45:58,941::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.053915977478', 'lastCheck': 1295372757.980794, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0505528450012', 'lastCheck': 1295372758.1244509, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0510470867157', 'lastCheck': 1295372758.11814, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0474679470062', 'lastCheck': 1295372758.114321, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0466661453247', 'lastCheck': 1295372758.1248901, 'valid': True, 'code': 0}} Thread-18645::DEBUG::2011-01-18 19:45:58,942::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: moving from state preparing -> state finished Thread-18645::DEBUG::2011-01-18 19:45:58,942::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18645::DEBUG::2011-01-18 19:45:58,942::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe releasing Thread-18645::DEBUG::2011-01-18 19:45:58,943::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18645::DEBUG::2011-01-18 19:45:58,943::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18645::DEBUG::2011-01-18 19:45:58,943::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18645::DEBUG::2011-01-18 19:45:58,943::resource::503::irs::Owner 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18645::DEBUG::2011-01-18 19:45:58,944::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18645::DEBUG::2011-01-18 19:45:58,944::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18645::DEBUG::2011-01-18 19:45:58,944::task::577::irs::Task 4a97ed0c-cc85-4114-9a9e-ea4d31f997fe: ref 0 aborting False Thread-18645::INFO::2011-01-18 19:45:58,945::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.053915977478', 'lastCheck': 1295372757.980794, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0510470867157', 'lastCheck': 1295372758.11814, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0466661453247', 'lastCheck': 1295372758.1248901, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0474679470062', 'lastCheck': 1295372758.114321, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0505528450012', 'lastCheck': 1295372758.1244509, 'valid': True, 'code': 0}} Thread-18647::INFO::2011-01-18 19:45:59,194::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18647::DEBUG::2011-01-18 19:45:59,195::task::577::irs::Task e3ed4ccc-9593-41ba-9a80-ad7378d2091e: moving from state init -> state preparing Thread-18647::DEBUG::2011-01-18 19:45:59,195::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18647::DEBUG::2011-01-18 19:45:59,227::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000415 seconds, 4.9 MB/s\n'; = 0 Thread-18647::DEBUG::2011-01-18 19:45:59,227::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000415 seconds, 4.9 MB/s'], size: 2048 Thread-18647::DEBUG::2011-01-18 19:45:59,228::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18647::DEBUG::2011-01-18 19:45:59,228::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18647::DEBUG::2011-01-18 19:45:59,229::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18647::DEBUG::2011-01-18 19:45:59,229::task::577::irs::Task e3ed4ccc-9593-41ba-9a80-ad7378d2091e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18647::DEBUG::2011-01-18 19:45:59,229::task::577::irs::Task e3ed4ccc-9593-41ba-9a80-ad7378d2091e: moving from state preparing -> state finished Thread-18647::DEBUG::2011-01-18 19:45:59,230::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18647::DEBUG::2011-01-18 19:45:59,230::task::577::irs::Task e3ed4ccc-9593-41ba-9a80-ad7378d2091e: ref 0 aborting False Thread-18647::INFO::2011-01-18 19:45:59,230::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18648::INFO::2011-01-18 19:45:59,238::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18648::DEBUG::2011-01-18 19:45:59,239::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: moving from state init -> state preparing Thread-18648::DEBUG::2011-01-18 19:45:59,239::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae acquire shared (120000) Thread-18648::DEBUG::2011-01-18 19:45:59,239::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18648::DEBUG::2011-01-18 19:45:59,240::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae' Thread-18648::DEBUG::2011-01-18 19:45:59,240::resource::524::irs::Owner 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18648::DEBUG::2011-01-18 19:45:59,240::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18648::DEBUG::2011-01-18 19:45:59,241::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: ref 1 aborting False Thread-18648::INFO::2011-01-18 19:45:59,241::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18648::DEBUG::2011-01-18 19:45:59,242::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18648::DEBUG::2011-01-18 19:45:59,242::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: moving from state preparing -> state finished Thread-18648::DEBUG::2011-01-18 19:45:59,242::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18648::DEBUG::2011-01-18 19:45:59,243::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae releasing Thread-18648::DEBUG::2011-01-18 19:45:59,243::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18648::DEBUG::2011-01-18 19:45:59,243::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18648::DEBUG::2011-01-18 19:45:59,243::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18648::DEBUG::2011-01-18 19:45:59,244::resource::503::irs::Owner 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18648::DEBUG::2011-01-18 19:45:59,244::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18648::DEBUG::2011-01-18 19:45:59,244::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18648::DEBUG::2011-01-18 19:45:59,245::task::577::irs::Task 64ca2ace-9a4c-4618-9fd3-e4b9ba8032ae: ref 0 aborting False Thread-18648::INFO::2011-01-18 19:45:59,245::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:46:00,027::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:00,561::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502529 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:02,576::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:03,138::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.530192 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:05,151::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:05,686::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504029 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:07,700::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:46:07,981::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:46:07,982::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:08,027::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:46:08,028::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata count=1' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:08,062::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000455 seconds, 4.5 MB/s\n'; = 0 Thread-18493::DEBUG::2011-01-18 19:46:08,063::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000455 seconds, 4.5 MB/s'], size: 2048 Thread-18493::DEBUG::2011-01-18 19:46:08,063::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_3', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE18,uuid:Qgf46A-WY12-2WRV-PrRt-wlBf-dG5l-Y0CiR2,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE19,uuid:I9Af7U-Xs1p-25wD-eipC-Fidg-XxVv-g51Ql4,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE16,uuid:Nvl4M2-De3J-JsKJ-JkBe-GZ6s-AjKD-lcInZA,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE17,uuid:bLZC8w-2nd6-mSQL-l7bf-qTMV-V0zG-2AjV5E,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE23,uuid:6a4K6m-i3eH-fMq3-o87l-7Vrd-u85A-gukoFD,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE22,uuid:Bq8FkT-8D7Z-QeDV-eZzx-RGR3-UzBm-xdyAgL,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE21,uuid:Vnwbgp-85vv-DFdc-LxUu-kPBu-pkQ3-jsIHqv,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE20,uuid:WqzA8s-xBVm-fjUO-1mxU-s8GQ-BTji-sWHK8S,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=u7udFg-03KL-F8eg-BQhY-TAJA-bV0h-ylO1p8', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=8fd1c0112168759eac1d4afe75228b2ee79efc2f'] Thread-18493::DEBUG::2011-01-18 19:46:08,064::metadata::89::irs::metadata.__validate() __cksum(md) = 8fd1c0112168759eac1d4afe75228b2ee79efc2f Thread-18496::INFO::2011-01-18 19:46:08,113::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:46:08,114::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:46:08,118::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:46:08,119::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:46:08,124::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18497::INFO::2011-01-18 19:46:08,125::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::DEBUG::2011-01-18 19:46:08,126::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:46:08,127::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:46:08,162::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:46:08,163::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:46:08,172::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:46:08,172::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:08,271::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.538594 seconds, 1.9 MB/s\n'; = 0 Thread-18653::INFO::2011-01-18 19:46:09,102::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18653::DEBUG::2011-01-18 19:46:09,102::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: moving from state init -> state preparing Thread-18653::DEBUG::2011-01-18 19:46:09,103::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 978f4efb-16b4-4a6c-8c06-c64c729718d1 acquire shared (120000) Thread-18653::DEBUG::2011-01-18 19:46:09,103::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18653::DEBUG::2011-01-18 19:46:09,103::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '978f4efb-16b4-4a6c-8c06-c64c729718d1' Thread-18653::DEBUG::2011-01-18 19:46:09,104::resource::524::irs::Owner 978f4efb-16b4-4a6c-8c06-c64c729718d1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18653::DEBUG::2011-01-18 19:46:09,104::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18653::DEBUG::2011-01-18 19:46:09,104::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: ref 1 aborting False Thread-18653::DEBUG::2011-01-18 19:46:09,104::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0874190330505', 'lastCheck': 1295372768.068275, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0526669025421', 'lastCheck': 1295372768.1765909, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0503070354462', 'lastCheck': 1295372768.1682141, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.055319070816', 'lastCheck': 1295372768.1691711, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0501511096954', 'lastCheck': 1295372768.175081, 'valid': True, 'code': 0}} Thread-18653::DEBUG::2011-01-18 19:46:09,105::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: moving from state preparing -> state finished Thread-18653::DEBUG::2011-01-18 19:46:09,105::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18653::DEBUG::2011-01-18 19:46:09,105::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 978f4efb-16b4-4a6c-8c06-c64c729718d1 releasing Thread-18653::DEBUG::2011-01-18 19:46:09,106::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18653::DEBUG::2011-01-18 19:46:09,106::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18653::DEBUG::2011-01-18 19:46:09,106::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18653::DEBUG::2011-01-18 19:46:09,107::resource::503::irs::Owner 978f4efb-16b4-4a6c-8c06-c64c729718d1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18653::DEBUG::2011-01-18 19:46:09,107::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18653::DEBUG::2011-01-18 19:46:09,107::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18653::DEBUG::2011-01-18 19:46:09,107::task::577::irs::Task 978f4efb-16b4-4a6c-8c06-c64c729718d1: ref 0 aborting False Thread-18653::INFO::2011-01-18 19:46:09,108::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0874190330505', 'lastCheck': 1295372768.068275, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0503070354462', 'lastCheck': 1295372768.1682141, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0501511096954', 'lastCheck': 1295372768.175081, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.055319070816', 'lastCheck': 1295372768.1691711, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0526669025421', 'lastCheck': 1295372768.1765909, 'valid': True, 'code': 0}} Thread-18655::INFO::2011-01-18 19:46:09,299::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18655::DEBUG::2011-01-18 19:46:09,300::task::577::irs::Task c7256814-6df5-4aaf-879f-10d7c3eb7496: moving from state init -> state preparing Thread-18655::DEBUG::2011-01-18 19:46:09,300::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18655::DEBUG::2011-01-18 19:46:09,332::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000448 seconds, 4.6 MB/s\n'; = 0 Thread-18655::DEBUG::2011-01-18 19:46:09,332::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000448 seconds, 4.6 MB/s'], size: 2048 Thread-18655::DEBUG::2011-01-18 19:46:09,333::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18655::DEBUG::2011-01-18 19:46:09,333::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18655::DEBUG::2011-01-18 19:46:09,334::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18655::DEBUG::2011-01-18 19:46:09,334::task::577::irs::Task c7256814-6df5-4aaf-879f-10d7c3eb7496: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18655::DEBUG::2011-01-18 19:46:09,335::task::577::irs::Task c7256814-6df5-4aaf-879f-10d7c3eb7496: moving from state preparing -> state finished Thread-18655::DEBUG::2011-01-18 19:46:09,335::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18655::DEBUG::2011-01-18 19:46:09,335::task::577::irs::Task c7256814-6df5-4aaf-879f-10d7c3eb7496: ref 0 aborting False Thread-18655::INFO::2011-01-18 19:46:09,335::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18656::INFO::2011-01-18 19:46:09,343::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18656::DEBUG::2011-01-18 19:46:09,344::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: moving from state init -> state preparing Thread-18656::DEBUG::2011-01-18 19:46:09,344::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01 acquire shared (120000) Thread-18656::DEBUG::2011-01-18 19:46:09,344::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18656::DEBUG::2011-01-18 19:46:09,345::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01' Thread-18656::DEBUG::2011-01-18 19:46:09,345::resource::524::irs::Owner 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18656::DEBUG::2011-01-18 19:46:09,345::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18656::DEBUG::2011-01-18 19:46:09,346::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: ref 1 aborting False Thread-18656::INFO::2011-01-18 19:46:09,346::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18656::DEBUG::2011-01-18 19:46:09,347::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18656::DEBUG::2011-01-18 19:46:09,347::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: moving from state preparing -> state finished Thread-18656::DEBUG::2011-01-18 19:46:09,348::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18656::DEBUG::2011-01-18 19:46:09,348::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01 releasing Thread-18656::DEBUG::2011-01-18 19:46:09,348::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18656::DEBUG::2011-01-18 19:46:09,349::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18656::DEBUG::2011-01-18 19:46:09,349::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18656::DEBUG::2011-01-18 19:46:09,349::resource::503::irs::Owner 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18656::DEBUG::2011-01-18 19:46:09,349::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18656::DEBUG::2011-01-18 19:46:09,350::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18656::DEBUG::2011-01-18 19:46:09,350::task::577::irs::Task 33cb6c8f-2a92-49bb-9fea-cd9fb63a1c01: ref 0 aborting False Thread-18656::INFO::2011-01-18 19:46:09,350::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:46:10,296::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:10,829::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500659 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:12,842::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:13,382::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507744 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:15,394::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:15,926::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500419 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:17,940::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:46:18,068::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:46:18,069::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:18,111::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:46:18,167::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:46:18,168::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:46:18,168::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:46:18,172::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:46:18,175::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::INFO::2011-01-18 19:46:18,176::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18497::DEBUG::2011-01-18 19:46:18,177::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:46:18,178::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:46:18,213::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:46:18,217::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:46:18,220::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:46:18,227::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:18,507::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.535757 seconds, 1.9 MB/s\n'; = 0 Thread-18661::INFO::2011-01-18 19:46:19,273::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18661::DEBUG::2011-01-18 19:46:19,273::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: moving from state init -> state preparing Thread-18661::DEBUG::2011-01-18 19:46:19,273::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b9f42df5-4fd1-4d70-8f79-2ff091d020f3 acquire shared (120000) Thread-18661::DEBUG::2011-01-18 19:46:19,274::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18661::DEBUG::2011-01-18 19:46:19,274::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b9f42df5-4fd1-4d70-8f79-2ff091d020f3' Thread-18661::DEBUG::2011-01-18 19:46:19,274::resource::524::irs::Owner b9f42df5-4fd1-4d70-8f79-2ff091d020f3: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18661::DEBUG::2011-01-18 19:46:19,275::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18661::DEBUG::2011-01-18 19:46:19,275::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: ref 1 aborting False Thread-18661::DEBUG::2011-01-18 19:46:19,275::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0481469631195', 'lastCheck': 1295372778.1160059, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0557069778442', 'lastCheck': 1295372778.231956, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.053582906723', 'lastCheck': 1295372778.2214389, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0539879798889', 'lastCheck': 1295372778.222872, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0492329597473', 'lastCheck': 1295372778.2243381, 'valid': True, 'code': 0}} Thread-18661::DEBUG::2011-01-18 19:46:19,276::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: moving from state preparing -> state finished Thread-18661::DEBUG::2011-01-18 19:46:19,276::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18661::DEBUG::2011-01-18 19:46:19,276::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b9f42df5-4fd1-4d70-8f79-2ff091d020f3 releasing Thread-18661::DEBUG::2011-01-18 19:46:19,277::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18661::DEBUG::2011-01-18 19:46:19,277::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18661::DEBUG::2011-01-18 19:46:19,277::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18661::DEBUG::2011-01-18 19:46:19,278::resource::503::irs::Owner b9f42df5-4fd1-4d70-8f79-2ff091d020f3: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18661::DEBUG::2011-01-18 19:46:19,278::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18661::DEBUG::2011-01-18 19:46:19,278::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18661::DEBUG::2011-01-18 19:46:19,278::task::577::irs::Task b9f42df5-4fd1-4d70-8f79-2ff091d020f3: ref 0 aborting False Thread-18661::INFO::2011-01-18 19:46:19,279::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0481469631195', 'lastCheck': 1295372778.1160059, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.053582906723', 'lastCheck': 1295372778.2214389, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0492329597473', 'lastCheck': 1295372778.2243381, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0539879798889', 'lastCheck': 1295372778.222872, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0557069778442', 'lastCheck': 1295372778.231956, 'valid': True, 'code': 0}} Thread-18663::INFO::2011-01-18 19:46:19,403::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18663::DEBUG::2011-01-18 19:46:19,403::task::577::irs::Task 6714ba20-a06a-4d82-9b81-fdd4e7765df0: moving from state init -> state preparing Thread-18663::DEBUG::2011-01-18 19:46:19,404::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18663::DEBUG::2011-01-18 19:46:19,436::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000416 seconds, 4.9 MB/s\n'; = 0 Thread-18663::DEBUG::2011-01-18 19:46:19,437::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000416 seconds, 4.9 MB/s'], size: 2048 Thread-18663::DEBUG::2011-01-18 19:46:19,437::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18663::DEBUG::2011-01-18 19:46:19,437::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18663::DEBUG::2011-01-18 19:46:19,438::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18663::DEBUG::2011-01-18 19:46:19,438::task::577::irs::Task 6714ba20-a06a-4d82-9b81-fdd4e7765df0: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18663::DEBUG::2011-01-18 19:46:19,439::task::577::irs::Task 6714ba20-a06a-4d82-9b81-fdd4e7765df0: moving from state preparing -> state finished Thread-18663::DEBUG::2011-01-18 19:46:19,439::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18663::DEBUG::2011-01-18 19:46:19,440::task::577::irs::Task 6714ba20-a06a-4d82-9b81-fdd4e7765df0: ref 0 aborting False Thread-18663::INFO::2011-01-18 19:46:19,440::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18664::INFO::2011-01-18 19:46:19,448::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18664::DEBUG::2011-01-18 19:46:19,448::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: moving from state init -> state preparing Thread-18664::DEBUG::2011-01-18 19:46:19,448::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6cb44bb3-3098-41c8-84ab-bfa085f35407 acquire shared (120000) Thread-18664::DEBUG::2011-01-18 19:46:19,449::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18664::DEBUG::2011-01-18 19:46:19,449::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6cb44bb3-3098-41c8-84ab-bfa085f35407' Thread-18664::DEBUG::2011-01-18 19:46:19,449::resource::524::irs::Owner 6cb44bb3-3098-41c8-84ab-bfa085f35407: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18664::DEBUG::2011-01-18 19:46:19,449::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18664::DEBUG::2011-01-18 19:46:19,450::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: ref 1 aborting False Thread-18664::INFO::2011-01-18 19:46:19,450::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18664::DEBUG::2011-01-18 19:46:19,451::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18664::DEBUG::2011-01-18 19:46:19,451::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: moving from state preparing -> state finished Thread-18664::DEBUG::2011-01-18 19:46:19,452::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18664::DEBUG::2011-01-18 19:46:19,452::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6cb44bb3-3098-41c8-84ab-bfa085f35407 releasing Thread-18664::DEBUG::2011-01-18 19:46:19,452::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18664::DEBUG::2011-01-18 19:46:19,452::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18664::DEBUG::2011-01-18 19:46:19,453::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18664::DEBUG::2011-01-18 19:46:19,453::resource::503::irs::Owner 6cb44bb3-3098-41c8-84ab-bfa085f35407: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18664::DEBUG::2011-01-18 19:46:19,453::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18664::DEBUG::2011-01-18 19:46:19,454::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18664::DEBUG::2011-01-18 19:46:19,454::task::577::irs::Task 6cb44bb3-3098-41c8-84ab-bfa085f35407: ref 0 aborting False Thread-18664::INFO::2011-01-18 19:46:19,454::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:46:20,522::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:21,054::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500659 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:23,069::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:23,604::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503299 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:25,616::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:26,150::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501399 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:46:28,115::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:46:28,116::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:28,156::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:28,163::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::INFO::2011-01-18 19:46:28,221::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:46:28,221::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:46:28,224::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::INFO::2011-01-18 19:46:28,225::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 19:46:28,226::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 19:46:28,227::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:46:28,232::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:46:28,233::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:46:28,265::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:46:28,269::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:46:28,271::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:46:28,277::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:28,724::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.529013 seconds, 1.9 MB/s\n'; = 0 Thread-18669::INFO::2011-01-18 19:46:29,445::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18669::DEBUG::2011-01-18 19:46:29,445::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: moving from state init -> state preparing Thread-18669::DEBUG::2011-01-18 19:46:29,446::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4ce869d2-b643-4bb0-b096-80efb6e515c3 acquire shared (120000) Thread-18669::DEBUG::2011-01-18 19:46:29,446::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18669::DEBUG::2011-01-18 19:46:29,446::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4ce869d2-b643-4bb0-b096-80efb6e515c3' Thread-18669::DEBUG::2011-01-18 19:46:29,446::resource::524::irs::Owner 4ce869d2-b643-4bb0-b096-80efb6e515c3: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18669::DEBUG::2011-01-18 19:46:29,447::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18669::DEBUG::2011-01-18 19:46:29,447::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: ref 1 aborting False Thread-18669::DEBUG::2011-01-18 19:46:29,447::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0449690818787', 'lastCheck': 1295372788.160809, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0491390228271', 'lastCheck': 1295372788.28108, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0515270233154', 'lastCheck': 1295372788.2724061, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0501630306244', 'lastCheck': 1295372788.2753589, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0522382259369', 'lastCheck': 1295372788.2763431, 'valid': True, 'code': 0}} Thread-18669::DEBUG::2011-01-18 19:46:29,448::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: moving from state preparing -> state finished Thread-18669::DEBUG::2011-01-18 19:46:29,448::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18669::DEBUG::2011-01-18 19:46:29,448::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4ce869d2-b643-4bb0-b096-80efb6e515c3 releasing Thread-18669::DEBUG::2011-01-18 19:46:29,449::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18669::DEBUG::2011-01-18 19:46:29,449::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18669::DEBUG::2011-01-18 19:46:29,449::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18669::DEBUG::2011-01-18 19:46:29,449::resource::503::irs::Owner 4ce869d2-b643-4bb0-b096-80efb6e515c3: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18669::DEBUG::2011-01-18 19:46:29,450::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18669::DEBUG::2011-01-18 19:46:29,450::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18669::DEBUG::2011-01-18 19:46:29,450::task::577::irs::Task 4ce869d2-b643-4bb0-b096-80efb6e515c3: ref 0 aborting False Thread-18669::INFO::2011-01-18 19:46:29,451::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0449690818787', 'lastCheck': 1295372788.160809, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0515270233154', 'lastCheck': 1295372788.2724061, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0522382259369', 'lastCheck': 1295372788.2763431, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0501630306244', 'lastCheck': 1295372788.2753589, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0491390228271', 'lastCheck': 1295372788.28108, 'valid': True, 'code': 0}} Thread-18671::INFO::2011-01-18 19:46:29,506::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18671::DEBUG::2011-01-18 19:46:29,507::task::577::irs::Task 6c8565c9-8870-47f2-bb28-64b736865994: moving from state init -> state preparing Thread-18671::DEBUG::2011-01-18 19:46:29,507::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18671::DEBUG::2011-01-18 19:46:29,539::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000429 seconds, 4.8 MB/s\n'; = 0 Thread-18671::DEBUG::2011-01-18 19:46:29,540::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000429 seconds, 4.8 MB/s'], size: 2048 Thread-18671::DEBUG::2011-01-18 19:46:29,540::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18671::DEBUG::2011-01-18 19:46:29,540::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18671::DEBUG::2011-01-18 19:46:29,541::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18671::DEBUG::2011-01-18 19:46:29,541::task::577::irs::Task 6c8565c9-8870-47f2-bb28-64b736865994: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18671::DEBUG::2011-01-18 19:46:29,542::task::577::irs::Task 6c8565c9-8870-47f2-bb28-64b736865994: moving from state preparing -> state finished Thread-18671::DEBUG::2011-01-18 19:46:29,542::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18671::DEBUG::2011-01-18 19:46:29,542::task::577::irs::Task 6c8565c9-8870-47f2-bb28-64b736865994: ref 0 aborting False Thread-18671::INFO::2011-01-18 19:46:29,543::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18672::INFO::2011-01-18 19:46:29,551::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18672::DEBUG::2011-01-18 19:46:29,551::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: moving from state init -> state preparing Thread-18672::DEBUG::2011-01-18 19:46:29,552::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fddb19f0-7623-4181-a5f9-ec523619a474 acquire shared (120000) Thread-18672::DEBUG::2011-01-18 19:46:29,552::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18672::DEBUG::2011-01-18 19:46:29,552::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fddb19f0-7623-4181-a5f9-ec523619a474' Thread-18672::DEBUG::2011-01-18 19:46:29,553::resource::524::irs::Owner fddb19f0-7623-4181-a5f9-ec523619a474: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18672::DEBUG::2011-01-18 19:46:29,553::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18672::DEBUG::2011-01-18 19:46:29,553::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: ref 1 aborting False Thread-18672::INFO::2011-01-18 19:46:29,554::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18672::DEBUG::2011-01-18 19:46:29,554::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18672::DEBUG::2011-01-18 19:46:29,555::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: moving from state preparing -> state finished Thread-18672::DEBUG::2011-01-18 19:46:29,555::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18672::DEBUG::2011-01-18 19:46:29,555::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fddb19f0-7623-4181-a5f9-ec523619a474 releasing Thread-18672::DEBUG::2011-01-18 19:46:29,556::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18672::DEBUG::2011-01-18 19:46:29,556::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18672::DEBUG::2011-01-18 19:46:29,556::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18672::DEBUG::2011-01-18 19:46:29,556::resource::503::irs::Owner fddb19f0-7623-4181-a5f9-ec523619a474: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18672::DEBUG::2011-01-18 19:46:29,557::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18672::DEBUG::2011-01-18 19:46:29,557::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18672::DEBUG::2011-01-18 19:46:29,557::task::577::irs::Task fddb19f0-7623-4181-a5f9-ec523619a474: ref 0 aborting False Thread-18672::INFO::2011-01-18 19:46:29,558::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:46:30,738::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:31,271::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501289 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:33,285::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:33,832::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502133 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:35,845::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:36,378::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500737 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:46:38,160::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:46:38,161::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:38,200::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:46:38,271::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:46:38,272::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:46:38,285::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::INFO::2011-01-18 19:46:38,285::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::DEBUG::2011-01-18 19:46:38,286::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:46:38,287::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18497::DEBUG::2011-01-18 19:46:38,287::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:46:38,288::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:46:38,312::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:46:38,330::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:46:38,331::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:46:38,336::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:38,391::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:38,943::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512189 seconds, 2.0 MB/s\n'; = 0 Thread-18677::INFO::2011-01-18 19:46:39,608::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18677::DEBUG::2011-01-18 19:46:39,608::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: moving from state init -> state preparing Thread-18677::DEBUG::2011-01-18 19:46:39,609::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8421487e-2452-4a98-8fc4-ab9f2089073c acquire shared (120000) Thread-18677::DEBUG::2011-01-18 19:46:39,609::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18677::DEBUG::2011-01-18 19:46:39,609::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8421487e-2452-4a98-8fc4-ab9f2089073c' Thread-18677::DEBUG::2011-01-18 19:46:39,609::resource::524::irs::Owner 8421487e-2452-4a98-8fc4-ab9f2089073c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18677::DEBUG::2011-01-18 19:46:39,610::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18677::DEBUG::2011-01-18 19:46:39,610::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: ref 1 aborting False Thread-18677::DEBUG::2011-01-18 19:46:39,610::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452020168304', 'lastCheck': 1295372798.206037, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0528860092163', 'lastCheck': 1295372798.339879, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.046010017395', 'lastCheck': 1295372798.3178561, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0515100955963', 'lastCheck': 1295372798.336375, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0484721660614', 'lastCheck': 1295372798.3338561, 'valid': True, 'code': 0}} Thread-18677::DEBUG::2011-01-18 19:46:39,611::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: moving from state preparing -> state finished Thread-18677::DEBUG::2011-01-18 19:46:39,611::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18677::DEBUG::2011-01-18 19:46:39,612::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8421487e-2452-4a98-8fc4-ab9f2089073c releasing Thread-18677::DEBUG::2011-01-18 19:46:39,612::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18677::DEBUG::2011-01-18 19:46:39,613::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18678::INFO::2011-01-18 19:46:39,613::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18677::DEBUG::2011-01-18 19:46:39,613::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18678::DEBUG::2011-01-18 19:46:39,613::task::577::irs::Task 0fe0ba91-efe5-44ad-907f-117465b5b49b: moving from state init -> state preparing Thread-18677::DEBUG::2011-01-18 19:46:39,614::resource::503::irs::Owner 8421487e-2452-4a98-8fc4-ab9f2089073c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18678::DEBUG::2011-01-18 19:46:39,614::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18677::DEBUG::2011-01-18 19:46:39,615::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18677::DEBUG::2011-01-18 19:46:39,617::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18677::DEBUG::2011-01-18 19:46:39,618::task::577::irs::Task 8421487e-2452-4a98-8fc4-ab9f2089073c: ref 0 aborting False Thread-18677::INFO::2011-01-18 19:46:39,618::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452020168304', 'lastCheck': 1295372798.206037, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.046010017395', 'lastCheck': 1295372798.3178561, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0484721660614', 'lastCheck': 1295372798.3338561, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0515100955963', 'lastCheck': 1295372798.336375, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0528860092163', 'lastCheck': 1295372798.339879, 'valid': True, 'code': 0}} Thread-18678::DEBUG::2011-01-18 19:46:39,647::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000468 seconds, 4.4 MB/s\n'; = 0 Thread-18678::DEBUG::2011-01-18 19:46:39,647::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000468 seconds, 4.4 MB/s'], size: 2048 Thread-18678::DEBUG::2011-01-18 19:46:39,647::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18678::DEBUG::2011-01-18 19:46:39,648::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18678::DEBUG::2011-01-18 19:46:39,648::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18678::DEBUG::2011-01-18 19:46:39,649::task::577::irs::Task 0fe0ba91-efe5-44ad-907f-117465b5b49b: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18678::DEBUG::2011-01-18 19:46:39,649::task::577::irs::Task 0fe0ba91-efe5-44ad-907f-117465b5b49b: moving from state preparing -> state finished Thread-18678::DEBUG::2011-01-18 19:46:39,649::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18678::DEBUG::2011-01-18 19:46:39,650::task::577::irs::Task 0fe0ba91-efe5-44ad-907f-117465b5b49b: ref 0 aborting False Thread-18678::INFO::2011-01-18 19:46:39,650::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18680::INFO::2011-01-18 19:46:39,658::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18680::DEBUG::2011-01-18 19:46:39,658::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: moving from state init -> state preparing Thread-18680::DEBUG::2011-01-18 19:46:39,658::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 197d55f5-83f2-4879-8717-2ebdc053a430 acquire shared (120000) Thread-18680::DEBUG::2011-01-18 19:46:39,659::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18680::DEBUG::2011-01-18 19:46:39,659::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '197d55f5-83f2-4879-8717-2ebdc053a430' Thread-18680::DEBUG::2011-01-18 19:46:39,659::resource::524::irs::Owner 197d55f5-83f2-4879-8717-2ebdc053a430: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18680::DEBUG::2011-01-18 19:46:39,659::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18680::DEBUG::2011-01-18 19:46:39,660::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: ref 1 aborting False Thread-18680::INFO::2011-01-18 19:46:39,660::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18680::DEBUG::2011-01-18 19:46:39,661::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18680::DEBUG::2011-01-18 19:46:39,661::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: moving from state preparing -> state finished Thread-18680::DEBUG::2011-01-18 19:46:39,661::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18680::DEBUG::2011-01-18 19:46:39,662::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 197d55f5-83f2-4879-8717-2ebdc053a430 releasing Thread-18680::DEBUG::2011-01-18 19:46:39,662::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18680::DEBUG::2011-01-18 19:46:39,662::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18680::DEBUG::2011-01-18 19:46:39,663::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18680::DEBUG::2011-01-18 19:46:39,663::resource::503::irs::Owner 197d55f5-83f2-4879-8717-2ebdc053a430: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18680::DEBUG::2011-01-18 19:46:39,663::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18680::DEBUG::2011-01-18 19:46:39,663::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18680::DEBUG::2011-01-18 19:46:39,664::task::577::irs::Task 197d55f5-83f2-4879-8717-2ebdc053a430: ref 0 aborting False Thread-18680::INFO::2011-01-18 19:46:39,664::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:46:40,957::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:41,491::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502028 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:43,504::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:44,043::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507153 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:46,057::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:46,589::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501042 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:46:48,205::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:46:48,206::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:48,245::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:46:48,317::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:46:48,318::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:46:48,334::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:46:48,335::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:46:48,337::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:46:48,338::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:46:48,340::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:46:48,342::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:46:48,358::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:46:48,375::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:46:48,376::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:46:48,385::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:48,603::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:49,145::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510605 seconds, 2.0 MB/s\n'; = 0 Thread-18685::INFO::2011-01-18 19:46:49,723::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18685::DEBUG::2011-01-18 19:46:49,723::task::577::irs::Task 91e80e1f-2df4-4c97-b335-6a56dbdd443b: moving from state init -> state preparing Thread-18685::DEBUG::2011-01-18 19:46:49,724::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18685::DEBUG::2011-01-18 19:46:49,756::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000451 seconds, 4.5 MB/s\n'; = 0 Thread-18685::DEBUG::2011-01-18 19:46:49,756::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000451 seconds, 4.5 MB/s'], size: 2048 Thread-18685::DEBUG::2011-01-18 19:46:49,756::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18685::DEBUG::2011-01-18 19:46:49,757::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18685::DEBUG::2011-01-18 19:46:49,757::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18685::DEBUG::2011-01-18 19:46:49,758::task::577::irs::Task 91e80e1f-2df4-4c97-b335-6a56dbdd443b: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18685::DEBUG::2011-01-18 19:46:49,758::task::577::irs::Task 91e80e1f-2df4-4c97-b335-6a56dbdd443b: moving from state preparing -> state finished Thread-18685::DEBUG::2011-01-18 19:46:49,758::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18685::DEBUG::2011-01-18 19:46:49,759::task::577::irs::Task 91e80e1f-2df4-4c97-b335-6a56dbdd443b: ref 0 aborting False Thread-18685::INFO::2011-01-18 19:46:49,759::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18686::INFO::2011-01-18 19:46:49,768::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18686::DEBUG::2011-01-18 19:46:49,768::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: moving from state init -> state preparing Thread-18686::DEBUG::2011-01-18 19:46:49,769::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2467ab16-8d53-4cbc-b802-869dcb934027 acquire shared (120000) Thread-18686::DEBUG::2011-01-18 19:46:49,769::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18686::DEBUG::2011-01-18 19:46:49,769::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2467ab16-8d53-4cbc-b802-869dcb934027' Thread-18686::DEBUG::2011-01-18 19:46:49,770::resource::524::irs::Owner 2467ab16-8d53-4cbc-b802-869dcb934027: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18686::DEBUG::2011-01-18 19:46:49,770::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18686::DEBUG::2011-01-18 19:46:49,770::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: ref 1 aborting False Thread-18686::INFO::2011-01-18 19:46:49,771::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18686::DEBUG::2011-01-18 19:46:49,771::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18686::DEBUG::2011-01-18 19:46:49,772::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: moving from state preparing -> state finished Thread-18686::DEBUG::2011-01-18 19:46:49,772::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18686::DEBUG::2011-01-18 19:46:49,772::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2467ab16-8d53-4cbc-b802-869dcb934027 releasing Thread-18686::DEBUG::2011-01-18 19:46:49,772::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18686::DEBUG::2011-01-18 19:46:49,773::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18686::DEBUG::2011-01-18 19:46:49,773::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18686::DEBUG::2011-01-18 19:46:49,773::resource::503::irs::Owner 2467ab16-8d53-4cbc-b802-869dcb934027: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18686::DEBUG::2011-01-18 19:46:49,774::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18686::DEBUG::2011-01-18 19:46:49,774::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18686::DEBUG::2011-01-18 19:46:49,774::task::577::irs::Task 2467ab16-8d53-4cbc-b802-869dcb934027: ref 0 aborting False Thread-18686::INFO::2011-01-18 19:46:49,774::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18687::INFO::2011-01-18 19:46:49,784::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18687::DEBUG::2011-01-18 19:46:49,784::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: moving from state init -> state preparing Thread-18687::DEBUG::2011-01-18 19:46:49,784::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 48ef4fb5-487c-46ed-b7ae-a10867530c86 acquire shared (120000) Thread-18687::DEBUG::2011-01-18 19:46:49,785::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18687::DEBUG::2011-01-18 19:46:49,785::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '48ef4fb5-487c-46ed-b7ae-a10867530c86' Thread-18687::DEBUG::2011-01-18 19:46:49,785::resource::524::irs::Owner 48ef4fb5-487c-46ed-b7ae-a10867530c86: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18687::DEBUG::2011-01-18 19:46:49,786::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18687::DEBUG::2011-01-18 19:46:49,786::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: ref 1 aborting False Thread-18687::DEBUG::2011-01-18 19:46:49,786::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0447459220886', 'lastCheck': 1295372808.250598, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.04816198349', 'lastCheck': 1295372808.3882539, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476078987122', 'lastCheck': 1295372808.365454, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0443120002747', 'lastCheck': 1295372808.3812881, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0447771549225', 'lastCheck': 1295372808.3787551, 'valid': True, 'code': 0}} Thread-18687::DEBUG::2011-01-18 19:46:49,787::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: moving from state preparing -> state finished Thread-18687::DEBUG::2011-01-18 19:46:49,787::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18687::DEBUG::2011-01-18 19:46:49,787::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 48ef4fb5-487c-46ed-b7ae-a10867530c86 releasing Thread-18687::DEBUG::2011-01-18 19:46:49,787::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18687::DEBUG::2011-01-18 19:46:49,788::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18687::DEBUG::2011-01-18 19:46:49,788::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18687::DEBUG::2011-01-18 19:46:49,788::resource::503::irs::Owner 48ef4fb5-487c-46ed-b7ae-a10867530c86: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18687::DEBUG::2011-01-18 19:46:49,788::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18687::DEBUG::2011-01-18 19:46:49,789::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18687::DEBUG::2011-01-18 19:46:49,789::task::577::irs::Task 48ef4fb5-487c-46ed-b7ae-a10867530c86: ref 0 aborting False Thread-18687::INFO::2011-01-18 19:46:49,789::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0447459220886', 'lastCheck': 1295372808.250598, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476078987122', 'lastCheck': 1295372808.365454, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0447771549225', 'lastCheck': 1295372808.3787551, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0443120002747', 'lastCheck': 1295372808.3812881, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.04816198349', 'lastCheck': 1295372808.3882539, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:46:51,158::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:51,690::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500511 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:53,703::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:54,239::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503789 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:56,253::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:56,787::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501622 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:46:58,252::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:46:58,253::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:46:58,292::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:46:58,364::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:46:58,365::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:46:58,378::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:46:58,379::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:46:58,381::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:46:58,383::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:46:58,388::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:46:58,389::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:46:58,406::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:46:58,422::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:46:58,423::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:46:58,435::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:46:58,800::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:46:59,349::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.517204 seconds, 2.0 MB/s\n'; = 0 Thread-18693::INFO::2011-01-18 19:46:59,839::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18693::DEBUG::2011-01-18 19:46:59,839::task::577::irs::Task ee5b1666-ed1f-4141-97fb-e6e6215a2580: moving from state init -> state preparing Thread-18693::DEBUG::2011-01-18 19:46:59,840::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18693::DEBUG::2011-01-18 19:46:59,872::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000418 seconds, 4.9 MB/s\n'; = 0 Thread-18693::DEBUG::2011-01-18 19:46:59,872::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000418 seconds, 4.9 MB/s'], size: 2048 Thread-18693::DEBUG::2011-01-18 19:46:59,872::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18693::DEBUG::2011-01-18 19:46:59,873::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18693::DEBUG::2011-01-18 19:46:59,874::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18693::DEBUG::2011-01-18 19:46:59,874::task::577::irs::Task ee5b1666-ed1f-4141-97fb-e6e6215a2580: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18693::DEBUG::2011-01-18 19:46:59,874::task::577::irs::Task ee5b1666-ed1f-4141-97fb-e6e6215a2580: moving from state preparing -> state finished Thread-18693::DEBUG::2011-01-18 19:46:59,874::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18693::DEBUG::2011-01-18 19:46:59,875::task::577::irs::Task ee5b1666-ed1f-4141-97fb-e6e6215a2580: ref 0 aborting False Thread-18693::INFO::2011-01-18 19:46:59,875::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18694::INFO::2011-01-18 19:46:59,883::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18694::DEBUG::2011-01-18 19:46:59,883::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: moving from state init -> state preparing Thread-18694::DEBUG::2011-01-18 19:46:59,883::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b8bed650-1c67-452e-bb93-3db021d8a22c acquire shared (120000) Thread-18694::DEBUG::2011-01-18 19:46:59,884::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18694::DEBUG::2011-01-18 19:46:59,884::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b8bed650-1c67-452e-bb93-3db021d8a22c' Thread-18694::DEBUG::2011-01-18 19:46:59,884::resource::524::irs::Owner b8bed650-1c67-452e-bb93-3db021d8a22c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18694::DEBUG::2011-01-18 19:46:59,885::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18694::DEBUG::2011-01-18 19:46:59,885::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: ref 1 aborting False Thread-18694::INFO::2011-01-18 19:46:59,885::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18694::DEBUG::2011-01-18 19:46:59,886::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18694::DEBUG::2011-01-18 19:46:59,886::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: moving from state preparing -> state finished Thread-18694::DEBUG::2011-01-18 19:46:59,887::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18694::DEBUG::2011-01-18 19:46:59,887::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b8bed650-1c67-452e-bb93-3db021d8a22c releasing Thread-18694::DEBUG::2011-01-18 19:46:59,887::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18694::DEBUG::2011-01-18 19:46:59,887::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18694::DEBUG::2011-01-18 19:46:59,888::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18694::DEBUG::2011-01-18 19:46:59,888::resource::503::irs::Owner b8bed650-1c67-452e-bb93-3db021d8a22c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18694::DEBUG::2011-01-18 19:46:59,888::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18694::DEBUG::2011-01-18 19:46:59,889::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18694::DEBUG::2011-01-18 19:46:59,889::task::577::irs::Task b8bed650-1c67-452e-bb93-3db021d8a22c: ref 0 aborting False Thread-18694::INFO::2011-01-18 19:46:59,889::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18695::INFO::2011-01-18 19:46:59,947::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18695::DEBUG::2011-01-18 19:46:59,947::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: moving from state init -> state preparing Thread-18695::DEBUG::2011-01-18 19:46:59,947::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6c2ea6b3-daad-4a02-917f-156aa5651b24 acquire shared (120000) Thread-18695::DEBUG::2011-01-18 19:46:59,948::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18695::DEBUG::2011-01-18 19:46:59,948::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6c2ea6b3-daad-4a02-917f-156aa5651b24' Thread-18695::DEBUG::2011-01-18 19:46:59,948::resource::524::irs::Owner 6c2ea6b3-daad-4a02-917f-156aa5651b24: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18695::DEBUG::2011-01-18 19:46:59,948::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18695::DEBUG::2011-01-18 19:46:59,949::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: ref 1 aborting False Thread-18695::DEBUG::2011-01-18 19:46:59,949::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.044399023056', 'lastCheck': 1295372818.2972381, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0508658885956', 'lastCheck': 1295372818.439049, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0472581386566', 'lastCheck': 1295372818.4121051, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0472979545593', 'lastCheck': 1295372818.4283969, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0500650405884', 'lastCheck': 1295372818.427923, 'valid': True, 'code': 0}} Thread-18695::DEBUG::2011-01-18 19:46:59,949::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: moving from state preparing -> state finished Thread-18695::DEBUG::2011-01-18 19:46:59,950::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18695::DEBUG::2011-01-18 19:46:59,950::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6c2ea6b3-daad-4a02-917f-156aa5651b24 releasing Thread-18695::DEBUG::2011-01-18 19:46:59,950::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18695::DEBUG::2011-01-18 19:46:59,951::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18695::DEBUG::2011-01-18 19:46:59,951::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18695::DEBUG::2011-01-18 19:46:59,951::resource::503::irs::Owner 6c2ea6b3-daad-4a02-917f-156aa5651b24: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18695::DEBUG::2011-01-18 19:46:59,951::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18695::DEBUG::2011-01-18 19:46:59,952::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18695::DEBUG::2011-01-18 19:46:59,952::task::577::irs::Task 6c2ea6b3-daad-4a02-917f-156aa5651b24: ref 0 aborting False Thread-18695::INFO::2011-01-18 19:46:59,952::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.044399023056', 'lastCheck': 1295372818.2972381, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0472581386566', 'lastCheck': 1295372818.4121051, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0500650405884', 'lastCheck': 1295372818.427923, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0472979545593', 'lastCheck': 1295372818.4283969, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0508658885956', 'lastCheck': 1295372818.439049, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:47:01,362::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:01,898::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504889 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:03,912::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:04,457::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51336 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:06,471::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:07,005::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501642 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:47:08,296::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:47:08,297::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:47:08,337::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:47:08,411::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:47:08,412::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:47:08,428::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::INFO::2011-01-18 19:47:08,428::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::DEBUG::2011-01-18 19:47:08,429::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:47:08,430::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:47:08,439::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:47:08,440::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:47:08,452::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:47:08,473::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:47:08,474::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:47:08,482::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:09,018::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:09,568::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51865 seconds, 2.0 MB/s\n'; = 0 Thread-18701::INFO::2011-01-18 19:47:09,945::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18701::DEBUG::2011-01-18 19:47:09,946::task::577::irs::Task 96ce0417-7929-441a-9fe2-e84b7c02258e: moving from state init -> state preparing Thread-18701::DEBUG::2011-01-18 19:47:09,946::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18701::DEBUG::2011-01-18 19:47:09,978::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000468 seconds, 4.4 MB/s\n'; = 0 Thread-18701::DEBUG::2011-01-18 19:47:09,978::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000468 seconds, 4.4 MB/s'], size: 2048 Thread-18701::DEBUG::2011-01-18 19:47:09,978::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18701::DEBUG::2011-01-18 19:47:09,979::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18701::DEBUG::2011-01-18 19:47:09,979::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18701::DEBUG::2011-01-18 19:47:09,980::task::577::irs::Task 96ce0417-7929-441a-9fe2-e84b7c02258e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18701::DEBUG::2011-01-18 19:47:09,980::task::577::irs::Task 96ce0417-7929-441a-9fe2-e84b7c02258e: moving from state preparing -> state finished Thread-18701::DEBUG::2011-01-18 19:47:09,980::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18701::DEBUG::2011-01-18 19:47:09,981::task::577::irs::Task 96ce0417-7929-441a-9fe2-e84b7c02258e: ref 0 aborting False Thread-18701::INFO::2011-01-18 19:47:09,981::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18702::INFO::2011-01-18 19:47:09,989::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18702::DEBUG::2011-01-18 19:47:09,989::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: moving from state init -> state preparing Thread-18702::DEBUG::2011-01-18 19:47:09,990::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 53e13133-1b3b-4f68-bc24-bce2913c5bfd acquire shared (120000) Thread-18702::DEBUG::2011-01-18 19:47:09,990::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18702::DEBUG::2011-01-18 19:47:09,990::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '53e13133-1b3b-4f68-bc24-bce2913c5bfd' Thread-18702::DEBUG::2011-01-18 19:47:09,991::resource::524::irs::Owner 53e13133-1b3b-4f68-bc24-bce2913c5bfd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18702::DEBUG::2011-01-18 19:47:09,991::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18702::DEBUG::2011-01-18 19:47:09,991::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: ref 1 aborting False Thread-18702::INFO::2011-01-18 19:47:09,992::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18702::DEBUG::2011-01-18 19:47:09,992::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18702::DEBUG::2011-01-18 19:47:09,993::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: moving from state preparing -> state finished Thread-18702::DEBUG::2011-01-18 19:47:09,993::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18702::DEBUG::2011-01-18 19:47:09,993::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 53e13133-1b3b-4f68-bc24-bce2913c5bfd releasing Thread-18702::DEBUG::2011-01-18 19:47:09,993::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18702::DEBUG::2011-01-18 19:47:09,994::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18702::DEBUG::2011-01-18 19:47:09,994::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18702::DEBUG::2011-01-18 19:47:09,994::resource::503::irs::Owner 53e13133-1b3b-4f68-bc24-bce2913c5bfd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18702::DEBUG::2011-01-18 19:47:09,995::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18702::DEBUG::2011-01-18 19:47:09,995::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18702::DEBUG::2011-01-18 19:47:09,995::task::577::irs::Task 53e13133-1b3b-4f68-bc24-bce2913c5bfd: ref 0 aborting False Thread-18702::INFO::2011-01-18 19:47:09,995::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18703::INFO::2011-01-18 19:47:10,112::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18703::DEBUG::2011-01-18 19:47:10,113::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: moving from state init -> state preparing Thread-18703::DEBUG::2011-01-18 19:47:10,113::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b acquire shared (120000) Thread-18703::DEBUG::2011-01-18 19:47:10,113::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18703::DEBUG::2011-01-18 19:47:10,114::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '00aaedce-16ab-4fa5-8ea8-dda9a2afd00b' Thread-18703::DEBUG::2011-01-18 19:47:10,114::resource::524::irs::Owner 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18703::DEBUG::2011-01-18 19:47:10,114::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18703::DEBUG::2011-01-18 19:47:10,115::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: ref 1 aborting False Thread-18703::DEBUG::2011-01-18 19:47:10,115::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0444049835205', 'lastCheck': 1295372828.341265, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0471308231354', 'lastCheck': 1295372828.4860129, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0462899208069', 'lastCheck': 1295372828.458138, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0513429641724', 'lastCheck': 1295372828.479243, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0490651130676', 'lastCheck': 1295372828.4777241, 'valid': True, 'code': 0}} Thread-18703::DEBUG::2011-01-18 19:47:10,115::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: moving from state preparing -> state finished Thread-18703::DEBUG::2011-01-18 19:47:10,116::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18703::DEBUG::2011-01-18 19:47:10,116::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b releasing Thread-18703::DEBUG::2011-01-18 19:47:10,116::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18703::DEBUG::2011-01-18 19:47:10,116::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18703::DEBUG::2011-01-18 19:47:10,117::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18703::DEBUG::2011-01-18 19:47:10,117::resource::503::irs::Owner 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18703::DEBUG::2011-01-18 19:47:10,117::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18703::DEBUG::2011-01-18 19:47:10,118::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18703::DEBUG::2011-01-18 19:47:10,118::task::577::irs::Task 00aaedce-16ab-4fa5-8ea8-dda9a2afd00b: ref 0 aborting False Thread-18703::INFO::2011-01-18 19:47:10,118::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0444049835205', 'lastCheck': 1295372828.341265, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0462899208069', 'lastCheck': 1295372828.458138, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0490651130676', 'lastCheck': 1295372828.4777241, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0513429641724', 'lastCheck': 1295372828.479243, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0471308231354', 'lastCheck': 1295372828.4860129, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:47:11,581::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:12,130::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.517472 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:14,143::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:14,681::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506796 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:16,694::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:17,341::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.614217 seconds, 1.7 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:47:18,340::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:47:18,341::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:47:18,381::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:47:18,457::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:47:18,458::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:47:18,477::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:47:18,478::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:47:18,480::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:47:18,482::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:47:18,486::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:47:18,487::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:47:18,498::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:47:18,519::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:47:18,521::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:47:18,530::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:19,355::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:20,049::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.661467 seconds, 1.5 MB/s\n'; = 0 Thread-18709::INFO::2011-01-18 19:47:20,066::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18709::DEBUG::2011-01-18 19:47:20,066::task::577::irs::Task 133bd704-3259-454e-8f67-d6828d314cf6: moving from state init -> state preparing Thread-18709::DEBUG::2011-01-18 19:47:20,067::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18709::DEBUG::2011-01-18 19:47:20,098::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000433 seconds, 4.7 MB/s\n'; = 0 Thread-18709::DEBUG::2011-01-18 19:47:20,099::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000433 seconds, 4.7 MB/s'], size: 2048 Thread-18709::DEBUG::2011-01-18 19:47:20,099::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18709::DEBUG::2011-01-18 19:47:20,100::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18709::DEBUG::2011-01-18 19:47:20,100::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18709::DEBUG::2011-01-18 19:47:20,101::task::577::irs::Task 133bd704-3259-454e-8f67-d6828d314cf6: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18709::DEBUG::2011-01-18 19:47:20,101::task::577::irs::Task 133bd704-3259-454e-8f67-d6828d314cf6: moving from state preparing -> state finished Thread-18709::DEBUG::2011-01-18 19:47:20,101::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18709::DEBUG::2011-01-18 19:47:20,102::task::577::irs::Task 133bd704-3259-454e-8f67-d6828d314cf6: ref 0 aborting False Thread-18709::INFO::2011-01-18 19:47:20,102::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18710::INFO::2011-01-18 19:47:20,110::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18710::DEBUG::2011-01-18 19:47:20,111::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: moving from state init -> state preparing Thread-18710::DEBUG::2011-01-18 19:47:20,111::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce acquire shared (120000) Thread-18710::DEBUG::2011-01-18 19:47:20,111::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18710::DEBUG::2011-01-18 19:47:20,111::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '78ed6c6d-b87b-4f41-bbe6-9a19b02999ce' Thread-18710::DEBUG::2011-01-18 19:47:20,112::resource::524::irs::Owner 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18710::DEBUG::2011-01-18 19:47:20,112::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18710::DEBUG::2011-01-18 19:47:20,112::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: ref 1 aborting False Thread-18710::INFO::2011-01-18 19:47:20,113::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18710::DEBUG::2011-01-18 19:47:20,114::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18710::DEBUG::2011-01-18 19:47:20,114::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: moving from state preparing -> state finished Thread-18710::DEBUG::2011-01-18 19:47:20,114::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18710::DEBUG::2011-01-18 19:47:20,115::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce releasing Thread-18710::DEBUG::2011-01-18 19:47:20,115::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18710::DEBUG::2011-01-18 19:47:20,115::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18710::DEBUG::2011-01-18 19:47:20,116::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18710::DEBUG::2011-01-18 19:47:20,116::resource::503::irs::Owner 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18710::DEBUG::2011-01-18 19:47:20,116::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18710::DEBUG::2011-01-18 19:47:20,116::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18710::DEBUG::2011-01-18 19:47:20,117::task::577::irs::Task 78ed6c6d-b87b-4f41-bbe6-9a19b02999ce: ref 0 aborting False Thread-18710::INFO::2011-01-18 19:47:20,117::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18711::INFO::2011-01-18 19:47:20,273::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18711::DEBUG::2011-01-18 19:47:20,273::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: moving from state init -> state preparing Thread-18711::DEBUG::2011-01-18 19:47:20,274::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 64ed172d-1695-4f0a-bafc-35838f1e8532 acquire shared (120000) Thread-18711::DEBUG::2011-01-18 19:47:20,274::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18711::DEBUG::2011-01-18 19:47:20,274::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '64ed172d-1695-4f0a-bafc-35838f1e8532' Thread-18711::DEBUG::2011-01-18 19:47:20,274::resource::524::irs::Owner 64ed172d-1695-4f0a-bafc-35838f1e8532: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18711::DEBUG::2011-01-18 19:47:20,275::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18711::DEBUG::2011-01-18 19:47:20,275::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: ref 1 aborting False Thread-18711::DEBUG::2011-01-18 19:47:20,275::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0454149246216', 'lastCheck': 1295372838.3862519, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0476610660553', 'lastCheck': 1295372838.5335391, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0471270084381', 'lastCheck': 1295372838.5049701, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463149547577', 'lastCheck': 1295372838.5263469, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0458900928497', 'lastCheck': 1295372838.522752, 'valid': True, 'code': 0}} Thread-18711::DEBUG::2011-01-18 19:47:20,276::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: moving from state preparing -> state finished Thread-18711::DEBUG::2011-01-18 19:47:20,276::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18711::DEBUG::2011-01-18 19:47:20,276::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 64ed172d-1695-4f0a-bafc-35838f1e8532 releasing Thread-18711::DEBUG::2011-01-18 19:47:20,276::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18711::DEBUG::2011-01-18 19:47:20,277::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18711::DEBUG::2011-01-18 19:47:20,277::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18711::DEBUG::2011-01-18 19:47:20,277::resource::503::irs::Owner 64ed172d-1695-4f0a-bafc-35838f1e8532: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18711::DEBUG::2011-01-18 19:47:20,278::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18711::DEBUG::2011-01-18 19:47:20,278::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18711::DEBUG::2011-01-18 19:47:20,278::task::577::irs::Task 64ed172d-1695-4f0a-bafc-35838f1e8532: ref 0 aborting False Thread-18711::INFO::2011-01-18 19:47:20,278::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0454149246216', 'lastCheck': 1295372838.3862519, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0471270084381', 'lastCheck': 1295372838.5049701, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0458900928497', 'lastCheck': 1295372838.522752, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463149547577', 'lastCheck': 1295372838.5263469, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0476610660553', 'lastCheck': 1295372838.5335391, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:47:22,064::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:22,778::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.681827 seconds, 1.5 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:24,791::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:25,477::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.654288 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:27,492::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:28,163::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.639218 seconds, 1.6 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:47:28,385::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:47:28,386::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:47:28,427::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:47:28,504::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:47:28,505::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:47:28,522::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:47:28,523::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:47:28,526::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:47:28,528::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:47:28,533::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:47:28,534::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:47:28,545::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:47:28,564::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:47:28,570::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:47:28,577::misc::122::irs::SUCCESS: = ''; = 0 Thread-18717::INFO::2011-01-18 19:47:30,171::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18717::DEBUG::2011-01-18 19:47:30,172::task::577::irs::Task 811368af-4145-4e47-81d2-3ffee5d63956: moving from state init -> state preparing Thread-18717::DEBUG::2011-01-18 19:47:30,172::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:30,177::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18717::DEBUG::2011-01-18 19:47:30,204::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000463 seconds, 4.4 MB/s\n'; = 0 Thread-18717::DEBUG::2011-01-18 19:47:30,205::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000463 seconds, 4.4 MB/s'], size: 2048 Thread-18717::DEBUG::2011-01-18 19:47:30,205::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18717::DEBUG::2011-01-18 19:47:30,206::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18717::DEBUG::2011-01-18 19:47:30,206::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18717::DEBUG::2011-01-18 19:47:30,207::task::577::irs::Task 811368af-4145-4e47-81d2-3ffee5d63956: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18717::DEBUG::2011-01-18 19:47:30,207::task::577::irs::Task 811368af-4145-4e47-81d2-3ffee5d63956: moving from state preparing -> state finished Thread-18717::DEBUG::2011-01-18 19:47:30,208::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18717::DEBUG::2011-01-18 19:47:30,208::task::577::irs::Task 811368af-4145-4e47-81d2-3ffee5d63956: ref 0 aborting False Thread-18717::INFO::2011-01-18 19:47:30,209::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18718::INFO::2011-01-18 19:47:30,217::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18718::DEBUG::2011-01-18 19:47:30,217::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: moving from state init -> state preparing Thread-18718::DEBUG::2011-01-18 19:47:30,218::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b1230e14-8588-4141-b123-d445f568835b acquire shared (120000) Thread-18718::DEBUG::2011-01-18 19:47:30,218::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18718::DEBUG::2011-01-18 19:47:30,218::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b1230e14-8588-4141-b123-d445f568835b' Thread-18718::DEBUG::2011-01-18 19:47:30,218::resource::524::irs::Owner b1230e14-8588-4141-b123-d445f568835b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18718::DEBUG::2011-01-18 19:47:30,219::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18718::DEBUG::2011-01-18 19:47:30,219::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: ref 1 aborting False Thread-18718::INFO::2011-01-18 19:47:30,220::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18718::DEBUG::2011-01-18 19:47:30,220::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18718::DEBUG::2011-01-18 19:47:30,221::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: moving from state preparing -> state finished Thread-18718::DEBUG::2011-01-18 19:47:30,221::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18718::DEBUG::2011-01-18 19:47:30,222::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b1230e14-8588-4141-b123-d445f568835b releasing Thread-18718::DEBUG::2011-01-18 19:47:30,222::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18718::DEBUG::2011-01-18 19:47:30,222::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18718::DEBUG::2011-01-18 19:47:30,222::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18718::DEBUG::2011-01-18 19:47:30,223::resource::503::irs::Owner b1230e14-8588-4141-b123-d445f568835b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18718::DEBUG::2011-01-18 19:47:30,223::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18718::DEBUG::2011-01-18 19:47:30,223::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18718::DEBUG::2011-01-18 19:47:30,224::task::577::irs::Task b1230e14-8588-4141-b123-d445f568835b: ref 0 aborting False Thread-18718::INFO::2011-01-18 19:47:30,224::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18719::INFO::2011-01-18 19:47:30,438::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18719::DEBUG::2011-01-18 19:47:30,439::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: moving from state init -> state preparing Thread-18719::DEBUG::2011-01-18 19:47:30,439::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 392c6539-aa20-4482-80d9-e3ff94e7f8b0 acquire shared (120000) Thread-18719::DEBUG::2011-01-18 19:47:30,439::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18719::DEBUG::2011-01-18 19:47:30,440::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '392c6539-aa20-4482-80d9-e3ff94e7f8b0' Thread-18719::DEBUG::2011-01-18 19:47:30,440::resource::524::irs::Owner 392c6539-aa20-4482-80d9-e3ff94e7f8b0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18719::DEBUG::2011-01-18 19:47:30,440::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18719::DEBUG::2011-01-18 19:47:30,441::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: ref 1 aborting False Thread-18719::DEBUG::2011-01-18 19:47:30,441::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0461909770966', 'lastCheck': 1295372848.4320381, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047600030899', 'lastCheck': 1295372848.5804961, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476989746094', 'lastCheck': 1295372848.5525429, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0485210418701', 'lastCheck': 1295372848.574657, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0465281009674', 'lastCheck': 1295372848.5683861, 'valid': True, 'code': 0}} Thread-18719::DEBUG::2011-01-18 19:47:30,442::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: moving from state preparing -> state finished Thread-18719::DEBUG::2011-01-18 19:47:30,442::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18719::DEBUG::2011-01-18 19:47:30,442::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 392c6539-aa20-4482-80d9-e3ff94e7f8b0 releasing Thread-18719::DEBUG::2011-01-18 19:47:30,443::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18719::DEBUG::2011-01-18 19:47:30,443::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18719::DEBUG::2011-01-18 19:47:30,443::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18719::DEBUG::2011-01-18 19:47:30,444::resource::503::irs::Owner 392c6539-aa20-4482-80d9-e3ff94e7f8b0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18719::DEBUG::2011-01-18 19:47:30,444::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18719::DEBUG::2011-01-18 19:47:30,444::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18719::DEBUG::2011-01-18 19:47:30,445::task::577::irs::Task 392c6539-aa20-4482-80d9-e3ff94e7f8b0: ref 0 aborting False Thread-18719::INFO::2011-01-18 19:47:30,445::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0461909770966', 'lastCheck': 1295372848.4320381, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476989746094', 'lastCheck': 1295372848.5525429, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0465281009674', 'lastCheck': 1295372848.5683861, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0485210418701', 'lastCheck': 1295372848.574657, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047600030899', 'lastCheck': 1295372848.5804961, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:47:30,808::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.598466 seconds, 1.7 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:32,821::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:33,510::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.656758 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:35,522::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:36,297::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.742089 seconds, 1.4 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:38,309::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:47:38,432::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:47:38,432::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:47:38,477::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:47:38,551::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:47:38,552::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:47:38,568::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:47:38,569::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:47:38,574::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:47:38,576::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:47:38,580::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:47:38,581::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:47:38,595::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:47:38,619::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:47:38,620::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:47:38,623::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:38,978::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.637046 seconds, 1.6 MB/s\n'; = 0 Thread-18725::INFO::2011-01-18 19:47:40,278::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18725::DEBUG::2011-01-18 19:47:40,278::task::577::irs::Task a226c8e8-522b-491f-bd58-044543764832: moving from state init -> state preparing Thread-18725::DEBUG::2011-01-18 19:47:40,278::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18725::DEBUG::2011-01-18 19:47:40,310::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000733 seconds, 2.8 MB/s\n'; = 0 Thread-18725::DEBUG::2011-01-18 19:47:40,311::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000733 seconds, 2.8 MB/s'], size: 2048 Thread-18725::DEBUG::2011-01-18 19:47:40,311::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18725::DEBUG::2011-01-18 19:47:40,312::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18725::DEBUG::2011-01-18 19:47:40,312::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18725::DEBUG::2011-01-18 19:47:40,313::task::577::irs::Task a226c8e8-522b-491f-bd58-044543764832: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18725::DEBUG::2011-01-18 19:47:40,313::task::577::irs::Task a226c8e8-522b-491f-bd58-044543764832: moving from state preparing -> state finished Thread-18725::DEBUG::2011-01-18 19:47:40,313::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18725::DEBUG::2011-01-18 19:47:40,314::task::577::irs::Task a226c8e8-522b-491f-bd58-044543764832: ref 0 aborting False Thread-18725::INFO::2011-01-18 19:47:40,314::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18726::INFO::2011-01-18 19:47:40,322::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18726::DEBUG::2011-01-18 19:47:40,322::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: moving from state init -> state preparing Thread-18726::DEBUG::2011-01-18 19:47:40,323::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d93ff6a8-ed91-42e2-9d30-a73ad0103454 acquire shared (120000) Thread-18726::DEBUG::2011-01-18 19:47:40,323::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18726::DEBUG::2011-01-18 19:47:40,323::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd93ff6a8-ed91-42e2-9d30-a73ad0103454' Thread-18726::DEBUG::2011-01-18 19:47:40,324::resource::524::irs::Owner d93ff6a8-ed91-42e2-9d30-a73ad0103454: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18726::DEBUG::2011-01-18 19:47:40,324::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18726::DEBUG::2011-01-18 19:47:40,324::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: ref 1 aborting False Thread-18726::INFO::2011-01-18 19:47:40,325::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18726::DEBUG::2011-01-18 19:47:40,326::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18726::DEBUG::2011-01-18 19:47:40,326::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: moving from state preparing -> state finished Thread-18726::DEBUG::2011-01-18 19:47:40,326::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18726::DEBUG::2011-01-18 19:47:40,327::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d93ff6a8-ed91-42e2-9d30-a73ad0103454 releasing Thread-18726::DEBUG::2011-01-18 19:47:40,327::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18726::DEBUG::2011-01-18 19:47:40,327::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18726::DEBUG::2011-01-18 19:47:40,327::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18726::DEBUG::2011-01-18 19:47:40,328::resource::503::irs::Owner d93ff6a8-ed91-42e2-9d30-a73ad0103454: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18726::DEBUG::2011-01-18 19:47:40,328::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18726::DEBUG::2011-01-18 19:47:40,328::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18726::DEBUG::2011-01-18 19:47:40,328::task::577::irs::Task d93ff6a8-ed91-42e2-9d30-a73ad0103454: ref 0 aborting False Thread-18726::INFO::2011-01-18 19:47:40,329::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18727::INFO::2011-01-18 19:47:40,615::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18727::DEBUG::2011-01-18 19:47:40,616::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: moving from state init -> state preparing Thread-18727::DEBUG::2011-01-18 19:47:40,616::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c4004b8-8b78-452d-b278-ae1c8c9900a5 acquire shared (120000) Thread-18727::DEBUG::2011-01-18 19:47:40,616::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18727::DEBUG::2011-01-18 19:47:40,616::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1c4004b8-8b78-452d-b278-ae1c8c9900a5' Thread-18727::DEBUG::2011-01-18 19:47:40,617::resource::524::irs::Owner 1c4004b8-8b78-452d-b278-ae1c8c9900a5: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18727::DEBUG::2011-01-18 19:47:40,617::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18727::DEBUG::2011-01-18 19:47:40,617::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: ref 1 aborting False Thread-18727::DEBUG::2011-01-18 19:47:40,618::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0510799884796', 'lastCheck': 1295372858.4829371, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048045873642', 'lastCheck': 1295372858.6279199, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0508201122284', 'lastCheck': 1295372858.6026671, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.05344414711', 'lastCheck': 1295372858.627341, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0554509162903', 'lastCheck': 1295372858.623317, 'valid': True, 'code': 0}} Thread-18727::DEBUG::2011-01-18 19:47:40,618::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: moving from state preparing -> state finished Thread-18727::DEBUG::2011-01-18 19:47:40,618::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18727::DEBUG::2011-01-18 19:47:40,619::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c4004b8-8b78-452d-b278-ae1c8c9900a5 releasing Thread-18727::DEBUG::2011-01-18 19:47:40,619::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18727::DEBUG::2011-01-18 19:47:40,619::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18727::DEBUG::2011-01-18 19:47:40,619::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18727::DEBUG::2011-01-18 19:47:40,620::resource::503::irs::Owner 1c4004b8-8b78-452d-b278-ae1c8c9900a5: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18727::DEBUG::2011-01-18 19:47:40,620::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18727::DEBUG::2011-01-18 19:47:40,620::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18727::DEBUG::2011-01-18 19:47:40,620::task::577::irs::Task 1c4004b8-8b78-452d-b278-ae1c8c9900a5: ref 0 aborting False Thread-18727::INFO::2011-01-18 19:47:40,621::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0510799884796', 'lastCheck': 1295372858.4829371, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0508201122284', 'lastCheck': 1295372858.6026671, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0554509162903', 'lastCheck': 1295372858.623317, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.05344414711', 'lastCheck': 1295372858.627341, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048045873642', 'lastCheck': 1295372858.6279199, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:47:40,992::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:41,710::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.686464 seconds, 1.5 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:43,723::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:44,392::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.63648 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:46,404::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:47,526::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 1.08996 seconds, 939 kB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:47:48,482::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:47:48,483::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:47:48,522::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:47:48,601::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:47:48,602::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:47:48,623::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:47:48,624::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:47:48,627::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:47:48,629::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:47:48,628::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:47:48,630::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:47:48,641::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:47:48,669::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:47:48,670::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:47:48,673::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:49,538::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:50,146::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.575511 seconds, 1.8 MB/s\n'; = 0 Thread-18733::INFO::2011-01-18 19:47:50,380::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18733::DEBUG::2011-01-18 19:47:50,381::task::577::irs::Task df3f0747-0bd8-4a98-acc9-2f318d51e2bc: moving from state init -> state preparing Thread-18733::DEBUG::2011-01-18 19:47:50,381::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18733::DEBUG::2011-01-18 19:47:50,413::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000675 seconds, 3.0 MB/s\n'; = 0 Thread-18733::DEBUG::2011-01-18 19:47:50,413::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000675 seconds, 3.0 MB/s'], size: 2048 Thread-18733::DEBUG::2011-01-18 19:47:50,414::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18733::DEBUG::2011-01-18 19:47:50,414::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18733::DEBUG::2011-01-18 19:47:50,415::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18733::DEBUG::2011-01-18 19:47:50,415::task::577::irs::Task df3f0747-0bd8-4a98-acc9-2f318d51e2bc: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18733::DEBUG::2011-01-18 19:47:50,415::task::577::irs::Task df3f0747-0bd8-4a98-acc9-2f318d51e2bc: moving from state preparing -> state finished Thread-18733::DEBUG::2011-01-18 19:47:50,416::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18733::DEBUG::2011-01-18 19:47:50,416::task::577::irs::Task df3f0747-0bd8-4a98-acc9-2f318d51e2bc: ref 0 aborting False Thread-18733::INFO::2011-01-18 19:47:50,416::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18734::INFO::2011-01-18 19:47:50,425::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18734::DEBUG::2011-01-18 19:47:50,425::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: moving from state init -> state preparing Thread-18734::DEBUG::2011-01-18 19:47:50,425::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fdec7702-d40c-4bea-b47f-769f2ad77dea acquire shared (120000) Thread-18734::DEBUG::2011-01-18 19:47:50,426::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18734::DEBUG::2011-01-18 19:47:50,426::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fdec7702-d40c-4bea-b47f-769f2ad77dea' Thread-18734::DEBUG::2011-01-18 19:47:50,426::resource::524::irs::Owner fdec7702-d40c-4bea-b47f-769f2ad77dea: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18734::DEBUG::2011-01-18 19:47:50,426::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18734::DEBUG::2011-01-18 19:47:50,427::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: ref 1 aborting False Thread-18734::INFO::2011-01-18 19:47:50,427::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18734::DEBUG::2011-01-18 19:47:50,428::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18734::DEBUG::2011-01-18 19:47:50,428::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: moving from state preparing -> state finished Thread-18734::DEBUG::2011-01-18 19:47:50,429::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18734::DEBUG::2011-01-18 19:47:50,429::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fdec7702-d40c-4bea-b47f-769f2ad77dea releasing Thread-18734::DEBUG::2011-01-18 19:47:50,429::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18734::DEBUG::2011-01-18 19:47:50,429::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18734::DEBUG::2011-01-18 19:47:50,430::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18734::DEBUG::2011-01-18 19:47:50,430::resource::503::irs::Owner fdec7702-d40c-4bea-b47f-769f2ad77dea: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18734::DEBUG::2011-01-18 19:47:50,430::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18734::DEBUG::2011-01-18 19:47:50,431::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18734::DEBUG::2011-01-18 19:47:50,431::task::577::irs::Task fdec7702-d40c-4bea-b47f-769f2ad77dea: ref 0 aborting False Thread-18734::INFO::2011-01-18 19:47:50,431::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18735::INFO::2011-01-18 19:47:50,778::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18735::DEBUG::2011-01-18 19:47:50,778::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: moving from state init -> state preparing Thread-18735::DEBUG::2011-01-18 19:47:50,779::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4457a816-7dbf-41f3-81b0-95865e226f47 acquire shared (120000) Thread-18735::DEBUG::2011-01-18 19:47:50,779::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18735::DEBUG::2011-01-18 19:47:50,779::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4457a816-7dbf-41f3-81b0-95865e226f47' Thread-18735::DEBUG::2011-01-18 19:47:50,780::resource::524::irs::Owner 4457a816-7dbf-41f3-81b0-95865e226f47: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18735::DEBUG::2011-01-18 19:47:50,780::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18735::DEBUG::2011-01-18 19:47:50,780::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: ref 1 aborting False Thread-18735::DEBUG::2011-01-18 19:47:50,780::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.04847407341', 'lastCheck': 1295372868.5313101, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0540289878845', 'lastCheck': 1295372868.68208, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0482249259949', 'lastCheck': 1295372868.650068, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0510897636414', 'lastCheck': 1295372868.6780379, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0500950813293', 'lastCheck': 1295372868.6729541, 'valid': True, 'code': 0}} Thread-18735::DEBUG::2011-01-18 19:47:50,781::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: moving from state preparing -> state finished Thread-18735::DEBUG::2011-01-18 19:47:50,781::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18735::DEBUG::2011-01-18 19:47:50,781::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4457a816-7dbf-41f3-81b0-95865e226f47 releasing Thread-18735::DEBUG::2011-01-18 19:47:50,782::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18735::DEBUG::2011-01-18 19:47:50,782::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18735::DEBUG::2011-01-18 19:47:50,782::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18735::DEBUG::2011-01-18 19:47:50,783::resource::503::irs::Owner 4457a816-7dbf-41f3-81b0-95865e226f47: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18735::DEBUG::2011-01-18 19:47:50,783::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18735::DEBUG::2011-01-18 19:47:50,783::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18735::DEBUG::2011-01-18 19:47:50,783::task::577::irs::Task 4457a816-7dbf-41f3-81b0-95865e226f47: ref 0 aborting False Thread-18735::INFO::2011-01-18 19:47:50,784::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.04847407341', 'lastCheck': 1295372868.5313101, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0482249259949', 'lastCheck': 1295372868.650068, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0500950813293', 'lastCheck': 1295372868.6729541, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0510897636414', 'lastCheck': 1295372868.6780379, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0540289878845', 'lastCheck': 1295372868.68208, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:47:52,160::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:52,985::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.791997 seconds, 1.3 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:54,999::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:47:56,039::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 1.00785 seconds, 1.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:58,053::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:47:58,531::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:47:58,532::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:47:58,578::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:47:58,649::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:47:58,650::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:47:58,673::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:47:58,674::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:47:58,678::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:47:58,680::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:47:58,683::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:47:58,684::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:47:58,699::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:47:58,717::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:47:58,726::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:47:58,728::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:47:58,825::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.739979 seconds, 1.4 MB/s\n'; = 0 Thread-18741::INFO::2011-01-18 19:48:00,488::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18741::DEBUG::2011-01-18 19:48:00,488::task::577::irs::Task 0ad37f08-b570-477c-b8f8-ba5d8d659176: moving from state init -> state preparing Thread-18741::DEBUG::2011-01-18 19:48:00,489::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18741::DEBUG::2011-01-18 19:48:00,521::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000465 seconds, 4.4 MB/s\n'; = 0 Thread-18741::DEBUG::2011-01-18 19:48:00,521::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000465 seconds, 4.4 MB/s'], size: 2048 Thread-18741::DEBUG::2011-01-18 19:48:00,522::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18741::DEBUG::2011-01-18 19:48:00,522::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18741::DEBUG::2011-01-18 19:48:00,523::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18741::DEBUG::2011-01-18 19:48:00,523::task::577::irs::Task 0ad37f08-b570-477c-b8f8-ba5d8d659176: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18741::DEBUG::2011-01-18 19:48:00,523::task::577::irs::Task 0ad37f08-b570-477c-b8f8-ba5d8d659176: moving from state preparing -> state finished Thread-18741::DEBUG::2011-01-18 19:48:00,524::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18741::DEBUG::2011-01-18 19:48:00,524::task::577::irs::Task 0ad37f08-b570-477c-b8f8-ba5d8d659176: ref 0 aborting False Thread-18741::INFO::2011-01-18 19:48:00,524::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18742::INFO::2011-01-18 19:48:00,532::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18742::DEBUG::2011-01-18 19:48:00,532::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: moving from state init -> state preparing Thread-18742::DEBUG::2011-01-18 19:48:00,533::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8bf08039-392b-44cd-bf6d-814b3f12b189 acquire shared (120000) Thread-18742::DEBUG::2011-01-18 19:48:00,533::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18742::DEBUG::2011-01-18 19:48:00,533::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8bf08039-392b-44cd-bf6d-814b3f12b189' Thread-18742::DEBUG::2011-01-18 19:48:00,534::resource::524::irs::Owner 8bf08039-392b-44cd-bf6d-814b3f12b189: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18742::DEBUG::2011-01-18 19:48:00,534::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18742::DEBUG::2011-01-18 19:48:00,534::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: ref 1 aborting False Thread-18742::INFO::2011-01-18 19:48:00,535::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18742::DEBUG::2011-01-18 19:48:00,535::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18742::DEBUG::2011-01-18 19:48:00,536::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: moving from state preparing -> state finished Thread-18742::DEBUG::2011-01-18 19:48:00,536::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18742::DEBUG::2011-01-18 19:48:00,536::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8bf08039-392b-44cd-bf6d-814b3f12b189 releasing Thread-18742::DEBUG::2011-01-18 19:48:00,537::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18742::DEBUG::2011-01-18 19:48:00,537::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18742::DEBUG::2011-01-18 19:48:00,537::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18742::DEBUG::2011-01-18 19:48:00,537::resource::503::irs::Owner 8bf08039-392b-44cd-bf6d-814b3f12b189: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18742::DEBUG::2011-01-18 19:48:00,538::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18742::DEBUG::2011-01-18 19:48:00,538::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18742::DEBUG::2011-01-18 19:48:00,538::task::577::irs::Task 8bf08039-392b-44cd-bf6d-814b3f12b189: ref 0 aborting False Thread-18742::INFO::2011-01-18 19:48:00,539::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:48:00,839::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18743::INFO::2011-01-18 19:48:00,945::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18743::DEBUG::2011-01-18 19:48:00,946::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: moving from state init -> state preparing Thread-18743::DEBUG::2011-01-18 19:48:00,946::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c acquire shared (120000) Thread-18743::DEBUG::2011-01-18 19:48:00,946::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18743::DEBUG::2011-01-18 19:48:00,947::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9ebdfa3b-7ff7-402e-97af-270ab8a36c9c' Thread-18743::DEBUG::2011-01-18 19:48:00,947::resource::524::irs::Owner 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18743::DEBUG::2011-01-18 19:48:00,947::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18743::DEBUG::2011-01-18 19:48:00,948::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: ref 1 aborting False Thread-18743::DEBUG::2011-01-18 19:48:00,948::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0528020858765', 'lastCheck': 1295372878.583724, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0477380752563', 'lastCheck': 1295372878.7307601, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0591661930084', 'lastCheck': 1295372878.7090261, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0564529895782', 'lastCheck': 1295372878.7344379, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0490760803223', 'lastCheck': 1295372878.7219501, 'valid': True, 'code': 0}} Thread-18743::DEBUG::2011-01-18 19:48:00,949::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: moving from state preparing -> state finished Thread-18743::DEBUG::2011-01-18 19:48:00,949::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18743::DEBUG::2011-01-18 19:48:00,949::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c releasing Thread-18743::DEBUG::2011-01-18 19:48:00,950::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18743::DEBUG::2011-01-18 19:48:00,950::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18743::DEBUG::2011-01-18 19:48:00,950::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18743::DEBUG::2011-01-18 19:48:00,951::resource::503::irs::Owner 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18743::DEBUG::2011-01-18 19:48:00,951::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18743::DEBUG::2011-01-18 19:48:00,951::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18743::DEBUG::2011-01-18 19:48:00,952::task::577::irs::Task 9ebdfa3b-7ff7-402e-97af-270ab8a36c9c: ref 0 aborting False Thread-18743::INFO::2011-01-18 19:48:00,952::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0528020858765', 'lastCheck': 1295372878.583724, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0591661930084', 'lastCheck': 1295372878.7090261, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0490760803223', 'lastCheck': 1295372878.7219501, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0564529895782', 'lastCheck': 1295372878.7344379, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0477380752563', 'lastCheck': 1295372878.7307601, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:48:01,550::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.679453 seconds, 1.5 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:03,564::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:04,236::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.640298 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:06,247::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:06,944::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.664342 seconds, 1.5 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:48:08,582::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:48:08,583::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:48:08,622::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:48:08,708::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:48:08,709::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:48:08,722::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:48:08,723::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:48:08,730::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:48:08,731::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:48:08,734::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:48:08,736::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:48:08,754::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:48:08,763::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:48:08,771::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:48:08,778::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:08,957::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:09,650::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.661053 seconds, 1.5 MB/s\n'; = 0 Thread-18749::INFO::2011-01-18 19:48:10,592::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18749::DEBUG::2011-01-18 19:48:10,592::task::577::irs::Task d9e3ceba-03a8-49d5-a660-c2a343b3a253: moving from state init -> state preparing Thread-18749::DEBUG::2011-01-18 19:48:10,593::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18749::DEBUG::2011-01-18 19:48:10,625::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000624 seconds, 3.3 MB/s\n'; = 0 Thread-18749::DEBUG::2011-01-18 19:48:10,625::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000624 seconds, 3.3 MB/s'], size: 2048 Thread-18749::DEBUG::2011-01-18 19:48:10,626::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18749::DEBUG::2011-01-18 19:48:10,626::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18749::DEBUG::2011-01-18 19:48:10,627::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18749::DEBUG::2011-01-18 19:48:10,627::task::577::irs::Task d9e3ceba-03a8-49d5-a660-c2a343b3a253: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18749::DEBUG::2011-01-18 19:48:10,627::task::577::irs::Task d9e3ceba-03a8-49d5-a660-c2a343b3a253: moving from state preparing -> state finished Thread-18749::DEBUG::2011-01-18 19:48:10,628::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18749::DEBUG::2011-01-18 19:48:10,628::task::577::irs::Task d9e3ceba-03a8-49d5-a660-c2a343b3a253: ref 0 aborting False Thread-18749::INFO::2011-01-18 19:48:10,628::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18750::INFO::2011-01-18 19:48:10,637::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18750::DEBUG::2011-01-18 19:48:10,637::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: moving from state init -> state preparing Thread-18750::DEBUG::2011-01-18 19:48:10,637::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a9327409-f55b-48ae-b0da-f282d654639c acquire shared (120000) Thread-18750::DEBUG::2011-01-18 19:48:10,638::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18750::DEBUG::2011-01-18 19:48:10,638::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a9327409-f55b-48ae-b0da-f282d654639c' Thread-18750::DEBUG::2011-01-18 19:48:10,638::resource::524::irs::Owner a9327409-f55b-48ae-b0da-f282d654639c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18750::DEBUG::2011-01-18 19:48:10,639::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18750::DEBUG::2011-01-18 19:48:10,639::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: ref 1 aborting False Thread-18750::INFO::2011-01-18 19:48:10,639::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18750::DEBUG::2011-01-18 19:48:10,640::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18750::DEBUG::2011-01-18 19:48:10,640::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: moving from state preparing -> state finished Thread-18750::DEBUG::2011-01-18 19:48:10,641::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18750::DEBUG::2011-01-18 19:48:10,641::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a9327409-f55b-48ae-b0da-f282d654639c releasing Thread-18750::DEBUG::2011-01-18 19:48:10,641::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18750::DEBUG::2011-01-18 19:48:10,641::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18750::DEBUG::2011-01-18 19:48:10,642::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18750::DEBUG::2011-01-18 19:48:10,642::resource::503::irs::Owner a9327409-f55b-48ae-b0da-f282d654639c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18750::DEBUG::2011-01-18 19:48:10,642::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18750::DEBUG::2011-01-18 19:48:10,643::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18750::DEBUG::2011-01-18 19:48:10,643::task::577::irs::Task a9327409-f55b-48ae-b0da-f282d654639c: ref 0 aborting False Thread-18750::INFO::2011-01-18 19:48:10,643::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18751::INFO::2011-01-18 19:48:11,114::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18751::DEBUG::2011-01-18 19:48:11,115::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: moving from state init -> state preparing Thread-18751::DEBUG::2011-01-18 19:48:11,115::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 79b1da36-9deb-466a-8e77-bde92b2fa4e5 acquire shared (120000) Thread-18751::DEBUG::2011-01-18 19:48:11,115::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18751::DEBUG::2011-01-18 19:48:11,115::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '79b1da36-9deb-466a-8e77-bde92b2fa4e5' Thread-18751::DEBUG::2011-01-18 19:48:11,116::resource::524::irs::Owner 79b1da36-9deb-466a-8e77-bde92b2fa4e5: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18751::DEBUG::2011-01-18 19:48:11,116::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18751::DEBUG::2011-01-18 19:48:11,116::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: ref 1 aborting False Thread-18751::DEBUG::2011-01-18 19:48:11,117::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0455620288849', 'lastCheck': 1295372888.628401, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0453410148621', 'lastCheck': 1295372888.7752249, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0515558719635', 'lastCheck': 1295372888.7604029, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0521140098572', 'lastCheck': 1295372888.7861071, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0459098815918', 'lastCheck': 1295372888.767782, 'valid': True, 'code': 0}} Thread-18751::DEBUG::2011-01-18 19:48:11,117::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: moving from state preparing -> state finished Thread-18751::DEBUG::2011-01-18 19:48:11,117::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18751::DEBUG::2011-01-18 19:48:11,117::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 79b1da36-9deb-466a-8e77-bde92b2fa4e5 releasing Thread-18751::DEBUG::2011-01-18 19:48:11,118::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18751::DEBUG::2011-01-18 19:48:11,118::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18751::DEBUG::2011-01-18 19:48:11,118::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18751::DEBUG::2011-01-18 19:48:11,119::resource::503::irs::Owner 79b1da36-9deb-466a-8e77-bde92b2fa4e5: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18751::DEBUG::2011-01-18 19:48:11,119::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18751::DEBUG::2011-01-18 19:48:11,119::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18751::DEBUG::2011-01-18 19:48:11,119::task::577::irs::Task 79b1da36-9deb-466a-8e77-bde92b2fa4e5: ref 0 aborting False Thread-18751::INFO::2011-01-18 19:48:11,120::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0455620288849', 'lastCheck': 1295372888.628401, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0515558719635', 'lastCheck': 1295372888.7604029, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0459098815918', 'lastCheck': 1295372888.767782, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0521140098572', 'lastCheck': 1295372888.7861071, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0453410148621', 'lastCheck': 1295372888.7752249, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:48:11,663::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:12,284::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.588603 seconds, 1.7 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:14,297::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:14,971::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.642128 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:16,984::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:17,699::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.682862 seconds, 1.5 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:48:18,627::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:48:18,628::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:48:18,668::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:48:18,759::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:48:18,760::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:48:18,767::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:48:18,768::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:48:18,775::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:48:18,776::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:48:18,786::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:48:18,787::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:48:18,800::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:48:18,811::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:48:18,818::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:48:18,834::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:19,712::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:20,425::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.682051 seconds, 1.5 MB/s\n'; = 0 Thread-18757::INFO::2011-01-18 19:48:20,696::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18757::DEBUG::2011-01-18 19:48:20,697::task::577::irs::Task 4064242f-c829-491b-b68a-0974c5bd3f93: moving from state init -> state preparing Thread-18757::DEBUG::2011-01-18 19:48:20,697::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18757::DEBUG::2011-01-18 19:48:20,729::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.001228 seconds, 1.7 MB/s\n'; = 0 Thread-18757::DEBUG::2011-01-18 19:48:20,730::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.001228 seconds, 1.7 MB/s'], size: 2048 Thread-18757::DEBUG::2011-01-18 19:48:20,730::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18757::DEBUG::2011-01-18 19:48:20,731::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18757::DEBUG::2011-01-18 19:48:20,731::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18757::DEBUG::2011-01-18 19:48:20,731::task::577::irs::Task 4064242f-c829-491b-b68a-0974c5bd3f93: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18757::DEBUG::2011-01-18 19:48:20,732::task::577::irs::Task 4064242f-c829-491b-b68a-0974c5bd3f93: moving from state preparing -> state finished Thread-18757::DEBUG::2011-01-18 19:48:20,732::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18757::DEBUG::2011-01-18 19:48:20,732::task::577::irs::Task 4064242f-c829-491b-b68a-0974c5bd3f93: ref 0 aborting False Thread-18757::INFO::2011-01-18 19:48:20,733::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18758::INFO::2011-01-18 19:48:20,741::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18758::DEBUG::2011-01-18 19:48:20,741::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: moving from state init -> state preparing Thread-18758::DEBUG::2011-01-18 19:48:20,742::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f1c83ad3-2424-43e6-a0bd-cfcbdf16057d acquire shared (120000) Thread-18758::DEBUG::2011-01-18 19:48:20,742::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18758::DEBUG::2011-01-18 19:48:20,742::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f1c83ad3-2424-43e6-a0bd-cfcbdf16057d' Thread-18758::DEBUG::2011-01-18 19:48:20,743::resource::524::irs::Owner f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18758::DEBUG::2011-01-18 19:48:20,743::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18758::DEBUG::2011-01-18 19:48:20,743::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: ref 1 aborting False Thread-18758::INFO::2011-01-18 19:48:20,744::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18758::DEBUG::2011-01-18 19:48:20,744::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18758::DEBUG::2011-01-18 19:48:20,745::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: moving from state preparing -> state finished Thread-18758::DEBUG::2011-01-18 19:48:20,745::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18758::DEBUG::2011-01-18 19:48:20,745::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f1c83ad3-2424-43e6-a0bd-cfcbdf16057d releasing Thread-18758::DEBUG::2011-01-18 19:48:20,746::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18758::DEBUG::2011-01-18 19:48:20,746::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18758::DEBUG::2011-01-18 19:48:20,746::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18758::DEBUG::2011-01-18 19:48:20,746::resource::503::irs::Owner f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18758::DEBUG::2011-01-18 19:48:20,747::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18758::DEBUG::2011-01-18 19:48:20,747::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18758::DEBUG::2011-01-18 19:48:20,747::task::577::irs::Task f1c83ad3-2424-43e6-a0bd-cfcbdf16057d: ref 0 aborting False Thread-18758::INFO::2011-01-18 19:48:20,748::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18759::INFO::2011-01-18 19:48:21,281::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18759::DEBUG::2011-01-18 19:48:21,281::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: moving from state init -> state preparing Thread-18759::DEBUG::2011-01-18 19:48:21,281::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51 acquire shared (120000) Thread-18759::DEBUG::2011-01-18 19:48:21,282::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18759::DEBUG::2011-01-18 19:48:21,282::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51' Thread-18759::DEBUG::2011-01-18 19:48:21,282::resource::524::irs::Owner b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18759::DEBUG::2011-01-18 19:48:21,282::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18759::DEBUG::2011-01-18 19:48:21,283::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: ref 1 aborting False Thread-18759::DEBUG::2011-01-18 19:48:21,283::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451128482819', 'lastCheck': 1295372898.6729529, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047611951828', 'lastCheck': 1295372898.8225, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0469470024109', 'lastCheck': 1295372898.8067939, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0569689273834', 'lastCheck': 1295372898.842932, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0486299991608', 'lastCheck': 1295372898.81549, 'valid': True, 'code': 0}} Thread-18759::DEBUG::2011-01-18 19:48:21,283::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: moving from state preparing -> state finished Thread-18759::DEBUG::2011-01-18 19:48:21,284::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18759::DEBUG::2011-01-18 19:48:21,284::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51 releasing Thread-18759::DEBUG::2011-01-18 19:48:21,284::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18759::DEBUG::2011-01-18 19:48:21,285::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18759::DEBUG::2011-01-18 19:48:21,285::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18759::DEBUG::2011-01-18 19:48:21,285::resource::503::irs::Owner b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18759::DEBUG::2011-01-18 19:48:21,285::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18759::DEBUG::2011-01-18 19:48:21,286::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18759::DEBUG::2011-01-18 19:48:21,286::task::577::irs::Task b3ccedaf-8b55-4d9e-bbf4-7e5717cdaf51: ref 0 aborting False Thread-18759::INFO::2011-01-18 19:48:21,286::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451128482819', 'lastCheck': 1295372898.6729529, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0469470024109', 'lastCheck': 1295372898.8067939, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0486299991608', 'lastCheck': 1295372898.81549, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0569689273834', 'lastCheck': 1295372898.842932, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047611951828', 'lastCheck': 1295372898.8225, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:48:22,438::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:23,106::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.636384 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:25,120::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:25,690::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.537985 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:27,702::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:28,264::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.529345 seconds, 1.9 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:48:28,672::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:48:28,673::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:48:28,712::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:48:28,806::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:48:28,807::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:48:28,815::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:48:28,816::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:48:28,822::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:48:28,823::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:48:28,843::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:48:28,844::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:48:28,848::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:48:28,859::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:48:28,863::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:48:28,884::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:30,277::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18765::INFO::2011-01-18 19:48:30,801::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18765::DEBUG::2011-01-18 19:48:30,802::task::577::irs::Task d1eba56b-000f-43d5-b6a4-946a290bfbb7: moving from state init -> state preparing Thread-18765::DEBUG::2011-01-18 19:48:30,802::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18765::DEBUG::2011-01-18 19:48:30,835::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000846 seconds, 2.4 MB/s\n'; = 0 Thread-18765::DEBUG::2011-01-18 19:48:30,836::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000846 seconds, 2.4 MB/s'], size: 2048 Thread-18765::DEBUG::2011-01-18 19:48:30,836::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Dummy-18546::DEBUG::2011-01-18 19:48:30,838::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.528071 seconds, 1.9 MB/s\n'; = 0 Thread-18765::DEBUG::2011-01-18 19:48:30,838::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18765::DEBUG::2011-01-18 19:48:30,852::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18765::DEBUG::2011-01-18 19:48:30,853::task::577::irs::Task d1eba56b-000f-43d5-b6a4-946a290bfbb7: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18765::DEBUG::2011-01-18 19:48:30,853::task::577::irs::Task d1eba56b-000f-43d5-b6a4-946a290bfbb7: moving from state preparing -> state finished Thread-18765::DEBUG::2011-01-18 19:48:30,853::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18765::DEBUG::2011-01-18 19:48:30,854::task::577::irs::Task d1eba56b-000f-43d5-b6a4-946a290bfbb7: ref 0 aborting False Thread-18765::INFO::2011-01-18 19:48:30,854::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18766::INFO::2011-01-18 19:48:30,862::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18766::DEBUG::2011-01-18 19:48:30,862::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: moving from state init -> state preparing Thread-18766::DEBUG::2011-01-18 19:48:30,863::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b98c0142-c03e-4b5e-b267-c01eefee5f6c acquire shared (120000) Thread-18766::DEBUG::2011-01-18 19:48:30,863::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18766::DEBUG::2011-01-18 19:48:30,863::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b98c0142-c03e-4b5e-b267-c01eefee5f6c' Thread-18766::DEBUG::2011-01-18 19:48:30,864::resource::524::irs::Owner b98c0142-c03e-4b5e-b267-c01eefee5f6c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18766::DEBUG::2011-01-18 19:48:30,864::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18766::DEBUG::2011-01-18 19:48:30,864::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: ref 1 aborting False Thread-18766::INFO::2011-01-18 19:48:30,865::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18766::DEBUG::2011-01-18 19:48:30,865::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18766::DEBUG::2011-01-18 19:48:30,866::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: moving from state preparing -> state finished Thread-18766::DEBUG::2011-01-18 19:48:30,866::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18766::DEBUG::2011-01-18 19:48:30,866::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b98c0142-c03e-4b5e-b267-c01eefee5f6c releasing Thread-18766::DEBUG::2011-01-18 19:48:30,867::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18766::DEBUG::2011-01-18 19:48:30,867::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18766::DEBUG::2011-01-18 19:48:30,867::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18766::DEBUG::2011-01-18 19:48:30,868::resource::503::irs::Owner b98c0142-c03e-4b5e-b267-c01eefee5f6c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18766::DEBUG::2011-01-18 19:48:30,868::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18766::DEBUG::2011-01-18 19:48:30,868::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18766::DEBUG::2011-01-18 19:48:30,868::task::577::irs::Task b98c0142-c03e-4b5e-b267-c01eefee5f6c: ref 0 aborting False Thread-18766::INFO::2011-01-18 19:48:30,869::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18767::INFO::2011-01-18 19:48:31,444::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18767::DEBUG::2011-01-18 19:48:31,445::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: moving from state init -> state preparing Thread-18767::DEBUG::2011-01-18 19:48:31,445::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f594cf1e-f918-456c-b70a-2765b12867ad acquire shared (120000) Thread-18767::DEBUG::2011-01-18 19:48:31,445::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18767::DEBUG::2011-01-18 19:48:31,446::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f594cf1e-f918-456c-b70a-2765b12867ad' Thread-18767::DEBUG::2011-01-18 19:48:31,446::resource::524::irs::Owner f594cf1e-f918-456c-b70a-2765b12867ad: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18767::DEBUG::2011-01-18 19:48:31,446::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18767::DEBUG::2011-01-18 19:48:31,446::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: ref 1 aborting False Thread-18767::DEBUG::2011-01-18 19:48:31,447::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0441670417786', 'lastCheck': 1295372908.717016, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0456581115723', 'lastCheck': 1295372908.8675411, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.046541929245', 'lastCheck': 1295372908.853389, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0456600189209', 'lastCheck': 1295372908.8885641, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0492188930511', 'lastCheck': 1295372908.8640909, 'valid': True, 'code': 0}} Thread-18767::DEBUG::2011-01-18 19:48:31,447::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: moving from state preparing -> state finished Thread-18767::DEBUG::2011-01-18 19:48:31,447::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18767::DEBUG::2011-01-18 19:48:31,448::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f594cf1e-f918-456c-b70a-2765b12867ad releasing Thread-18767::DEBUG::2011-01-18 19:48:31,448::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18767::DEBUG::2011-01-18 19:48:31,448::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18767::DEBUG::2011-01-18 19:48:31,449::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18767::DEBUG::2011-01-18 19:48:31,449::resource::503::irs::Owner f594cf1e-f918-456c-b70a-2765b12867ad: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18767::DEBUG::2011-01-18 19:48:31,449::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18767::DEBUG::2011-01-18 19:48:31,449::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18767::DEBUG::2011-01-18 19:48:31,450::task::577::irs::Task f594cf1e-f918-456c-b70a-2765b12867ad: ref 0 aborting False Thread-18767::INFO::2011-01-18 19:48:31,450::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0441670417786', 'lastCheck': 1295372908.717016, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.046541929245', 'lastCheck': 1295372908.853389, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0492188930511', 'lastCheck': 1295372908.8640909, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0456600189209', 'lastCheck': 1295372908.8885641, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0456581115723', 'lastCheck': 1295372908.8675411, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:48:32,852::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:33,436::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.551258 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:35,448::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:36,049::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.568348 seconds, 1.8 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:38,062::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:38,595::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501597 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:48:38,716::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:48:38,717::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:48:38,757::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:48:38,853::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:48:38,854::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:48:38,864::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:48:38,865::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:48:38,867::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:48:38,868::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:48:38,888::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:48:38,889::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:48:38,893::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:48:38,908::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:48:38,909::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:48:38,930::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:40,609::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18773::INFO::2011-01-18 19:48:40,922::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18773::DEBUG::2011-01-18 19:48:40,923::task::577::irs::Task e35eda18-8653-41e4-a3d2-2962b8ca46a5: moving from state init -> state preparing Thread-18773::DEBUG::2011-01-18 19:48:40,924::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18773::DEBUG::2011-01-18 19:48:40,956::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000412 seconds, 5.0 MB/s\n'; = 0 Thread-18773::DEBUG::2011-01-18 19:48:40,957::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000412 seconds, 5.0 MB/s'], size: 2048 Thread-18773::DEBUG::2011-01-18 19:48:40,957::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18773::DEBUG::2011-01-18 19:48:40,958::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18773::DEBUG::2011-01-18 19:48:40,958::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18773::DEBUG::2011-01-18 19:48:40,959::task::577::irs::Task e35eda18-8653-41e4-a3d2-2962b8ca46a5: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18773::DEBUG::2011-01-18 19:48:40,959::task::577::irs::Task e35eda18-8653-41e4-a3d2-2962b8ca46a5: moving from state preparing -> state finished Thread-18773::DEBUG::2011-01-18 19:48:40,959::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18773::DEBUG::2011-01-18 19:48:40,960::task::577::irs::Task e35eda18-8653-41e4-a3d2-2962b8ca46a5: ref 0 aborting False Thread-18773::INFO::2011-01-18 19:48:40,960::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18774::INFO::2011-01-18 19:48:40,968::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18774::DEBUG::2011-01-18 19:48:40,969::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: moving from state init -> state preparing Thread-18774::DEBUG::2011-01-18 19:48:40,969::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 05461d85-8691-4cff-9376-4683f7d299ba acquire shared (120000) Thread-18774::DEBUG::2011-01-18 19:48:40,970::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18774::DEBUG::2011-01-18 19:48:40,970::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '05461d85-8691-4cff-9376-4683f7d299ba' Thread-18774::DEBUG::2011-01-18 19:48:40,970::resource::524::irs::Owner 05461d85-8691-4cff-9376-4683f7d299ba: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18774::DEBUG::2011-01-18 19:48:40,970::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18774::DEBUG::2011-01-18 19:48:40,971::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: ref 1 aborting False Thread-18774::INFO::2011-01-18 19:48:40,971::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18774::DEBUG::2011-01-18 19:48:40,972::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18774::DEBUG::2011-01-18 19:48:40,972::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: moving from state preparing -> state finished Thread-18774::DEBUG::2011-01-18 19:48:40,973::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18774::DEBUG::2011-01-18 19:48:40,973::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 05461d85-8691-4cff-9376-4683f7d299ba releasing Thread-18774::DEBUG::2011-01-18 19:48:40,973::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18774::DEBUG::2011-01-18 19:48:40,974::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18774::DEBUG::2011-01-18 19:48:40,974::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18774::DEBUG::2011-01-18 19:48:40,974::resource::503::irs::Owner 05461d85-8691-4cff-9376-4683f7d299ba: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18774::DEBUG::2011-01-18 19:48:40,975::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18774::DEBUG::2011-01-18 19:48:40,975::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18774::DEBUG::2011-01-18 19:48:40,975::task::577::irs::Task 05461d85-8691-4cff-9376-4683f7d299ba: ref 0 aborting False Thread-18774::INFO::2011-01-18 19:48:40,975::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:48:41,159::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.518238 seconds, 2.0 MB/s\n'; = 0 Thread-18775::INFO::2011-01-18 19:48:41,698::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18775::DEBUG::2011-01-18 19:48:41,698::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: moving from state init -> state preparing Thread-18775::DEBUG::2011-01-18 19:48:41,699::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c933d4a3-5b5a-4715-b30a-07a93eaaf82b acquire shared (120000) Thread-18775::DEBUG::2011-01-18 19:48:41,699::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18775::DEBUG::2011-01-18 19:48:41,699::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c933d4a3-5b5a-4715-b30a-07a93eaaf82b' Thread-18775::DEBUG::2011-01-18 19:48:41,700::resource::524::irs::Owner c933d4a3-5b5a-4715-b30a-07a93eaaf82b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18775::DEBUG::2011-01-18 19:48:41,700::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18775::DEBUG::2011-01-18 19:48:41,700::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: ref 1 aborting False Thread-18775::DEBUG::2011-01-18 19:48:41,700::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452671051025', 'lastCheck': 1295372918.7621191, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.046049118042', 'lastCheck': 1295372918.9131351, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0449402332306', 'lastCheck': 1295372918.8987851, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0474519729614', 'lastCheck': 1295372918.9353459, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0502150058746', 'lastCheck': 1295372918.9141181, 'valid': True, 'code': 0}} Thread-18775::DEBUG::2011-01-18 19:48:41,701::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: moving from state preparing -> state finished Thread-18775::DEBUG::2011-01-18 19:48:41,701::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18775::DEBUG::2011-01-18 19:48:41,701::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c933d4a3-5b5a-4715-b30a-07a93eaaf82b releasing Thread-18775::DEBUG::2011-01-18 19:48:41,702::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18775::DEBUG::2011-01-18 19:48:41,702::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18775::DEBUG::2011-01-18 19:48:41,702::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18775::DEBUG::2011-01-18 19:48:41,702::resource::503::irs::Owner c933d4a3-5b5a-4715-b30a-07a93eaaf82b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18775::DEBUG::2011-01-18 19:48:41,703::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18775::DEBUG::2011-01-18 19:48:41,703::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18775::DEBUG::2011-01-18 19:48:41,703::task::577::irs::Task c933d4a3-5b5a-4715-b30a-07a93eaaf82b: ref 0 aborting False Thread-18775::INFO::2011-01-18 19:48:41,704::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452671051025', 'lastCheck': 1295372918.7621191, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0449402332306', 'lastCheck': 1295372918.8987851, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0502150058746', 'lastCheck': 1295372918.9141181, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0474519729614', 'lastCheck': 1295372918.9353459, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.046049118042', 'lastCheck': 1295372918.9131351, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:48:43,172::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:43,737::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.533559 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:45,751::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:46,284::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501032 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:48,299::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:48:48,762::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:48:48,762::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:48:48,807::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:48,840::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509036 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 19:48:48,897::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:48:48,898::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:48:48,913::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:48:48,914::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:48:48,914::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:48:48,915::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:48:48,935::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:48:48,936::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:48:48,939::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:48:48,957::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:48:48,957::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:48:48,976::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:50,853::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18781::INFO::2011-01-18 19:48:51,030::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18781::DEBUG::2011-01-18 19:48:51,030::task::577::irs::Task 9200d818-c030-4670-8747-097a62798e79: moving from state init -> state preparing Thread-18781::DEBUG::2011-01-18 19:48:51,031::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18781::DEBUG::2011-01-18 19:48:51,063::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000969 seconds, 2.1 MB/s\n'; = 0 Thread-18781::DEBUG::2011-01-18 19:48:51,064::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000969 seconds, 2.1 MB/s'], size: 2048 Thread-18781::DEBUG::2011-01-18 19:48:51,064::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18781::DEBUG::2011-01-18 19:48:51,065::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18781::DEBUG::2011-01-18 19:48:51,065::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18781::DEBUG::2011-01-18 19:48:51,066::task::577::irs::Task 9200d818-c030-4670-8747-097a62798e79: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18781::DEBUG::2011-01-18 19:48:51,066::task::577::irs::Task 9200d818-c030-4670-8747-097a62798e79: moving from state preparing -> state finished Thread-18781::DEBUG::2011-01-18 19:48:51,066::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18781::DEBUG::2011-01-18 19:48:51,067::task::577::irs::Task 9200d818-c030-4670-8747-097a62798e79: ref 0 aborting False Thread-18781::INFO::2011-01-18 19:48:51,067::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18782::INFO::2011-01-18 19:48:51,077::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18782::DEBUG::2011-01-18 19:48:51,077::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: moving from state init -> state preparing Thread-18782::DEBUG::2011-01-18 19:48:51,077::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5a9922a7-fb25-4f5a-b26f-4664f22012e2 acquire shared (120000) Thread-18782::DEBUG::2011-01-18 19:48:51,078::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18782::DEBUG::2011-01-18 19:48:51,078::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5a9922a7-fb25-4f5a-b26f-4664f22012e2' Thread-18782::DEBUG::2011-01-18 19:48:51,078::resource::524::irs::Owner 5a9922a7-fb25-4f5a-b26f-4664f22012e2: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18782::DEBUG::2011-01-18 19:48:51,079::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18782::DEBUG::2011-01-18 19:48:51,079::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: ref 1 aborting False Thread-18782::INFO::2011-01-18 19:48:51,080::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18782::DEBUG::2011-01-18 19:48:51,081::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18782::DEBUG::2011-01-18 19:48:51,081::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: moving from state preparing -> state finished Thread-18782::DEBUG::2011-01-18 19:48:51,082::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18782::DEBUG::2011-01-18 19:48:51,082::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5a9922a7-fb25-4f5a-b26f-4664f22012e2 releasing Thread-18782::DEBUG::2011-01-18 19:48:51,082::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18782::DEBUG::2011-01-18 19:48:51,083::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18782::DEBUG::2011-01-18 19:48:51,083::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18782::DEBUG::2011-01-18 19:48:51,083::resource::503::irs::Owner 5a9922a7-fb25-4f5a-b26f-4664f22012e2: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18782::DEBUG::2011-01-18 19:48:51,084::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18782::DEBUG::2011-01-18 19:48:51,084::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18782::DEBUG::2011-01-18 19:48:51,085::task::577::irs::Task 5a9922a7-fb25-4f5a-b26f-4664f22012e2: ref 0 aborting False Thread-18782::INFO::2011-01-18 19:48:51,085::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:48:51,400::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514578 seconds, 2.0 MB/s\n'; = 0 Thread-18783::INFO::2011-01-18 19:48:51,868::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18783::DEBUG::2011-01-18 19:48:51,868::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: moving from state init -> state preparing Thread-18783::DEBUG::2011-01-18 19:48:51,868::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9a7e874f-af06-4b9a-8626-e6f69ee9e49a acquire shared (120000) Thread-18783::DEBUG::2011-01-18 19:48:51,869::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18783::DEBUG::2011-01-18 19:48:51,869::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9a7e874f-af06-4b9a-8626-e6f69ee9e49a' Thread-18783::DEBUG::2011-01-18 19:48:51,869::resource::524::irs::Owner 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18783::DEBUG::2011-01-18 19:48:51,869::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18783::DEBUG::2011-01-18 19:48:51,870::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: ref 1 aborting False Thread-18783::DEBUG::2011-01-18 19:48:51,870::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0509831905365', 'lastCheck': 1295372928.8128381, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0497570037842', 'lastCheck': 1295372928.9626241, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0465080738068', 'lastCheck': 1295372928.944356, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463960170746', 'lastCheck': 1295372928.981276, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0477769374847', 'lastCheck': 1295372928.9621329, 'valid': True, 'code': 0}} Thread-18783::DEBUG::2011-01-18 19:48:51,870::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: moving from state preparing -> state finished Thread-18783::DEBUG::2011-01-18 19:48:51,871::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18783::DEBUG::2011-01-18 19:48:51,871::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9a7e874f-af06-4b9a-8626-e6f69ee9e49a releasing Thread-18783::DEBUG::2011-01-18 19:48:51,871::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18783::DEBUG::2011-01-18 19:48:51,872::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18783::DEBUG::2011-01-18 19:48:51,872::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18783::DEBUG::2011-01-18 19:48:51,872::resource::503::irs::Owner 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18783::DEBUG::2011-01-18 19:48:51,872::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18783::DEBUG::2011-01-18 19:48:51,873::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18783::DEBUG::2011-01-18 19:48:51,873::task::577::irs::Task 9a7e874f-af06-4b9a-8626-e6f69ee9e49a: ref 0 aborting False Thread-18783::INFO::2011-01-18 19:48:51,873::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0509831905365', 'lastCheck': 1295372928.8128381, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0465080738068', 'lastCheck': 1295372928.944356, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0477769374847', 'lastCheck': 1295372928.9621329, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463960170746', 'lastCheck': 1295372928.981276, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0497570037842', 'lastCheck': 1295372928.9626241, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:48:53,412::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:53,948::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504122 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:55,963::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:48:56,496::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500976 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:58,509::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:48:58,813::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:48:58,814::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:48:58,944::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:48:58,944::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:48:58,962::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18497::INFO::2011-01-18 19:48:58,962::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::DEBUG::2011-01-18 19:48:58,963::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:48:58,964::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:48:58,981::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:48:58,982::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:48:59,024::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:48:59,025::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:48:59,026::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:48:59,027::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:48:59,029::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:48:59,062::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.520292 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:01,074::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18789::INFO::2011-01-18 19:49:01,139::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18789::DEBUG::2011-01-18 19:49:01,139::task::577::irs::Task f1072e99-8363-4854-8306-b46cf54842eb: moving from state init -> state preparing Thread-18789::DEBUG::2011-01-18 19:49:01,140::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18789::DEBUG::2011-01-18 19:49:01,174::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000894 seconds, 2.3 MB/s\n'; = 0 Thread-18789::DEBUG::2011-01-18 19:49:01,175::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000894 seconds, 2.3 MB/s'], size: 2048 Thread-18789::DEBUG::2011-01-18 19:49:01,175::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18789::DEBUG::2011-01-18 19:49:01,175::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18789::DEBUG::2011-01-18 19:49:01,176::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18789::DEBUG::2011-01-18 19:49:01,176::task::577::irs::Task f1072e99-8363-4854-8306-b46cf54842eb: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18789::DEBUG::2011-01-18 19:49:01,177::task::577::irs::Task f1072e99-8363-4854-8306-b46cf54842eb: moving from state preparing -> state finished Thread-18789::DEBUG::2011-01-18 19:49:01,177::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18789::DEBUG::2011-01-18 19:49:01,178::task::577::irs::Task f1072e99-8363-4854-8306-b46cf54842eb: ref 0 aborting False Thread-18789::INFO::2011-01-18 19:49:01,178::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18790::INFO::2011-01-18 19:49:01,186::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18790::DEBUG::2011-01-18 19:49:01,187::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: moving from state init -> state preparing Thread-18790::DEBUG::2011-01-18 19:49:01,187::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5538d491-76e6-4313-9720-a612d891f23c acquire shared (120000) Thread-18790::DEBUG::2011-01-18 19:49:01,187::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18790::DEBUG::2011-01-18 19:49:01,188::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5538d491-76e6-4313-9720-a612d891f23c' Thread-18790::DEBUG::2011-01-18 19:49:01,188::resource::524::irs::Owner 5538d491-76e6-4313-9720-a612d891f23c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18790::DEBUG::2011-01-18 19:49:01,188::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18790::DEBUG::2011-01-18 19:49:01,188::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: ref 1 aborting False Thread-18790::INFO::2011-01-18 19:49:01,189::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18790::DEBUG::2011-01-18 19:49:01,190::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18790::DEBUG::2011-01-18 19:49:01,190::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: moving from state preparing -> state finished Thread-18790::DEBUG::2011-01-18 19:49:01,191::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18790::DEBUG::2011-01-18 19:49:01,191::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5538d491-76e6-4313-9720-a612d891f23c releasing Thread-18790::DEBUG::2011-01-18 19:49:01,191::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18790::DEBUG::2011-01-18 19:49:01,191::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18790::DEBUG::2011-01-18 19:49:01,192::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18790::DEBUG::2011-01-18 19:49:01,192::resource::503::irs::Owner 5538d491-76e6-4313-9720-a612d891f23c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18790::DEBUG::2011-01-18 19:49:01,192::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18790::DEBUG::2011-01-18 19:49:01,193::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18790::DEBUG::2011-01-18 19:49:01,193::task::577::irs::Task 5538d491-76e6-4313-9720-a612d891f23c: ref 0 aborting False Thread-18790::INFO::2011-01-18 19:49:01,193::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:49:01,618::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511224 seconds, 2.0 MB/s\n'; = 0 Thread-18791::INFO::2011-01-18 19:49:02,047::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18791::DEBUG::2011-01-18 19:49:02,047::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: moving from state init -> state preparing Thread-18791::DEBUG::2011-01-18 19:49:02,047::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 64b04dac-c439-4cef-8373-00b5bdbcaf44 acquire shared (120000) Thread-18791::DEBUG::2011-01-18 19:49:02,047::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18791::DEBUG::2011-01-18 19:49:02,048::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '64b04dac-c439-4cef-8373-00b5bdbcaf44' Thread-18791::DEBUG::2011-01-18 19:49:02,048::resource::524::irs::Owner 64b04dac-c439-4cef-8373-00b5bdbcaf44: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18791::DEBUG::2011-01-18 19:49:02,048::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18791::DEBUG::2011-01-18 19:49:02,049::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: ref 1 aborting False Thread-18791::DEBUG::2011-01-18 19:49:02,049::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.220446109772', 'lastCheck': 1295372939.0333071, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0707859992981', 'lastCheck': 1295372939.0326869, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0918819904327', 'lastCheck': 1295372939.0357339, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0541439056396', 'lastCheck': 1295372939.0350549, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0731868743896', 'lastCheck': 1295372939.035893, 'valid': True, 'code': 0}} Thread-18791::DEBUG::2011-01-18 19:49:02,049::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: moving from state preparing -> state finished Thread-18791::DEBUG::2011-01-18 19:49:02,050::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18791::DEBUG::2011-01-18 19:49:02,050::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 64b04dac-c439-4cef-8373-00b5bdbcaf44 releasing Thread-18791::DEBUG::2011-01-18 19:49:02,050::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18791::DEBUG::2011-01-18 19:49:02,050::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18791::DEBUG::2011-01-18 19:49:02,051::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18791::DEBUG::2011-01-18 19:49:02,051::resource::503::irs::Owner 64b04dac-c439-4cef-8373-00b5bdbcaf44: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18791::DEBUG::2011-01-18 19:49:02,051::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18791::DEBUG::2011-01-18 19:49:02,051::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18791::DEBUG::2011-01-18 19:49:02,052::task::577::irs::Task 64b04dac-c439-4cef-8373-00b5bdbcaf44: ref 0 aborting False Thread-18791::INFO::2011-01-18 19:49:02,052::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.220446109772', 'lastCheck': 1295372939.0333071, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0918819904327', 'lastCheck': 1295372939.0357339, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0731868743896', 'lastCheck': 1295372939.035893, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0541439056396', 'lastCheck': 1295372939.0350549, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0707859992981', 'lastCheck': 1295372939.0326869, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:49:03,631::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:04,167::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503867 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:06,180::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:06,716::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504412 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:08,728::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18494::INFO::2011-01-18 19:49:09,032::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:49:09,033::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:49:09,033::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:49:09,034::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:49:09,038::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18495::INFO::2011-01-18 19:49:09,039::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::INFO::2011-01-18 19:49:09,039::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::DEBUG::2011-01-18 19:49:09,044::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:49:09,046::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:49:09,046::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:49:09,083::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:49:09,084::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata count=1' (cwd None) Thread-18493::DEBUG::2011-01-18 19:49:09,085::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:49:09,089::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:09,093::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:49:09,094::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:09,095::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata count=1' (cwd None) Thread-18497::DEBUG::2011-01-18 19:49:09,100::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata count=1' (cwd None) Thread-18494::DEBUG::2011-01-18 19:49:09,120::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000517 seconds, 4.0 MB/s\n'; = 0 Thread-18494::DEBUG::2011-01-18 19:49:09,121::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000517 seconds, 4.0 MB/s'], size: 2048 Thread-18494::DEBUG::2011-01-18 19:49:09,121::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=None', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE0,uuid:JhuxXz-oY2f-VTKM-jZw1-vjeb-1yfc-4DEMhe,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE1,uuid:3aUVw3-VXRN-GbIT-jnEQ-RmUc-Kqcf-cj2Q3x,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE2,uuid:OFmc1C-VUM2-UeEr-4PaC-e2G4-YjTo-0aIgd3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE3,uuid:kyzPWM-1lW2-zYaO-2BIR-W66P-XrsG-fpehsp,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE4,uuid:EacnTZ-z822-xe9v-9t6A-1u3S-t96k-bOlSQM,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE5,uuid:N8Yas4-g1Rl-y3qt-Zb1d-t4ty-y8Iv-5LxYUR,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE6,uuid:aAF0AR-v83k-qND9-ZwAN-3p89-o9p0-rAF1zi,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE7,uuid:Qf3LTH-Ai55-3Lp0-FKFJ-zmfX-yyf8-yEyqIf,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=zSkJHd-z2vi-SfdH-OmXK-HHD2-HSSF-I7j139', 'MASTER_VERSION=0', '_SHA_CKSUM=6ac9d8deed2c8198ad87a15fde0e9be690649fe9'] Thread-18494::DEBUG::2011-01-18 19:49:09,122::metadata::89::irs::metadata.__validate() __cksum(md) = 6ac9d8deed2c8198ad87a15fde0e9be690649fe9 Thread-18496::DEBUG::2011-01-18 19:49:09,131::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000431 seconds, 4.8 MB/s\n'; = 0 Thread-18496::DEBUG::2011-01-18 19:49:09,131::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000431 seconds, 4.8 MB/s'], size: 2048 Thread-18496::DEBUG::2011-01-18 19:49:09,132::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_5', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE30,uuid:6OMUem-Ea8u-ePsj-ZtiI-PS2g-9lar-vDE1yw,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE31,uuid:rp1dI7-UPsb-ZzJX-eptN-usNA-7bhM-O2aeC0,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE32,uuid:REuolt-m2qg-IguX-yQ6Q-a88i-QbOk-KfxuNR,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE33,uuid:auCyUI-Qzi4-nPej-g5ji-3O7c-PNdD-YSr4HX,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE34,uuid:nxQIzE-gINr-2WGk-fBFz-xWdc-VKpc-0AkgEu,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE35,uuid:9rYRaB-6vqa-jeNi-8d70-Olyy-x5FR-Sfd9rm,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE36,uuid:aj40O1-nJLf-RfMK-vPfA-zy3M-CGZP-gFOulR,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE37,uuid:vCUrIv-sXPe-09Ze-EYzV-cj0C-67iG-ukcW5V,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=YlGdeL-gaDB-Es97-ogbJ-3LdW-crm3-jWw9cH', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=f0ac78701aec46eb830881e3c6db5e3fa21ea53c'] Thread-18496::DEBUG::2011-01-18 19:49:09,133::metadata::89::irs::metadata.__validate() __cksum(md) = f0ac78701aec46eb830881e3c6db5e3fa21ea53c Thread-18497::DEBUG::2011-01-18 19:49:09,133::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0004 seconds, 5.1 MB/s\n'; = 0 Thread-18497::DEBUG::2011-01-18 19:49:09,134::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0004 seconds, 5.1 MB/s'], size: 2048 Thread-18497::DEBUG::2011-01-18 19:49:09,134::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_4', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE25,uuid:oT9Njr-43C6-OFn2-Pb1m-OHmv-q1ko-qWVZfU,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE24,uuid:zAhT6X-lhHA-0tpM-y8Ir-qdYz-cToH-QS34Qd,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE26,uuid:iai1Ih-p3aO-aJfa-m0Vu-bbUI-Bzmt-faQpU3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE27,uuid:Po2nTz-ZVf1-9CUn-XrvV-KFvh-bVc0-0UlRfc,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE28,uuid:7RfWRw-dleE-FJGk-unwH-mCIt-vjvO-cFlwEV,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE29,uuid:o0eNOA-eXTU-lOuo-1pOl-S9Kc-t3SS-qmqoxq,pestart:0,pecount:95,mapoffset:475', 'ROLE=Regular', 'SDUUID=d36e088c-e33f-41c9-9799-60f27d683f24', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=Rg9Ok4-Ts62-7x69-dnoq-vXMJ-1kxr-7V4hzD', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=506390723e870e52d768c8a93509b36b71d536b4'] Thread-18497::DEBUG::2011-01-18 19:49:09,135::metadata::89::irs::metadata.__validate() __cksum(md) = 506390723e870e52d768c8a93509b36b71d536b4 Dummy-18546::DEBUG::2011-01-18 19:49:09,287::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.527256 seconds, 1.9 MB/s\n'; = 0 Thread-18797::INFO::2011-01-18 19:49:11,248::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18797::DEBUG::2011-01-18 19:49:11,248::task::577::irs::Task b2330013-83f4-4327-acf4-368fffc2d193: moving from state init -> state preparing Thread-18797::DEBUG::2011-01-18 19:49:11,248::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18797::DEBUG::2011-01-18 19:49:11,280::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000416 seconds, 4.9 MB/s\n'; = 0 Thread-18797::DEBUG::2011-01-18 19:49:11,281::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000416 seconds, 4.9 MB/s'], size: 2048 Thread-18797::DEBUG::2011-01-18 19:49:11,281::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18797::DEBUG::2011-01-18 19:49:11,282::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18797::DEBUG::2011-01-18 19:49:11,282::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18797::DEBUG::2011-01-18 19:49:11,283::task::577::irs::Task b2330013-83f4-4327-acf4-368fffc2d193: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18797::DEBUG::2011-01-18 19:49:11,283::task::577::irs::Task b2330013-83f4-4327-acf4-368fffc2d193: moving from state preparing -> state finished Thread-18797::DEBUG::2011-01-18 19:49:11,283::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18797::DEBUG::2011-01-18 19:49:11,284::task::577::irs::Task b2330013-83f4-4327-acf4-368fffc2d193: ref 0 aborting False Thread-18797::INFO::2011-01-18 19:49:11,284::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18798::INFO::2011-01-18 19:49:11,292::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18798::DEBUG::2011-01-18 19:49:11,292::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: moving from state init -> state preparing Thread-18798::DEBUG::2011-01-18 19:49:11,293::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8c958c9-420d-4e31-be5b-09e97d9d0581 acquire shared (120000) Thread-18798::DEBUG::2011-01-18 19:49:11,293::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18798::DEBUG::2011-01-18 19:49:11,293::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f8c958c9-420d-4e31-be5b-09e97d9d0581' Thread-18798::DEBUG::2011-01-18 19:49:11,294::resource::524::irs::Owner f8c958c9-420d-4e31-be5b-09e97d9d0581: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18798::DEBUG::2011-01-18 19:49:11,294::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18798::DEBUG::2011-01-18 19:49:11,294::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: ref 1 aborting False Thread-18798::INFO::2011-01-18 19:49:11,295::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18798::DEBUG::2011-01-18 19:49:11,295::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18798::DEBUG::2011-01-18 19:49:11,296::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: moving from state preparing -> state finished Thread-18798::DEBUG::2011-01-18 19:49:11,296::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18798::DEBUG::2011-01-18 19:49:11,296::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8c958c9-420d-4e31-be5b-09e97d9d0581 releasing Thread-18798::DEBUG::2011-01-18 19:49:11,297::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18798::DEBUG::2011-01-18 19:49:11,297::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18798::DEBUG::2011-01-18 19:49:11,297::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18798::DEBUG::2011-01-18 19:49:11,297::resource::503::irs::Owner f8c958c9-420d-4e31-be5b-09e97d9d0581: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18798::DEBUG::2011-01-18 19:49:11,298::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18798::DEBUG::2011-01-18 19:49:11,298::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18798::DEBUG::2011-01-18 19:49:11,298::task::577::irs::Task f8c958c9-420d-4e31-be5b-09e97d9d0581: ref 0 aborting False Thread-18798::INFO::2011-01-18 19:49:11,298::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:49:11,303::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:11,844::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510271 seconds, 2.0 MB/s\n'; = 0 Thread-18799::INFO::2011-01-18 19:49:12,211::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18799::DEBUG::2011-01-18 19:49:12,212::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: moving from state init -> state preparing Thread-18799::DEBUG::2011-01-18 19:49:12,212::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a55f6b5f-ea1c-4d19-9165-c8f7232e9160 acquire shared (120000) Thread-18799::DEBUG::2011-01-18 19:49:12,212::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18799::DEBUG::2011-01-18 19:49:12,212::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a55f6b5f-ea1c-4d19-9165-c8f7232e9160' Thread-18799::DEBUG::2011-01-18 19:49:12,213::resource::524::irs::Owner a55f6b5f-ea1c-4d19-9165-c8f7232e9160: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18799::DEBUG::2011-01-18 19:49:12,213::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18799::DEBUG::2011-01-18 19:49:12,213::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: ref 1 aborting False Thread-18799::DEBUG::2011-01-18 19:49:12,214::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0595510005951', 'lastCheck': 1295372949.09287, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0947668552399', 'lastCheck': 1295372949.1266229, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0608229637146', 'lastCheck': 1295372949.0997081, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.100084066391', 'lastCheck': 1295372949.1381431, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0986261367798', 'lastCheck': 1295372949.1379011, 'valid': True, 'code': 0}} Thread-18799::DEBUG::2011-01-18 19:49:12,214::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: moving from state preparing -> state finished Thread-18799::DEBUG::2011-01-18 19:49:12,214::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18799::DEBUG::2011-01-18 19:49:12,215::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a55f6b5f-ea1c-4d19-9165-c8f7232e9160 releasing Thread-18799::DEBUG::2011-01-18 19:49:12,215::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18799::DEBUG::2011-01-18 19:49:12,215::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18799::DEBUG::2011-01-18 19:49:12,216::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18799::DEBUG::2011-01-18 19:49:12,216::resource::503::irs::Owner a55f6b5f-ea1c-4d19-9165-c8f7232e9160: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18799::DEBUG::2011-01-18 19:49:12,217::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18799::DEBUG::2011-01-18 19:49:12,217::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18799::DEBUG::2011-01-18 19:49:12,217::task::577::irs::Task a55f6b5f-ea1c-4d19-9165-c8f7232e9160: ref 0 aborting False Thread-18799::INFO::2011-01-18 19:49:12,218::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0595510005951', 'lastCheck': 1295372949.09287, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0608229637146', 'lastCheck': 1295372949.0997081, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0986261367798', 'lastCheck': 1295372949.1379011, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.100084066391', 'lastCheck': 1295372949.1381431, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0947668552399', 'lastCheck': 1295372949.1266229, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:49:13,857::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:14,392::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50366 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:16,407::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:16,939::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500915 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:18,952::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:49:19,093::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:49:19,093::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:49:19,099::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:49:19,100::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:49:19,126::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:49:19,127::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:49:19,135::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:49:19,138::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::INFO::2011-01-18 19:49:19,138::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::DEBUG::2011-01-18 19:49:19,139::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:49:19,140::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:49:19,149::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:49:19,173::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:19,187::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:49:19,188::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:19,516::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.532812 seconds, 1.9 MB/s\n'; = 0 Thread-18805::INFO::2011-01-18 19:49:21,351::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18805::DEBUG::2011-01-18 19:49:21,352::task::577::irs::Task a2c40bf9-739b-40b6-8474-a2f178d5aea5: moving from state init -> state preparing Thread-18805::DEBUG::2011-01-18 19:49:21,352::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18805::DEBUG::2011-01-18 19:49:21,384::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000885 seconds, 2.3 MB/s\n'; = 0 Thread-18805::DEBUG::2011-01-18 19:49:21,385::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000885 seconds, 2.3 MB/s'], size: 2048 Thread-18805::DEBUG::2011-01-18 19:49:21,385::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18805::DEBUG::2011-01-18 19:49:21,386::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18805::DEBUG::2011-01-18 19:49:21,386::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18805::DEBUG::2011-01-18 19:49:21,387::task::577::irs::Task a2c40bf9-739b-40b6-8474-a2f178d5aea5: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18805::DEBUG::2011-01-18 19:49:21,387::task::577::irs::Task a2c40bf9-739b-40b6-8474-a2f178d5aea5: moving from state preparing -> state finished Thread-18805::DEBUG::2011-01-18 19:49:21,387::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18805::DEBUG::2011-01-18 19:49:21,387::task::577::irs::Task a2c40bf9-739b-40b6-8474-a2f178d5aea5: ref 0 aborting False Thread-18805::INFO::2011-01-18 19:49:21,388::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18806::INFO::2011-01-18 19:49:21,397::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18806::DEBUG::2011-01-18 19:49:21,397::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: moving from state init -> state preparing Thread-18806::DEBUG::2011-01-18 19:49:21,397::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9 acquire shared (120000) Thread-18806::DEBUG::2011-01-18 19:49:21,398::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18806::DEBUG::2011-01-18 19:49:21,398::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '555ace14-0d1c-4000-bc0d-6d3c6aca8bc9' Thread-18806::DEBUG::2011-01-18 19:49:21,398::resource::524::irs::Owner 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18806::DEBUG::2011-01-18 19:49:21,398::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18806::DEBUG::2011-01-18 19:49:21,399::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: ref 1 aborting False Thread-18806::INFO::2011-01-18 19:49:21,399::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18806::DEBUG::2011-01-18 19:49:21,400::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18806::DEBUG::2011-01-18 19:49:21,400::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: moving from state preparing -> state finished Thread-18806::DEBUG::2011-01-18 19:49:21,400::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18806::DEBUG::2011-01-18 19:49:21,401::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9 releasing Thread-18806::DEBUG::2011-01-18 19:49:21,401::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18806::DEBUG::2011-01-18 19:49:21,401::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18806::DEBUG::2011-01-18 19:49:21,401::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18806::DEBUG::2011-01-18 19:49:21,402::resource::503::irs::Owner 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18806::DEBUG::2011-01-18 19:49:21,402::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18806::DEBUG::2011-01-18 19:49:21,402::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18806::DEBUG::2011-01-18 19:49:21,403::task::577::irs::Task 555ace14-0d1c-4000-bc0d-6d3c6aca8bc9: ref 0 aborting False Thread-18806::INFO::2011-01-18 19:49:21,403::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:49:21,530::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:22,072::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510514 seconds, 2.0 MB/s\n'; = 0 Thread-18807::INFO::2011-01-18 19:49:22,381::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18807::DEBUG::2011-01-18 19:49:22,381::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: moving from state init -> state preparing Thread-18807::DEBUG::2011-01-18 19:49:22,382::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d11a3062-3d4f-4697-83d4-5497ffbc2d52 acquire shared (120000) Thread-18807::DEBUG::2011-01-18 19:49:22,382::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18807::DEBUG::2011-01-18 19:49:22,382::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd11a3062-3d4f-4697-83d4-5497ffbc2d52' Thread-18807::DEBUG::2011-01-18 19:49:22,382::resource::524::irs::Owner d11a3062-3d4f-4697-83d4-5497ffbc2d52: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18807::DEBUG::2011-01-18 19:49:22,383::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18807::DEBUG::2011-01-18 19:49:22,383::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: ref 1 aborting False Thread-18807::DEBUG::2011-01-18 19:49:22,384::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.05415391922', 'lastCheck': 1295372959.1470089, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0513620376587', 'lastCheck': 1295372959.1772699, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0559158325195', 'lastCheck': 1295372959.1547949, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.054995059967', 'lastCheck': 1295372959.192965, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0535910129547', 'lastCheck': 1295372959.192009, 'valid': True, 'code': 0}} Thread-18807::DEBUG::2011-01-18 19:49:22,384::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: moving from state preparing -> state finished Thread-18807::DEBUG::2011-01-18 19:49:22,384::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18807::DEBUG::2011-01-18 19:49:22,385::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d11a3062-3d4f-4697-83d4-5497ffbc2d52 releasing Thread-18807::DEBUG::2011-01-18 19:49:22,385::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18807::DEBUG::2011-01-18 19:49:22,385::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18807::DEBUG::2011-01-18 19:49:22,386::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18807::DEBUG::2011-01-18 19:49:22,386::resource::503::irs::Owner d11a3062-3d4f-4697-83d4-5497ffbc2d52: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18807::DEBUG::2011-01-18 19:49:22,387::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18807::DEBUG::2011-01-18 19:49:22,387::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18807::DEBUG::2011-01-18 19:49:22,387::task::577::irs::Task d11a3062-3d4f-4697-83d4-5497ffbc2d52: ref 0 aborting False Thread-18807::INFO::2011-01-18 19:49:22,387::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.05415391922', 'lastCheck': 1295372959.1470089, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0559158325195', 'lastCheck': 1295372959.1547949, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0535910129547', 'lastCheck': 1295372959.192009, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.054995059967', 'lastCheck': 1295372959.192965, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0513620376587', 'lastCheck': 1295372959.1772699, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:49:24,085::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:24,625::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507616 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:26,638::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:27,171::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500725 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:49:29,146::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:49:29,147::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:49:29,155::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:49:29,156::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:29,184::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18494::INFO::2011-01-18 19:49:29,185::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:49:29,189::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:49:29,190::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 19:49:29,194::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::INFO::2011-01-18 19:49:29,195::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 19:49:29,197::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 19:49:29,198::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:49:29,199::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:49:29,237::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:49:29,244::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:29,246::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:29,733::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.515615 seconds, 2.0 MB/s\n'; = 0 Thread-18813::INFO::2011-01-18 19:49:31,468::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18813::DEBUG::2011-01-18 19:49:31,469::task::577::irs::Task f0f28a54-0c58-4dbf-8a20-5b1ad67b9602: moving from state init -> state preparing Thread-18813::DEBUG::2011-01-18 19:49:31,469::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18813::DEBUG::2011-01-18 19:49:31,501::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000448 seconds, 4.6 MB/s\n'; = 0 Thread-18813::DEBUG::2011-01-18 19:49:31,501::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000448 seconds, 4.6 MB/s'], size: 2048 Thread-18813::DEBUG::2011-01-18 19:49:31,502::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18813::DEBUG::2011-01-18 19:49:31,502::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18813::DEBUG::2011-01-18 19:49:31,503::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18813::DEBUG::2011-01-18 19:49:31,503::task::577::irs::Task f0f28a54-0c58-4dbf-8a20-5b1ad67b9602: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18813::DEBUG::2011-01-18 19:49:31,503::task::577::irs::Task f0f28a54-0c58-4dbf-8a20-5b1ad67b9602: moving from state preparing -> state finished Thread-18813::DEBUG::2011-01-18 19:49:31,504::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18813::DEBUG::2011-01-18 19:49:31,504::task::577::irs::Task f0f28a54-0c58-4dbf-8a20-5b1ad67b9602: ref 0 aborting False Thread-18813::INFO::2011-01-18 19:49:31,504::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18814::INFO::2011-01-18 19:49:31,512::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18814::DEBUG::2011-01-18 19:49:31,513::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: moving from state init -> state preparing Thread-18814::DEBUG::2011-01-18 19:49:31,513::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4138550d-569b-48c1-b752-25b2e5deb7c1 acquire shared (120000) Thread-18814::DEBUG::2011-01-18 19:49:31,513::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18814::DEBUG::2011-01-18 19:49:31,513::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4138550d-569b-48c1-b752-25b2e5deb7c1' Thread-18814::DEBUG::2011-01-18 19:49:31,514::resource::524::irs::Owner 4138550d-569b-48c1-b752-25b2e5deb7c1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18814::DEBUG::2011-01-18 19:49:31,514::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18814::DEBUG::2011-01-18 19:49:31,514::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: ref 1 aborting False Thread-18814::INFO::2011-01-18 19:49:31,515::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18814::DEBUG::2011-01-18 19:49:31,515::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18814::DEBUG::2011-01-18 19:49:31,516::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: moving from state preparing -> state finished Thread-18814::DEBUG::2011-01-18 19:49:31,516::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18814::DEBUG::2011-01-18 19:49:31,516::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4138550d-569b-48c1-b752-25b2e5deb7c1 releasing Thread-18814::DEBUG::2011-01-18 19:49:31,517::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18814::DEBUG::2011-01-18 19:49:31,517::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18814::DEBUG::2011-01-18 19:49:31,517::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18814::DEBUG::2011-01-18 19:49:31,518::resource::503::irs::Owner 4138550d-569b-48c1-b752-25b2e5deb7c1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18814::DEBUG::2011-01-18 19:49:31,518::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18814::DEBUG::2011-01-18 19:49:31,518::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18814::DEBUG::2011-01-18 19:49:31,518::task::577::irs::Task 4138550d-569b-48c1-b752-25b2e5deb7c1: ref 0 aborting False Thread-18814::INFO::2011-01-18 19:49:31,519::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:49:31,748::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:32,289::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509266 seconds, 2.0 MB/s\n'; = 0 Thread-18815::INFO::2011-01-18 19:49:32,556::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18815::DEBUG::2011-01-18 19:49:32,557::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: moving from state init -> state preparing Thread-18815::DEBUG::2011-01-18 19:49:32,557::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d57660bc-473b-401a-ab32-0db9229868a3 acquire shared (120000) Thread-18815::DEBUG::2011-01-18 19:49:32,557::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18815::DEBUG::2011-01-18 19:49:32,558::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd57660bc-473b-401a-ab32-0db9229868a3' Thread-18815::DEBUG::2011-01-18 19:49:32,558::resource::524::irs::Owner d57660bc-473b-401a-ab32-0db9229868a3: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18815::DEBUG::2011-01-18 19:49:32,558::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18815::DEBUG::2011-01-18 19:49:32,559::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: ref 1 aborting False Thread-18815::DEBUG::2011-01-18 19:49:32,559::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0594329833984', 'lastCheck': 1295372969.206316, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0552899837494', 'lastCheck': 1295372969.240412, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.056009054184', 'lastCheck': 1295372969.21088, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0557210445404', 'lastCheck': 1295372969.2509961, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0529730319977', 'lastCheck': 1295372969.2470989, 'valid': True, 'code': 0}} Thread-18815::DEBUG::2011-01-18 19:49:32,559::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: moving from state preparing -> state finished Thread-18815::DEBUG::2011-01-18 19:49:32,560::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18815::DEBUG::2011-01-18 19:49:32,560::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d57660bc-473b-401a-ab32-0db9229868a3 releasing Thread-18815::DEBUG::2011-01-18 19:49:32,560::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18815::DEBUG::2011-01-18 19:49:32,561::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18815::DEBUG::2011-01-18 19:49:32,561::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18815::DEBUG::2011-01-18 19:49:32,561::resource::503::irs::Owner d57660bc-473b-401a-ab32-0db9229868a3: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18815::DEBUG::2011-01-18 19:49:32,561::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18815::DEBUG::2011-01-18 19:49:32,562::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18815::DEBUG::2011-01-18 19:49:32,562::task::577::irs::Task d57660bc-473b-401a-ab32-0db9229868a3: ref 0 aborting False Thread-18815::INFO::2011-01-18 19:49:32,562::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0594329833984', 'lastCheck': 1295372969.206316, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.056009054184', 'lastCheck': 1295372969.21088, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0529730319977', 'lastCheck': 1295372969.2470989, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0557210445404', 'lastCheck': 1295372969.2509961, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0552899837494', 'lastCheck': 1295372969.240412, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:49:34,302::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:34,836::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502536 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:36,849::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:37,382::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501902 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:49:39,205::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:49:39,206::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:49:39,211::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:49:39,212::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:49:39,240::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:49:39,241::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:49:39,246::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 19:49:39,247::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:49:39,248::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:49:39,252::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:49:39,253::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:49:39,254::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:49:39,282::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:49:39,292::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:39,296::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:39,396::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:39,934::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506238 seconds, 2.0 MB/s\n'; = 0 Thread-18821::INFO::2011-01-18 19:49:41,572::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18821::DEBUG::2011-01-18 19:49:41,572::task::577::irs::Task b2edede8-c8ef-4d74-87ea-2d3dea0b4c7e: moving from state init -> state preparing Thread-18821::DEBUG::2011-01-18 19:49:41,573::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18821::DEBUG::2011-01-18 19:49:41,605::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000429 seconds, 4.8 MB/s\n'; = 0 Thread-18821::DEBUG::2011-01-18 19:49:41,605::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000429 seconds, 4.8 MB/s'], size: 2048 Thread-18821::DEBUG::2011-01-18 19:49:41,605::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18821::DEBUG::2011-01-18 19:49:41,606::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18821::DEBUG::2011-01-18 19:49:41,606::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18821::DEBUG::2011-01-18 19:49:41,607::task::577::irs::Task b2edede8-c8ef-4d74-87ea-2d3dea0b4c7e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18821::DEBUG::2011-01-18 19:49:41,607::task::577::irs::Task b2edede8-c8ef-4d74-87ea-2d3dea0b4c7e: moving from state preparing -> state finished Thread-18821::DEBUG::2011-01-18 19:49:41,607::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18821::DEBUG::2011-01-18 19:49:41,608::task::577::irs::Task b2edede8-c8ef-4d74-87ea-2d3dea0b4c7e: ref 0 aborting False Thread-18821::INFO::2011-01-18 19:49:41,608::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18822::INFO::2011-01-18 19:49:41,616::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18822::DEBUG::2011-01-18 19:49:41,617::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: moving from state init -> state preparing Thread-18822::DEBUG::2011-01-18 19:49:41,617::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 674643e5-b3c4-4c1b-bb78-143078b77712 acquire shared (120000) Thread-18822::DEBUG::2011-01-18 19:49:41,617::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18822::DEBUG::2011-01-18 19:49:41,618::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '674643e5-b3c4-4c1b-bb78-143078b77712' Thread-18822::DEBUG::2011-01-18 19:49:41,618::resource::524::irs::Owner 674643e5-b3c4-4c1b-bb78-143078b77712: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18822::DEBUG::2011-01-18 19:49:41,618::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18822::DEBUG::2011-01-18 19:49:41,619::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: ref 1 aborting False Thread-18822::INFO::2011-01-18 19:49:41,619::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18822::DEBUG::2011-01-18 19:49:41,620::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18822::DEBUG::2011-01-18 19:49:41,620::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: moving from state preparing -> state finished Thread-18822::DEBUG::2011-01-18 19:49:41,620::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18822::DEBUG::2011-01-18 19:49:41,621::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 674643e5-b3c4-4c1b-bb78-143078b77712 releasing Thread-18822::DEBUG::2011-01-18 19:49:41,621::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18822::DEBUG::2011-01-18 19:49:41,621::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18822::DEBUG::2011-01-18 19:49:41,621::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18822::DEBUG::2011-01-18 19:49:41,622::resource::503::irs::Owner 674643e5-b3c4-4c1b-bb78-143078b77712: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18822::DEBUG::2011-01-18 19:49:41,622::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18822::DEBUG::2011-01-18 19:49:41,622::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18822::DEBUG::2011-01-18 19:49:41,623::task::577::irs::Task 674643e5-b3c4-4c1b-bb78-143078b77712: ref 0 aborting False Thread-18822::INFO::2011-01-18 19:49:41,623::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:49:41,948::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:42,492::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512208 seconds, 2.0 MB/s\n'; = 0 Thread-18823::INFO::2011-01-18 19:49:42,750::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18823::DEBUG::2011-01-18 19:49:42,751::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: moving from state init -> state preparing Thread-18823::DEBUG::2011-01-18 19:49:42,751::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b6cd0b58-f925-4e8b-9669-6b1b73eba6a6 acquire shared (120000) Thread-18823::DEBUG::2011-01-18 19:49:42,751::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18823::DEBUG::2011-01-18 19:49:42,752::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b6cd0b58-f925-4e8b-9669-6b1b73eba6a6' Thread-18823::DEBUG::2011-01-18 19:49:42,752::resource::524::irs::Owner b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18823::DEBUG::2011-01-18 19:49:42,752::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18823::DEBUG::2011-01-18 19:49:42,753::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: ref 1 aborting False Thread-18823::DEBUG::2011-01-18 19:49:42,753::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0525817871094', 'lastCheck': 1295372979.2584169, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0458669662476', 'lastCheck': 1295372979.2857361, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0533940792084', 'lastCheck': 1295372979.264313, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494968891144', 'lastCheck': 1295372979.3015139, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0481379032135', 'lastCheck': 1295372979.2950549, 'valid': True, 'code': 0}} Thread-18823::DEBUG::2011-01-18 19:49:42,753::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: moving from state preparing -> state finished Thread-18823::DEBUG::2011-01-18 19:49:42,754::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18823::DEBUG::2011-01-18 19:49:42,754::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b6cd0b58-f925-4e8b-9669-6b1b73eba6a6 releasing Thread-18823::DEBUG::2011-01-18 19:49:42,754::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18823::DEBUG::2011-01-18 19:49:42,754::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18823::DEBUG::2011-01-18 19:49:42,755::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18823::DEBUG::2011-01-18 19:49:42,755::resource::503::irs::Owner b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18823::DEBUG::2011-01-18 19:49:42,755::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18823::DEBUG::2011-01-18 19:49:42,756::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18823::DEBUG::2011-01-18 19:49:42,756::task::577::irs::Task b6cd0b58-f925-4e8b-9669-6b1b73eba6a6: ref 0 aborting False Thread-18823::INFO::2011-01-18 19:49:42,756::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0525817871094', 'lastCheck': 1295372979.2584169, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0533940792084', 'lastCheck': 1295372979.264313, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0481379032135', 'lastCheck': 1295372979.2950549, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494968891144', 'lastCheck': 1295372979.3015139, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0458669662476', 'lastCheck': 1295372979.2857361, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:49:44,504::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:45,040::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504237 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:47,053::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:47,587::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501194 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:49:49,257::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:49:49,258::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:49:49,264::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:49:49,265::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:49:49,285::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:49:49,286::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:49:49,295::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:49:49,296::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:49:49,299::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:49:49,301::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:49:49,302::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:49:49,309::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:49:49,326::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:49:49,336::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:49,348::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:49,601::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:50,137::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50419 seconds, 2.0 MB/s\n'; = 0 Thread-18829::INFO::2011-01-18 19:49:51,676::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18829::DEBUG::2011-01-18 19:49:51,676::task::577::irs::Task 37b71f31-5e95-4058-95a5-a9165dc35161: moving from state init -> state preparing Thread-18829::DEBUG::2011-01-18 19:49:51,677::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18829::DEBUG::2011-01-18 19:49:51,709::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000411 seconds, 5.0 MB/s\n'; = 0 Thread-18829::DEBUG::2011-01-18 19:49:51,709::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000411 seconds, 5.0 MB/s'], size: 2048 Thread-18829::DEBUG::2011-01-18 19:49:51,709::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18829::DEBUG::2011-01-18 19:49:51,710::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18829::DEBUG::2011-01-18 19:49:51,710::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18829::DEBUG::2011-01-18 19:49:51,711::task::577::irs::Task 37b71f31-5e95-4058-95a5-a9165dc35161: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18829::DEBUG::2011-01-18 19:49:51,711::task::577::irs::Task 37b71f31-5e95-4058-95a5-a9165dc35161: moving from state preparing -> state finished Thread-18829::DEBUG::2011-01-18 19:49:51,711::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18829::DEBUG::2011-01-18 19:49:51,712::task::577::irs::Task 37b71f31-5e95-4058-95a5-a9165dc35161: ref 0 aborting False Thread-18829::INFO::2011-01-18 19:49:51,712::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18830::INFO::2011-01-18 19:49:51,720::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18830::DEBUG::2011-01-18 19:49:51,720::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: moving from state init -> state preparing Thread-18830::DEBUG::2011-01-18 19:49:51,720::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9ac511de-0a90-429a-9cfb-5b7badacf082 acquire shared (120000) Thread-18830::DEBUG::2011-01-18 19:49:51,721::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18830::DEBUG::2011-01-18 19:49:51,721::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9ac511de-0a90-429a-9cfb-5b7badacf082' Thread-18830::DEBUG::2011-01-18 19:49:51,721::resource::524::irs::Owner 9ac511de-0a90-429a-9cfb-5b7badacf082: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18830::DEBUG::2011-01-18 19:49:51,721::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18830::DEBUG::2011-01-18 19:49:51,722::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: ref 1 aborting False Thread-18830::INFO::2011-01-18 19:49:51,722::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18830::DEBUG::2011-01-18 19:49:51,723::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18830::DEBUG::2011-01-18 19:49:51,723::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: moving from state preparing -> state finished Thread-18830::DEBUG::2011-01-18 19:49:51,724::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18830::DEBUG::2011-01-18 19:49:51,724::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9ac511de-0a90-429a-9cfb-5b7badacf082 releasing Thread-18830::DEBUG::2011-01-18 19:49:51,724::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18830::DEBUG::2011-01-18 19:49:51,724::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18830::DEBUG::2011-01-18 19:49:51,725::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18830::DEBUG::2011-01-18 19:49:51,725::resource::503::irs::Owner 9ac511de-0a90-429a-9cfb-5b7badacf082: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18830::DEBUG::2011-01-18 19:49:51,725::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18830::DEBUG::2011-01-18 19:49:51,726::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18830::DEBUG::2011-01-18 19:49:51,726::task::577::irs::Task 9ac511de-0a90-429a-9cfb-5b7badacf082: ref 0 aborting False Thread-18830::INFO::2011-01-18 19:49:51,726::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:49:52,151::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:52,683::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500387 seconds, 2.0 MB/s\n'; = 0 Thread-18831::INFO::2011-01-18 19:49:52,924::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18831::DEBUG::2011-01-18 19:49:52,925::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: moving from state init -> state preparing Thread-18831::DEBUG::2011-01-18 19:49:52,925::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 14171312-e4a5-476e-b6ed-5b8521c8e724 acquire shared (120000) Thread-18831::DEBUG::2011-01-18 19:49:52,925::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18831::DEBUG::2011-01-18 19:49:52,926::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '14171312-e4a5-476e-b6ed-5b8521c8e724' Thread-18831::DEBUG::2011-01-18 19:49:52,926::resource::524::irs::Owner 14171312-e4a5-476e-b6ed-5b8521c8e724: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18831::DEBUG::2011-01-18 19:49:52,926::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18831::DEBUG::2011-01-18 19:49:52,926::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: ref 1 aborting False Thread-18831::DEBUG::2011-01-18 19:49:52,927::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0507309436798', 'lastCheck': 1295372989.308579, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0458788871765', 'lastCheck': 1295372989.3307419, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.053591966629', 'lastCheck': 1295372989.317518, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0515899658203', 'lastCheck': 1295372989.352742, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0453300476074', 'lastCheck': 1295372989.340199, 'valid': True, 'code': 0}} Thread-18831::DEBUG::2011-01-18 19:49:52,927::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: moving from state preparing -> state finished Thread-18831::DEBUG::2011-01-18 19:49:52,928::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18831::DEBUG::2011-01-18 19:49:52,928::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 14171312-e4a5-476e-b6ed-5b8521c8e724 releasing Thread-18831::DEBUG::2011-01-18 19:49:52,928::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18831::DEBUG::2011-01-18 19:49:52,928::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18831::DEBUG::2011-01-18 19:49:52,929::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18831::DEBUG::2011-01-18 19:49:52,929::resource::503::irs::Owner 14171312-e4a5-476e-b6ed-5b8521c8e724: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18831::DEBUG::2011-01-18 19:49:52,929::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18831::DEBUG::2011-01-18 19:49:52,929::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18831::DEBUG::2011-01-18 19:49:52,930::task::577::irs::Task 14171312-e4a5-476e-b6ed-5b8521c8e724: ref 0 aborting False Thread-18831::INFO::2011-01-18 19:49:52,930::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0507309436798', 'lastCheck': 1295372989.308579, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.053591966629', 'lastCheck': 1295372989.317518, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0453300476074', 'lastCheck': 1295372989.340199, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0515899658203', 'lastCheck': 1295372989.352742, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0458788871765', 'lastCheck': 1295372989.3307419, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:49:54,696::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:55,240::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512074 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:57,252::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:49:57,785::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500296 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:49:59,307::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:49:59,308::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:49:59,317::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:49:59,318::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:49:59,330::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:49:59,331::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:49:59,340::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:49:59,341::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:49:59,352::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:49:59,353::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:49:59,353::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:49:59,357::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:49:59,372::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:49:59,381::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:49:59,397::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:49:59,799::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:00,333::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502512 seconds, 2.0 MB/s\n'; = 0 Thread-18837::INFO::2011-01-18 19:50:01,783::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18837::DEBUG::2011-01-18 19:50:01,784::task::577::irs::Task 9a9d67e5-20dc-40d2-967b-2b2f9a211cd0: moving from state init -> state preparing Thread-18837::DEBUG::2011-01-18 19:50:01,784::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18837::DEBUG::2011-01-18 19:50:01,816::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000472 seconds, 4.3 MB/s\n'; = 0 Thread-18837::DEBUG::2011-01-18 19:50:01,817::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000472 seconds, 4.3 MB/s'], size: 2048 Thread-18837::DEBUG::2011-01-18 19:50:01,817::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18837::DEBUG::2011-01-18 19:50:01,817::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18837::DEBUG::2011-01-18 19:50:01,818::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18837::DEBUG::2011-01-18 19:50:01,818::task::577::irs::Task 9a9d67e5-20dc-40d2-967b-2b2f9a211cd0: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18837::DEBUG::2011-01-18 19:50:01,819::task::577::irs::Task 9a9d67e5-20dc-40d2-967b-2b2f9a211cd0: moving from state preparing -> state finished Thread-18837::DEBUG::2011-01-18 19:50:01,819::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18837::DEBUG::2011-01-18 19:50:01,819::task::577::irs::Task 9a9d67e5-20dc-40d2-967b-2b2f9a211cd0: ref 0 aborting False Thread-18837::INFO::2011-01-18 19:50:01,820::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18838::INFO::2011-01-18 19:50:01,828::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18838::DEBUG::2011-01-18 19:50:01,828::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: moving from state init -> state preparing Thread-18838::DEBUG::2011-01-18 19:50:01,828::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 91d06552-ca26-4385-8ea9-97487ce35a89 acquire shared (120000) Thread-18838::DEBUG::2011-01-18 19:50:01,829::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18838::DEBUG::2011-01-18 19:50:01,829::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '91d06552-ca26-4385-8ea9-97487ce35a89' Thread-18838::DEBUG::2011-01-18 19:50:01,829::resource::524::irs::Owner 91d06552-ca26-4385-8ea9-97487ce35a89: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18838::DEBUG::2011-01-18 19:50:01,829::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18838::DEBUG::2011-01-18 19:50:01,830::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: ref 1 aborting False Thread-18838::INFO::2011-01-18 19:50:01,830::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18838::DEBUG::2011-01-18 19:50:01,831::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18838::DEBUG::2011-01-18 19:50:01,831::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: moving from state preparing -> state finished Thread-18838::DEBUG::2011-01-18 19:50:01,832::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18838::DEBUG::2011-01-18 19:50:01,832::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 91d06552-ca26-4385-8ea9-97487ce35a89 releasing Thread-18838::DEBUG::2011-01-18 19:50:01,832::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18838::DEBUG::2011-01-18 19:50:01,832::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18838::DEBUG::2011-01-18 19:50:01,833::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18838::DEBUG::2011-01-18 19:50:01,833::resource::503::irs::Owner 91d06552-ca26-4385-8ea9-97487ce35a89: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18838::DEBUG::2011-01-18 19:50:01,833::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18838::DEBUG::2011-01-18 19:50:01,834::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18838::DEBUG::2011-01-18 19:50:01,834::task::577::irs::Task 91d06552-ca26-4385-8ea9-97487ce35a89: ref 0 aborting False Thread-18838::INFO::2011-01-18 19:50:01,834::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:50:02,346::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:02,888::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510187 seconds, 2.0 MB/s\n'; = 0 Thread-18839::INFO::2011-01-18 19:50:03,089::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18839::DEBUG::2011-01-18 19:50:03,089::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: moving from state init -> state preparing Thread-18839::DEBUG::2011-01-18 19:50:03,089::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 52d103d9-6ef2-4391-b28f-2384d73820d6 acquire shared (120000) Thread-18839::DEBUG::2011-01-18 19:50:03,090::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18839::DEBUG::2011-01-18 19:50:03,090::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '52d103d9-6ef2-4391-b28f-2384d73820d6' Thread-18839::DEBUG::2011-01-18 19:50:03,090::resource::524::irs::Owner 52d103d9-6ef2-4391-b28f-2384d73820d6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18839::DEBUG::2011-01-18 19:50:03,091::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18839::DEBUG::2011-01-18 19:50:03,091::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: ref 1 aborting False Thread-18839::DEBUG::2011-01-18 19:50:03,091::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0545949935913', 'lastCheck': 1295372999.3624339, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0477268695831', 'lastCheck': 1295372999.377605, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0485291481018', 'lastCheck': 1295372999.365406, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0500209331512', 'lastCheck': 1295372999.401901, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455479621887', 'lastCheck': 1295372999.3854239, 'valid': True, 'code': 0}} Thread-18839::DEBUG::2011-01-18 19:50:03,092::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: moving from state preparing -> state finished Thread-18839::DEBUG::2011-01-18 19:50:03,092::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18839::DEBUG::2011-01-18 19:50:03,092::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 52d103d9-6ef2-4391-b28f-2384d73820d6 releasing Thread-18839::DEBUG::2011-01-18 19:50:03,092::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18839::DEBUG::2011-01-18 19:50:03,093::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18839::DEBUG::2011-01-18 19:50:03,093::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18839::DEBUG::2011-01-18 19:50:03,093::resource::503::irs::Owner 52d103d9-6ef2-4391-b28f-2384d73820d6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18839::DEBUG::2011-01-18 19:50:03,094::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18839::DEBUG::2011-01-18 19:50:03,094::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18839::DEBUG::2011-01-18 19:50:03,094::task::577::irs::Task 52d103d9-6ef2-4391-b28f-2384d73820d6: ref 0 aborting False Thread-18839::INFO::2011-01-18 19:50:03,094::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0545949935913', 'lastCheck': 1295372999.3624339, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0485291481018', 'lastCheck': 1295372999.365406, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455479621887', 'lastCheck': 1295372999.3854239, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0500209331512', 'lastCheck': 1295372999.401901, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0477268695831', 'lastCheck': 1295372999.377605, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:50:04,898::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:05,446::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514733 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:07,458::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:07,992::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502478 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:50:09,361::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:50:09,362::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:50:09,366::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:50:09,367::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:50:09,377::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:50:09,378::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:50:09,385::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:50:09,386::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:50:09,402::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:50:09,403::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:50:09,407::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:50:09,408::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:50:09,420::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:50:09,430::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:50:09,444::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:10,004::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:10,538::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502264 seconds, 2.0 MB/s\n'; = 0 Thread-18845::INFO::2011-01-18 19:50:11,888::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18845::DEBUG::2011-01-18 19:50:11,889::task::577::irs::Task 931b038f-37f8-4fd7-b8b6-ca9470447832: moving from state init -> state preparing Thread-18845::DEBUG::2011-01-18 19:50:11,889::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18845::DEBUG::2011-01-18 19:50:11,921::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000473 seconds, 4.3 MB/s\n'; = 0 Thread-18845::DEBUG::2011-01-18 19:50:11,922::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000473 seconds, 4.3 MB/s'], size: 2048 Thread-18845::DEBUG::2011-01-18 19:50:11,922::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18845::DEBUG::2011-01-18 19:50:11,922::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18845::DEBUG::2011-01-18 19:50:11,923::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18845::DEBUG::2011-01-18 19:50:11,923::task::577::irs::Task 931b038f-37f8-4fd7-b8b6-ca9470447832: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18845::DEBUG::2011-01-18 19:50:11,924::task::577::irs::Task 931b038f-37f8-4fd7-b8b6-ca9470447832: moving from state preparing -> state finished Thread-18845::DEBUG::2011-01-18 19:50:11,924::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18845::DEBUG::2011-01-18 19:50:11,924::task::577::irs::Task 931b038f-37f8-4fd7-b8b6-ca9470447832: ref 0 aborting False Thread-18845::INFO::2011-01-18 19:50:11,925::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18846::INFO::2011-01-18 19:50:11,933::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18846::DEBUG::2011-01-18 19:50:11,933::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: moving from state init -> state preparing Thread-18846::DEBUG::2011-01-18 19:50:11,933::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a5ac7d8f-ba03-482d-b18a-5ed007b9a329 acquire shared (120000) Thread-18846::DEBUG::2011-01-18 19:50:11,934::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18846::DEBUG::2011-01-18 19:50:11,934::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a5ac7d8f-ba03-482d-b18a-5ed007b9a329' Thread-18846::DEBUG::2011-01-18 19:50:11,934::resource::524::irs::Owner a5ac7d8f-ba03-482d-b18a-5ed007b9a329: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18846::DEBUG::2011-01-18 19:50:11,934::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18846::DEBUG::2011-01-18 19:50:11,935::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: ref 1 aborting False Thread-18846::INFO::2011-01-18 19:50:11,935::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18846::DEBUG::2011-01-18 19:50:11,936::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18846::DEBUG::2011-01-18 19:50:11,936::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: moving from state preparing -> state finished Thread-18846::DEBUG::2011-01-18 19:50:11,936::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18846::DEBUG::2011-01-18 19:50:11,937::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a5ac7d8f-ba03-482d-b18a-5ed007b9a329 releasing Thread-18846::DEBUG::2011-01-18 19:50:11,937::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18846::DEBUG::2011-01-18 19:50:11,937::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18846::DEBUG::2011-01-18 19:50:11,938::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18846::DEBUG::2011-01-18 19:50:11,938::resource::503::irs::Owner a5ac7d8f-ba03-482d-b18a-5ed007b9a329: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18846::DEBUG::2011-01-18 19:50:11,938::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18846::DEBUG::2011-01-18 19:50:11,938::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18846::DEBUG::2011-01-18 19:50:11,939::task::577::irs::Task a5ac7d8f-ba03-482d-b18a-5ed007b9a329: ref 0 aborting False Thread-18846::INFO::2011-01-18 19:50:11,939::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:50:12,551::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:13,085::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501928 seconds, 2.0 MB/s\n'; = 0 Thread-18847::INFO::2011-01-18 19:50:13,253::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18847::DEBUG::2011-01-18 19:50:13,254::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: moving from state init -> state preparing Thread-18847::DEBUG::2011-01-18 19:50:13,254::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8171c56-2486-4abb-981c-c9df320cbded acquire shared (120000) Thread-18847::DEBUG::2011-01-18 19:50:13,254::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18847::DEBUG::2011-01-18 19:50:13,255::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f8171c56-2486-4abb-981c-c9df320cbded' Thread-18847::DEBUG::2011-01-18 19:50:13,255::resource::524::irs::Owner f8171c56-2486-4abb-981c-c9df320cbded: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18847::DEBUG::2011-01-18 19:50:13,255::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18847::DEBUG::2011-01-18 19:50:13,255::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: ref 1 aborting False Thread-18847::DEBUG::2011-01-18 19:50:13,256::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0526421070099', 'lastCheck': 1295373009.414484, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048896074295', 'lastCheck': 1295373009.425806, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0487451553345', 'lastCheck': 1295373009.4146841, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.047600030899', 'lastCheck': 1295373009.449461, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0485639572144', 'lastCheck': 1295373009.4334381, 'valid': True, 'code': 0}} Thread-18847::DEBUG::2011-01-18 19:50:13,256::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: moving from state preparing -> state finished Thread-18847::DEBUG::2011-01-18 19:50:13,256::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18847::DEBUG::2011-01-18 19:50:13,257::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8171c56-2486-4abb-981c-c9df320cbded releasing Thread-18847::DEBUG::2011-01-18 19:50:13,257::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18847::DEBUG::2011-01-18 19:50:13,257::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18847::DEBUG::2011-01-18 19:50:13,258::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18847::DEBUG::2011-01-18 19:50:13,258::resource::503::irs::Owner f8171c56-2486-4abb-981c-c9df320cbded: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18847::DEBUG::2011-01-18 19:50:13,258::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18847::DEBUG::2011-01-18 19:50:13,258::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18847::DEBUG::2011-01-18 19:50:13,259::task::577::irs::Task f8171c56-2486-4abb-981c-c9df320cbded: ref 0 aborting False Thread-18847::INFO::2011-01-18 19:50:13,259::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0526421070099', 'lastCheck': 1295373009.414484, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0487451553345', 'lastCheck': 1295373009.4146841, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0485639572144', 'lastCheck': 1295373009.4334381, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.047600030899', 'lastCheck': 1295373009.449461, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048896074295', 'lastCheck': 1295373009.425806, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:50:15,099::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:15,642::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51117 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:17,655::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:18,188::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501339 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 19:50:19,413::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::INFO::2011-01-18 19:50:19,414::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::DEBUG::2011-01-18 19:50:19,414::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:50:19,415::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:50:19,426::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:50:19,427::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:50:19,433::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:50:19,434::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:50:19,449::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:50:19,450::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:50:19,458::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:50:19,458::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:50:19,470::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:50:19,476::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:50:19,494::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:20,202::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:20,736::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502255 seconds, 2.0 MB/s\n'; = 0 Thread-18853::INFO::2011-01-18 19:50:21,992::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18853::DEBUG::2011-01-18 19:50:21,993::task::577::irs::Task 3968c46e-bb4d-4328-a449-4983719f1a83: moving from state init -> state preparing Thread-18853::DEBUG::2011-01-18 19:50:21,993::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18853::DEBUG::2011-01-18 19:50:22,025::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000493 seconds, 4.2 MB/s\n'; = 0 Thread-18853::DEBUG::2011-01-18 19:50:22,026::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000493 seconds, 4.2 MB/s'], size: 2048 Thread-18853::DEBUG::2011-01-18 19:50:22,026::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18853::DEBUG::2011-01-18 19:50:22,027::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18853::DEBUG::2011-01-18 19:50:22,027::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18853::DEBUG::2011-01-18 19:50:22,028::task::577::irs::Task 3968c46e-bb4d-4328-a449-4983719f1a83: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18853::DEBUG::2011-01-18 19:50:22,028::task::577::irs::Task 3968c46e-bb4d-4328-a449-4983719f1a83: moving from state preparing -> state finished Thread-18853::DEBUG::2011-01-18 19:50:22,028::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18853::DEBUG::2011-01-18 19:50:22,028::task::577::irs::Task 3968c46e-bb4d-4328-a449-4983719f1a83: ref 0 aborting False Thread-18853::INFO::2011-01-18 19:50:22,029::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18854::INFO::2011-01-18 19:50:22,037::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18854::DEBUG::2011-01-18 19:50:22,037::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: moving from state init -> state preparing Thread-18854::DEBUG::2011-01-18 19:50:22,037::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8033d064-72db-4b76-a20b-89e99d880f7f acquire shared (120000) Thread-18854::DEBUG::2011-01-18 19:50:22,038::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18854::DEBUG::2011-01-18 19:50:22,038::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8033d064-72db-4b76-a20b-89e99d880f7f' Thread-18854::DEBUG::2011-01-18 19:50:22,038::resource::524::irs::Owner 8033d064-72db-4b76-a20b-89e99d880f7f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18854::DEBUG::2011-01-18 19:50:22,038::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18854::DEBUG::2011-01-18 19:50:22,039::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: ref 1 aborting False Thread-18854::INFO::2011-01-18 19:50:22,039::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18854::DEBUG::2011-01-18 19:50:22,040::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18854::DEBUG::2011-01-18 19:50:22,040::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: moving from state preparing -> state finished Thread-18854::DEBUG::2011-01-18 19:50:22,041::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18854::DEBUG::2011-01-18 19:50:22,041::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8033d064-72db-4b76-a20b-89e99d880f7f releasing Thread-18854::DEBUG::2011-01-18 19:50:22,041::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18854::DEBUG::2011-01-18 19:50:22,041::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18854::DEBUG::2011-01-18 19:50:22,042::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18854::DEBUG::2011-01-18 19:50:22,042::resource::503::irs::Owner 8033d064-72db-4b76-a20b-89e99d880f7f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18854::DEBUG::2011-01-18 19:50:22,042::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18854::DEBUG::2011-01-18 19:50:22,043::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18854::DEBUG::2011-01-18 19:50:22,043::task::577::irs::Task 8033d064-72db-4b76-a20b-89e99d880f7f: ref 0 aborting False Thread-18854::INFO::2011-01-18 19:50:22,043::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:50:22,749::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:23,281::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500346 seconds, 2.0 MB/s\n'; = 0 Thread-18855::INFO::2011-01-18 19:50:23,415::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18855::DEBUG::2011-01-18 19:50:23,415::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: moving from state init -> state preparing Thread-18855::DEBUG::2011-01-18 19:50:23,416::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b77c8f85-f921-42d1-a9a7-aa13c7f8014d acquire shared (120000) Thread-18855::DEBUG::2011-01-18 19:50:23,416::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18855::DEBUG::2011-01-18 19:50:23,416::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b77c8f85-f921-42d1-a9a7-aa13c7f8014d' Thread-18855::DEBUG::2011-01-18 19:50:23,416::resource::524::irs::Owner b77c8f85-f921-42d1-a9a7-aa13c7f8014d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18855::DEBUG::2011-01-18 19:50:23,417::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18855::DEBUG::2011-01-18 19:50:23,417::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: ref 1 aborting False Thread-18855::DEBUG::2011-01-18 19:50:23,417::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0512909889221', 'lastCheck': 1295373019.4653859, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0504429340363', 'lastCheck': 1295373019.4763629, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0521202087402', 'lastCheck': 1295373019.4659531, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0500321388245', 'lastCheck': 1295373019.498934, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463230609894', 'lastCheck': 1295373019.479233, 'valid': True, 'code': 0}} Thread-18855::DEBUG::2011-01-18 19:50:23,418::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: moving from state preparing -> state finished Thread-18855::DEBUG::2011-01-18 19:50:23,418::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18855::DEBUG::2011-01-18 19:50:23,419::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b77c8f85-f921-42d1-a9a7-aa13c7f8014d releasing Thread-18855::DEBUG::2011-01-18 19:50:23,419::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18855::DEBUG::2011-01-18 19:50:23,419::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18855::DEBUG::2011-01-18 19:50:23,419::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18855::DEBUG::2011-01-18 19:50:23,420::resource::503::irs::Owner b77c8f85-f921-42d1-a9a7-aa13c7f8014d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18855::DEBUG::2011-01-18 19:50:23,420::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18855::DEBUG::2011-01-18 19:50:23,420::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18855::DEBUG::2011-01-18 19:50:23,420::task::577::irs::Task b77c8f85-f921-42d1-a9a7-aa13c7f8014d: ref 0 aborting False Thread-18855::INFO::2011-01-18 19:50:23,421::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0512909889221', 'lastCheck': 1295373019.4653859, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0521202087402', 'lastCheck': 1295373019.4659531, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463230609894', 'lastCheck': 1295373019.479233, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0500321388245', 'lastCheck': 1295373019.498934, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0504429340363', 'lastCheck': 1295373019.4763629, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:50:25,294::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:25,840::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514706 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:27,853::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:28,387::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502823 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:50:29,464::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:50:29,465::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:50:29,465::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:50:29,466::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:50:29,476::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:50:29,477::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:50:29,480::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:50:29,481::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:50:29,499::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:50:29,500::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:50:29,508::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:50:29,509::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:50:29,519::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:50:29,522::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:50:29,543::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:30,401::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:30,934::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502116 seconds, 2.0 MB/s\n'; = 0 Thread-18861::INFO::2011-01-18 19:50:32,106::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18861::DEBUG::2011-01-18 19:50:32,107::task::577::irs::Task f0b4f96c-6a0c-4957-a314-51af8b01e94f: moving from state init -> state preparing Thread-18861::DEBUG::2011-01-18 19:50:32,107::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18861::DEBUG::2011-01-18 19:50:32,139::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000492 seconds, 4.2 MB/s\n'; = 0 Thread-18861::DEBUG::2011-01-18 19:50:32,139::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000492 seconds, 4.2 MB/s'], size: 2048 Thread-18861::DEBUG::2011-01-18 19:50:32,140::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18861::DEBUG::2011-01-18 19:50:32,140::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18861::DEBUG::2011-01-18 19:50:32,141::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18861::DEBUG::2011-01-18 19:50:32,141::task::577::irs::Task f0b4f96c-6a0c-4957-a314-51af8b01e94f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18861::DEBUG::2011-01-18 19:50:32,141::task::577::irs::Task f0b4f96c-6a0c-4957-a314-51af8b01e94f: moving from state preparing -> state finished Thread-18861::DEBUG::2011-01-18 19:50:32,142::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18861::DEBUG::2011-01-18 19:50:32,142::task::577::irs::Task f0b4f96c-6a0c-4957-a314-51af8b01e94f: ref 0 aborting False Thread-18861::INFO::2011-01-18 19:50:32,142::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18862::INFO::2011-01-18 19:50:32,151::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18862::DEBUG::2011-01-18 19:50:32,151::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: moving from state init -> state preparing Thread-18862::DEBUG::2011-01-18 19:50:32,152::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5bd8970c-a312-4a02-96af-46894f47a858 acquire shared (120000) Thread-18862::DEBUG::2011-01-18 19:50:32,152::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18862::DEBUG::2011-01-18 19:50:32,152::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5bd8970c-a312-4a02-96af-46894f47a858' Thread-18862::DEBUG::2011-01-18 19:50:32,152::resource::524::irs::Owner 5bd8970c-a312-4a02-96af-46894f47a858: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18862::DEBUG::2011-01-18 19:50:32,153::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18862::DEBUG::2011-01-18 19:50:32,153::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: ref 1 aborting False Thread-18862::INFO::2011-01-18 19:50:32,153::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18862::DEBUG::2011-01-18 19:50:32,154::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18862::DEBUG::2011-01-18 19:50:32,154::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: moving from state preparing -> state finished Thread-18862::DEBUG::2011-01-18 19:50:32,155::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18862::DEBUG::2011-01-18 19:50:32,155::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5bd8970c-a312-4a02-96af-46894f47a858 releasing Thread-18862::DEBUG::2011-01-18 19:50:32,155::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18862::DEBUG::2011-01-18 19:50:32,156::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18862::DEBUG::2011-01-18 19:50:32,156::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18862::DEBUG::2011-01-18 19:50:32,156::resource::503::irs::Owner 5bd8970c-a312-4a02-96af-46894f47a858: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18862::DEBUG::2011-01-18 19:50:32,156::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18862::DEBUG::2011-01-18 19:50:32,157::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18862::DEBUG::2011-01-18 19:50:32,157::task::577::irs::Task 5bd8970c-a312-4a02-96af-46894f47a858: ref 0 aborting False Thread-18862::INFO::2011-01-18 19:50:32,157::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:50:32,948::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:33,480::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500787 seconds, 2.0 MB/s\n'; = 0 Thread-18863::INFO::2011-01-18 19:50:33,578::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18863::DEBUG::2011-01-18 19:50:33,579::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: moving from state init -> state preparing Thread-18863::DEBUG::2011-01-18 19:50:33,579::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9b3bb12d-6d9d-4054-b22c-eba6d2ada271 acquire shared (120000) Thread-18863::DEBUG::2011-01-18 19:50:33,579::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18863::DEBUG::2011-01-18 19:50:33,580::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9b3bb12d-6d9d-4054-b22c-eba6d2ada271' Thread-18863::DEBUG::2011-01-18 19:50:33,580::resource::524::irs::Owner 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18863::DEBUG::2011-01-18 19:50:33,580::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18863::DEBUG::2011-01-18 19:50:33,580::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: ref 1 aborting False Thread-18863::DEBUG::2011-01-18 19:50:33,581::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0500319004059', 'lastCheck': 1295373029.5148749, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0461950302124', 'lastCheck': 1295373029.5220749, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0506820678711', 'lastCheck': 1295373029.516567, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0492548942566', 'lastCheck': 1295373029.5481229, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0467200279236', 'lastCheck': 1295373029.5266311, 'valid': True, 'code': 0}} Thread-18863::DEBUG::2011-01-18 19:50:33,581::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: moving from state preparing -> state finished Thread-18863::DEBUG::2011-01-18 19:50:33,581::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18863::DEBUG::2011-01-18 19:50:33,582::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9b3bb12d-6d9d-4054-b22c-eba6d2ada271 releasing Thread-18863::DEBUG::2011-01-18 19:50:33,582::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18863::DEBUG::2011-01-18 19:50:33,582::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18863::DEBUG::2011-01-18 19:50:33,583::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18863::DEBUG::2011-01-18 19:50:33,583::resource::503::irs::Owner 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18863::DEBUG::2011-01-18 19:50:33,583::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18863::DEBUG::2011-01-18 19:50:33,583::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18863::DEBUG::2011-01-18 19:50:33,584::task::577::irs::Task 9b3bb12d-6d9d-4054-b22c-eba6d2ada271: ref 0 aborting False Thread-18863::INFO::2011-01-18 19:50:33,584::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0500319004059', 'lastCheck': 1295373029.5148749, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0506820678711', 'lastCheck': 1295373029.516567, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0467200279236', 'lastCheck': 1295373029.5266311, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0492548942566', 'lastCheck': 1295373029.5481229, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0461950302124', 'lastCheck': 1295373029.5220749, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:50:35,493::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:36,036::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511162 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:38,049::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:38,582::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.5014 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:50:39,514::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:50:39,515::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:50:39,516::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:50:39,518::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:50:39,522::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:50:39,523::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:50:39,526::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:50:39,527::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:50:39,548::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:50:39,549::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:50:39,557::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:50:39,558::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:50:39,565::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:50:39,568::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:50:39,589::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:40,594::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:41,130::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503316 seconds, 2.0 MB/s\n'; = 0 Thread-18869::INFO::2011-01-18 19:50:42,216::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18869::DEBUG::2011-01-18 19:50:42,216::task::577::irs::Task 25ed7f6f-71fa-4cc1-b4cb-1022b98632db: moving from state init -> state preparing Thread-18869::DEBUG::2011-01-18 19:50:42,217::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18869::DEBUG::2011-01-18 19:50:42,248::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000482 seconds, 4.2 MB/s\n'; = 0 Thread-18869::DEBUG::2011-01-18 19:50:42,248::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000482 seconds, 4.2 MB/s'], size: 2048 Thread-18869::DEBUG::2011-01-18 19:50:42,249::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18869::DEBUG::2011-01-18 19:50:42,249::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18869::DEBUG::2011-01-18 19:50:42,250::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18869::DEBUG::2011-01-18 19:50:42,250::task::577::irs::Task 25ed7f6f-71fa-4cc1-b4cb-1022b98632db: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18869::DEBUG::2011-01-18 19:50:42,250::task::577::irs::Task 25ed7f6f-71fa-4cc1-b4cb-1022b98632db: moving from state preparing -> state finished Thread-18869::DEBUG::2011-01-18 19:50:42,251::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18869::DEBUG::2011-01-18 19:50:42,251::task::577::irs::Task 25ed7f6f-71fa-4cc1-b4cb-1022b98632db: ref 0 aborting False Thread-18869::INFO::2011-01-18 19:50:42,251::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18870::INFO::2011-01-18 19:50:42,260::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18870::DEBUG::2011-01-18 19:50:42,260::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: moving from state init -> state preparing Thread-18870::DEBUG::2011-01-18 19:50:42,261::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 72d795a4-9583-45e2-87c6-72d8ffdaac89 acquire shared (120000) Thread-18870::DEBUG::2011-01-18 19:50:42,261::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18870::DEBUG::2011-01-18 19:50:42,261::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '72d795a4-9583-45e2-87c6-72d8ffdaac89' Thread-18870::DEBUG::2011-01-18 19:50:42,262::resource::524::irs::Owner 72d795a4-9583-45e2-87c6-72d8ffdaac89: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18870::DEBUG::2011-01-18 19:50:42,262::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18870::DEBUG::2011-01-18 19:50:42,262::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: ref 1 aborting False Thread-18870::INFO::2011-01-18 19:50:42,263::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18870::DEBUG::2011-01-18 19:50:42,263::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18870::DEBUG::2011-01-18 19:50:42,264::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: moving from state preparing -> state finished Thread-18870::DEBUG::2011-01-18 19:50:42,264::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18870::DEBUG::2011-01-18 19:50:42,264::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 72d795a4-9583-45e2-87c6-72d8ffdaac89 releasing Thread-18870::DEBUG::2011-01-18 19:50:42,264::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18870::DEBUG::2011-01-18 19:50:42,265::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18870::DEBUG::2011-01-18 19:50:42,265::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18870::DEBUG::2011-01-18 19:50:42,265::resource::503::irs::Owner 72d795a4-9583-45e2-87c6-72d8ffdaac89: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18870::DEBUG::2011-01-18 19:50:42,266::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18870::DEBUG::2011-01-18 19:50:42,266::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18870::DEBUG::2011-01-18 19:50:42,266::task::577::irs::Task 72d795a4-9583-45e2-87c6-72d8ffdaac89: ref 0 aborting False Thread-18870::INFO::2011-01-18 19:50:42,266::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:50:43,143::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:43,676::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50084 seconds, 2.0 MB/s\n'; = 0 Thread-18871::INFO::2011-01-18 19:50:43,748::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18871::DEBUG::2011-01-18 19:50:43,749::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: moving from state init -> state preparing Thread-18871::DEBUG::2011-01-18 19:50:43,749::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f0704887-26ef-4f5e-a89f-8e4dd784b586 acquire shared (120000) Thread-18871::DEBUG::2011-01-18 19:50:43,749::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18871::DEBUG::2011-01-18 19:50:43,750::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f0704887-26ef-4f5e-a89f-8e4dd784b586' Thread-18871::DEBUG::2011-01-18 19:50:43,750::resource::524::irs::Owner f0704887-26ef-4f5e-a89f-8e4dd784b586: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18871::DEBUG::2011-01-18 19:50:43,750::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18871::DEBUG::2011-01-18 19:50:43,750::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: ref 1 aborting False Thread-18871::DEBUG::2011-01-18 19:50:43,751::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0487990379333', 'lastCheck': 1295373039.563648, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0471889972687', 'lastCheck': 1295373039.5690601, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0496060848236', 'lastCheck': 1295373039.5655351, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0459949970245', 'lastCheck': 1295373039.593945, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0457367897034', 'lastCheck': 1295373039.5715959, 'valid': True, 'code': 0}} Thread-18871::DEBUG::2011-01-18 19:50:43,751::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: moving from state preparing -> state finished Thread-18871::DEBUG::2011-01-18 19:50:43,751::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18871::DEBUG::2011-01-18 19:50:43,752::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f0704887-26ef-4f5e-a89f-8e4dd784b586 releasing Thread-18871::DEBUG::2011-01-18 19:50:43,752::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18871::DEBUG::2011-01-18 19:50:43,752::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18871::DEBUG::2011-01-18 19:50:43,752::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18871::DEBUG::2011-01-18 19:50:43,753::resource::503::irs::Owner f0704887-26ef-4f5e-a89f-8e4dd784b586: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18871::DEBUG::2011-01-18 19:50:43,753::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18871::DEBUG::2011-01-18 19:50:43,753::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18871::DEBUG::2011-01-18 19:50:43,754::task::577::irs::Task f0704887-26ef-4f5e-a89f-8e4dd784b586: ref 0 aborting False Thread-18871::INFO::2011-01-18 19:50:43,754::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0487990379333', 'lastCheck': 1295373039.563648, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0496060848236', 'lastCheck': 1295373039.5655351, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0457367897034', 'lastCheck': 1295373039.5715959, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0459949970245', 'lastCheck': 1295373039.593945, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0471889972687', 'lastCheck': 1295373039.5690601, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:50:45,689::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:46,232::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511427 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:48,245::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:48,777::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500443 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:50:49,562::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:50:49,563::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:50:49,566::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:50:49,568::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:50:49,570::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18497::INFO::2011-01-18 19:50:49,571::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::DEBUG::2011-01-18 19:50:49,572::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:50:49,573::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:50:49,594::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:50:49,595::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:50:49,607::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:50:49,608::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:50:49,615::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:50:49,617::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:50:49,640::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:50,789::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:51,324::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503012 seconds, 2.0 MB/s\n'; = 0 Thread-18877::INFO::2011-01-18 19:50:52,319::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18877::DEBUG::2011-01-18 19:50:52,320::task::577::irs::Task e7c92aa4-d11a-49dd-a1f1-67f58da629d2: moving from state init -> state preparing Thread-18877::DEBUG::2011-01-18 19:50:52,320::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18877::DEBUG::2011-01-18 19:50:52,352::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00044 seconds, 4.7 MB/s\n'; = 0 Thread-18877::DEBUG::2011-01-18 19:50:52,352::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00044 seconds, 4.7 MB/s'], size: 2048 Thread-18877::DEBUG::2011-01-18 19:50:52,352::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18877::DEBUG::2011-01-18 19:50:52,353::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18877::DEBUG::2011-01-18 19:50:52,354::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18877::DEBUG::2011-01-18 19:50:52,354::task::577::irs::Task e7c92aa4-d11a-49dd-a1f1-67f58da629d2: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18877::DEBUG::2011-01-18 19:50:52,355::task::577::irs::Task e7c92aa4-d11a-49dd-a1f1-67f58da629d2: moving from state preparing -> state finished Thread-18877::DEBUG::2011-01-18 19:50:52,355::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18877::DEBUG::2011-01-18 19:50:52,355::task::577::irs::Task e7c92aa4-d11a-49dd-a1f1-67f58da629d2: ref 0 aborting False Thread-18877::INFO::2011-01-18 19:50:52,356::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18878::INFO::2011-01-18 19:50:52,364::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18878::DEBUG::2011-01-18 19:50:52,364::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: moving from state init -> state preparing Thread-18878::DEBUG::2011-01-18 19:50:52,365::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 29ef51b1-ae0e-4f40-afab-e94c007befbc acquire shared (120000) Thread-18878::DEBUG::2011-01-18 19:50:52,365::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18878::DEBUG::2011-01-18 19:50:52,365::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '29ef51b1-ae0e-4f40-afab-e94c007befbc' Thread-18878::DEBUG::2011-01-18 19:50:52,365::resource::524::irs::Owner 29ef51b1-ae0e-4f40-afab-e94c007befbc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18878::DEBUG::2011-01-18 19:50:52,366::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18878::DEBUG::2011-01-18 19:50:52,366::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: ref 1 aborting False Thread-18878::INFO::2011-01-18 19:50:52,366::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18878::DEBUG::2011-01-18 19:50:52,367::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18878::DEBUG::2011-01-18 19:50:52,367::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: moving from state preparing -> state finished Thread-18878::DEBUG::2011-01-18 19:50:52,368::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18878::DEBUG::2011-01-18 19:50:52,368::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 29ef51b1-ae0e-4f40-afab-e94c007befbc releasing Thread-18878::DEBUG::2011-01-18 19:50:52,368::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18878::DEBUG::2011-01-18 19:50:52,369::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18878::DEBUG::2011-01-18 19:50:52,369::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18878::DEBUG::2011-01-18 19:50:52,369::resource::503::irs::Owner 29ef51b1-ae0e-4f40-afab-e94c007befbc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18878::DEBUG::2011-01-18 19:50:52,370::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18878::DEBUG::2011-01-18 19:50:52,370::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18878::DEBUG::2011-01-18 19:50:52,370::task::577::irs::Task 29ef51b1-ae0e-4f40-afab-e94c007befbc: ref 0 aborting False Thread-18878::INFO::2011-01-18 19:50:52,370::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:50:53,338::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:53,872::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501623 seconds, 2.0 MB/s\n'; = 0 Thread-18879::INFO::2011-01-18 19:50:53,919::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18879::DEBUG::2011-01-18 19:50:53,919::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: moving from state init -> state preparing Thread-18879::DEBUG::2011-01-18 19:50:53,919::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 296b84e6-8009-4cb8-a771-d328da55d17b acquire shared (120000) Thread-18879::DEBUG::2011-01-18 19:50:53,920::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18879::DEBUG::2011-01-18 19:50:53,920::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '296b84e6-8009-4cb8-a771-d328da55d17b' Thread-18879::DEBUG::2011-01-18 19:50:53,920::resource::524::irs::Owner 296b84e6-8009-4cb8-a771-d328da55d17b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18879::DEBUG::2011-01-18 19:50:53,920::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18879::DEBUG::2011-01-18 19:50:53,921::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: ref 1 aborting False Thread-18879::DEBUG::2011-01-18 19:50:53,921::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0517289638519', 'lastCheck': 1295373049.614568, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0484721660614', 'lastCheck': 1295373049.6185651, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0490829944611', 'lastCheck': 1295373049.6154079, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0507829189301', 'lastCheck': 1295373049.6446559, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0495889186859', 'lastCheck': 1295373049.6207399, 'valid': True, 'code': 0}} Thread-18879::DEBUG::2011-01-18 19:50:53,922::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: moving from state preparing -> state finished Thread-18879::DEBUG::2011-01-18 19:50:53,922::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18879::DEBUG::2011-01-18 19:50:53,922::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 296b84e6-8009-4cb8-a771-d328da55d17b releasing Thread-18879::DEBUG::2011-01-18 19:50:53,922::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18879::DEBUG::2011-01-18 19:50:53,923::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18879::DEBUG::2011-01-18 19:50:53,923::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18879::DEBUG::2011-01-18 19:50:53,923::resource::503::irs::Owner 296b84e6-8009-4cb8-a771-d328da55d17b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18879::DEBUG::2011-01-18 19:50:53,923::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18879::DEBUG::2011-01-18 19:50:53,924::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18879::DEBUG::2011-01-18 19:50:53,924::task::577::irs::Task 296b84e6-8009-4cb8-a771-d328da55d17b: ref 0 aborting False Thread-18879::INFO::2011-01-18 19:50:53,924::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0517289638519', 'lastCheck': 1295373049.614568, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0490829944611', 'lastCheck': 1295373049.6154079, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0495889186859', 'lastCheck': 1295373049.6207399, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0507829189301', 'lastCheck': 1295373049.6446559, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0484721660614', 'lastCheck': 1295373049.6185651, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:50:55,884::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:56,427::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510792 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:50:58,442::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:50:58,980::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504991 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:50:59,613::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:50:59,614::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:50:59,614::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:50:59,617::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:50:59,618::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:50:59,618::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:50:59,621::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:50:59,622::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:50:59,644::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:50:59,646::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:50:59,656::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:50:59,658::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:50:59,667::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:50:59,668::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:50:59,691::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:00,994::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:01,531::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504601 seconds, 2.0 MB/s\n'; = 0 Thread-18885::INFO::2011-01-18 19:51:02,422::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18885::DEBUG::2011-01-18 19:51:02,423::task::577::irs::Task 5984b26f-4f9d-434f-90be-c8203c21a318: moving from state init -> state preparing Thread-18885::DEBUG::2011-01-18 19:51:02,423::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18885::DEBUG::2011-01-18 19:51:02,455::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000598 seconds, 3.4 MB/s\n'; = 0 Thread-18885::DEBUG::2011-01-18 19:51:02,455::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000598 seconds, 3.4 MB/s'], size: 2048 Thread-18885::DEBUG::2011-01-18 19:51:02,456::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18885::DEBUG::2011-01-18 19:51:02,456::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18885::DEBUG::2011-01-18 19:51:02,457::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18885::DEBUG::2011-01-18 19:51:02,457::task::577::irs::Task 5984b26f-4f9d-434f-90be-c8203c21a318: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18885::DEBUG::2011-01-18 19:51:02,457::task::577::irs::Task 5984b26f-4f9d-434f-90be-c8203c21a318: moving from state preparing -> state finished Thread-18885::DEBUG::2011-01-18 19:51:02,458::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18885::DEBUG::2011-01-18 19:51:02,458::task::577::irs::Task 5984b26f-4f9d-434f-90be-c8203c21a318: ref 0 aborting False Thread-18885::INFO::2011-01-18 19:51:02,458::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18886::INFO::2011-01-18 19:51:02,466::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18886::DEBUG::2011-01-18 19:51:02,467::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: moving from state init -> state preparing Thread-18886::DEBUG::2011-01-18 19:51:02,467::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 84b20204-8cdc-4aec-bfce-b01a6295d006 acquire shared (120000) Thread-18886::DEBUG::2011-01-18 19:51:02,467::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18886::DEBUG::2011-01-18 19:51:02,468::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '84b20204-8cdc-4aec-bfce-b01a6295d006' Thread-18886::DEBUG::2011-01-18 19:51:02,468::resource::524::irs::Owner 84b20204-8cdc-4aec-bfce-b01a6295d006: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18886::DEBUG::2011-01-18 19:51:02,468::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18886::DEBUG::2011-01-18 19:51:02,469::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: ref 1 aborting False Thread-18886::INFO::2011-01-18 19:51:02,469::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18886::DEBUG::2011-01-18 19:51:02,470::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18886::DEBUG::2011-01-18 19:51:02,470::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: moving from state preparing -> state finished Thread-18886::DEBUG::2011-01-18 19:51:02,470::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18886::DEBUG::2011-01-18 19:51:02,471::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 84b20204-8cdc-4aec-bfce-b01a6295d006 releasing Thread-18886::DEBUG::2011-01-18 19:51:02,471::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18886::DEBUG::2011-01-18 19:51:02,471::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18886::DEBUG::2011-01-18 19:51:02,471::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18886::DEBUG::2011-01-18 19:51:02,472::resource::503::irs::Owner 84b20204-8cdc-4aec-bfce-b01a6295d006: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18886::DEBUG::2011-01-18 19:51:02,472::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18886::DEBUG::2011-01-18 19:51:02,472::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18886::DEBUG::2011-01-18 19:51:02,473::task::577::irs::Task 84b20204-8cdc-4aec-bfce-b01a6295d006: ref 0 aborting False Thread-18886::INFO::2011-01-18 19:51:02,473::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:51:03,544::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:04,078::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50279 seconds, 2.0 MB/s\n'; = 0 Thread-18887::INFO::2011-01-18 19:51:04,095::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18887::DEBUG::2011-01-18 19:51:04,095::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: moving from state init -> state preparing Thread-18887::DEBUG::2011-01-18 19:51:04,095::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fe6a54b0-73dc-4f6f-b6f5-933452ae1512 acquire shared (120000) Thread-18887::DEBUG::2011-01-18 19:51:04,096::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18887::DEBUG::2011-01-18 19:51:04,096::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fe6a54b0-73dc-4f6f-b6f5-933452ae1512' Thread-18887::DEBUG::2011-01-18 19:51:04,096::resource::524::irs::Owner fe6a54b0-73dc-4f6f-b6f5-933452ae1512: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18887::DEBUG::2011-01-18 19:51:04,097::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18887::DEBUG::2011-01-18 19:51:04,097::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: ref 1 aborting False Thread-18887::DEBUG::2011-01-18 19:51:04,097::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0485739707947', 'lastCheck': 1295373059.662416, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0537650585175', 'lastCheck': 1295373059.6718171, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049614906311', 'lastCheck': 1295373059.6645119, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0519418716431', 'lastCheck': 1295373059.69625, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0502729415894', 'lastCheck': 1295373059.671258, 'valid': True, 'code': 0}} Thread-18887::DEBUG::2011-01-18 19:51:04,098::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: moving from state preparing -> state finished Thread-18887::DEBUG::2011-01-18 19:51:04,098::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18887::DEBUG::2011-01-18 19:51:04,098::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fe6a54b0-73dc-4f6f-b6f5-933452ae1512 releasing Thread-18887::DEBUG::2011-01-18 19:51:04,099::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18887::DEBUG::2011-01-18 19:51:04,099::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18887::DEBUG::2011-01-18 19:51:04,099::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18887::DEBUG::2011-01-18 19:51:04,099::resource::503::irs::Owner fe6a54b0-73dc-4f6f-b6f5-933452ae1512: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18887::DEBUG::2011-01-18 19:51:04,100::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18887::DEBUG::2011-01-18 19:51:04,100::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18887::DEBUG::2011-01-18 19:51:04,100::task::577::irs::Task fe6a54b0-73dc-4f6f-b6f5-933452ae1512: ref 0 aborting False Thread-18887::INFO::2011-01-18 19:51:04,101::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0485739707947', 'lastCheck': 1295373059.662416, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049614906311', 'lastCheck': 1295373059.6645119, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0502729415894', 'lastCheck': 1295373059.671258, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0519418716431', 'lastCheck': 1295373059.69625, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0537650585175', 'lastCheck': 1295373059.6718171, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:51:06,095::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:06,640::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512952 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:08,653::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:09,187::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502835 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:51:09,661::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:51:09,662::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:51:09,666::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:51:09,667::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:51:09,671::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::INFO::2011-01-18 19:51:09,672::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18497::DEBUG::2011-01-18 19:51:09,673::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:51:09,673::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:51:09,696::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:51:09,697::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:51:09,704::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:09,706::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata count=1' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:09,707::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:51:09,716::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:51:09,718::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:51:09,737::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:09,742::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000861 seconds, 2.4 MB/s\n'; = 0 Thread-18493::DEBUG::2011-01-18 19:51:09,743::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000861 seconds, 2.4 MB/s'], size: 2048 Thread-18493::DEBUG::2011-01-18 19:51:09,743::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_3', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE18,uuid:Qgf46A-WY12-2WRV-PrRt-wlBf-dG5l-Y0CiR2,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE19,uuid:I9Af7U-Xs1p-25wD-eipC-Fidg-XxVv-g51Ql4,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE16,uuid:Nvl4M2-De3J-JsKJ-JkBe-GZ6s-AjKD-lcInZA,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE17,uuid:bLZC8w-2nd6-mSQL-l7bf-qTMV-V0zG-2AjV5E,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE23,uuid:6a4K6m-i3eH-fMq3-o87l-7Vrd-u85A-gukoFD,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE22,uuid:Bq8FkT-8D7Z-QeDV-eZzx-RGR3-UzBm-xdyAgL,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE21,uuid:Vnwbgp-85vv-DFdc-LxUu-kPBu-pkQ3-jsIHqv,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE20,uuid:WqzA8s-xBVm-fjUO-1mxU-s8GQ-BTji-sWHK8S,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=u7udFg-03KL-F8eg-BQhY-TAJA-bV0h-ylO1p8', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=8fd1c0112168759eac1d4afe75228b2ee79efc2f'] Thread-18493::DEBUG::2011-01-18 19:51:09,744::metadata::89::irs::metadata.__validate() __cksum(md) = 8fd1c0112168759eac1d4afe75228b2ee79efc2f Dummy-18546::DEBUG::2011-01-18 19:51:11,200::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:11,732::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50003 seconds, 2.0 MB/s\n'; = 0 Thread-18893::INFO::2011-01-18 19:51:12,526::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18893::DEBUG::2011-01-18 19:51:12,527::task::577::irs::Task 092a0c79-38a2-448c-8902-b5e8f546c757: moving from state init -> state preparing Thread-18893::DEBUG::2011-01-18 19:51:12,527::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18893::DEBUG::2011-01-18 19:51:12,559::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000479 seconds, 4.3 MB/s\n'; = 0 Thread-18893::DEBUG::2011-01-18 19:51:12,559::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000479 seconds, 4.3 MB/s'], size: 2048 Thread-18893::DEBUG::2011-01-18 19:51:12,560::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18893::DEBUG::2011-01-18 19:51:12,560::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18893::DEBUG::2011-01-18 19:51:12,561::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18893::DEBUG::2011-01-18 19:51:12,561::task::577::irs::Task 092a0c79-38a2-448c-8902-b5e8f546c757: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18893::DEBUG::2011-01-18 19:51:12,561::task::577::irs::Task 092a0c79-38a2-448c-8902-b5e8f546c757: moving from state preparing -> state finished Thread-18893::DEBUG::2011-01-18 19:51:12,562::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18893::DEBUG::2011-01-18 19:51:12,562::task::577::irs::Task 092a0c79-38a2-448c-8902-b5e8f546c757: ref 0 aborting False Thread-18893::INFO::2011-01-18 19:51:12,562::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18894::INFO::2011-01-18 19:51:12,570::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18894::DEBUG::2011-01-18 19:51:12,570::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: moving from state init -> state preparing Thread-18894::DEBUG::2011-01-18 19:51:12,571::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fafa711e-8a5b-49d9-8e3b-b5df67e030b1 acquire shared (120000) Thread-18894::DEBUG::2011-01-18 19:51:12,571::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18894::DEBUG::2011-01-18 19:51:12,571::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fafa711e-8a5b-49d9-8e3b-b5df67e030b1' Thread-18894::DEBUG::2011-01-18 19:51:12,572::resource::524::irs::Owner fafa711e-8a5b-49d9-8e3b-b5df67e030b1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18894::DEBUG::2011-01-18 19:51:12,572::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18894::DEBUG::2011-01-18 19:51:12,572::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: ref 1 aborting False Thread-18894::INFO::2011-01-18 19:51:12,573::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18894::DEBUG::2011-01-18 19:51:12,573::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18894::DEBUG::2011-01-18 19:51:12,574::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: moving from state preparing -> state finished Thread-18894::DEBUG::2011-01-18 19:51:12,574::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18894::DEBUG::2011-01-18 19:51:12,574::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fafa711e-8a5b-49d9-8e3b-b5df67e030b1 releasing Thread-18894::DEBUG::2011-01-18 19:51:12,575::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18894::DEBUG::2011-01-18 19:51:12,575::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18894::DEBUG::2011-01-18 19:51:12,575::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18894::DEBUG::2011-01-18 19:51:12,575::resource::503::irs::Owner fafa711e-8a5b-49d9-8e3b-b5df67e030b1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18894::DEBUG::2011-01-18 19:51:12,576::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18894::DEBUG::2011-01-18 19:51:12,576::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18894::DEBUG::2011-01-18 19:51:12,576::task::577::irs::Task fafa711e-8a5b-49d9-8e3b-b5df67e030b1: ref 0 aborting False Thread-18894::INFO::2011-01-18 19:51:12,577::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:51:13,746::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18895::INFO::2011-01-18 19:51:14,259::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18895::DEBUG::2011-01-18 19:51:14,259::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: moving from state init -> state preparing Thread-18895::DEBUG::2011-01-18 19:51:14,260::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4f0afe49-d807-4826-a471-d37f62647f2c acquire shared (120000) Thread-18895::DEBUG::2011-01-18 19:51:14,260::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18895::DEBUG::2011-01-18 19:51:14,261::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4f0afe49-d807-4826-a471-d37f62647f2c' Thread-18895::DEBUG::2011-01-18 19:51:14,261::resource::524::irs::Owner 4f0afe49-d807-4826-a471-d37f62647f2c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18895::DEBUG::2011-01-18 19:51:14,261::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18895::DEBUG::2011-01-18 19:51:14,262::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: ref 1 aborting False Thread-18895::DEBUG::2011-01-18 19:51:14,262::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.08726811409', 'lastCheck': 1295373069.7491081, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0501499176025', 'lastCheck': 1295373069.722121, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0499260425568', 'lastCheck': 1295373069.715987, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463161468506', 'lastCheck': 1295373069.742228, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.049026966095', 'lastCheck': 1295373069.71998, 'valid': True, 'code': 0}} Thread-18895::DEBUG::2011-01-18 19:51:14,263::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: moving from state preparing -> state finished Thread-18895::DEBUG::2011-01-18 19:51:14,263::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18895::DEBUG::2011-01-18 19:51:14,263::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4f0afe49-d807-4826-a471-d37f62647f2c releasing Thread-18895::DEBUG::2011-01-18 19:51:14,264::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18895::DEBUG::2011-01-18 19:51:14,264::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18895::DEBUG::2011-01-18 19:51:14,264::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18895::DEBUG::2011-01-18 19:51:14,265::resource::503::irs::Owner 4f0afe49-d807-4826-a471-d37f62647f2c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18895::DEBUG::2011-01-18 19:51:14,265::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18895::DEBUG::2011-01-18 19:51:14,265::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18895::DEBUG::2011-01-18 19:51:14,266::task::577::irs::Task 4f0afe49-d807-4826-a471-d37f62647f2c: ref 0 aborting False Thread-18895::INFO::2011-01-18 19:51:14,266::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.08726811409', 'lastCheck': 1295373069.7491081, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0499260425568', 'lastCheck': 1295373069.715987, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.049026966095', 'lastCheck': 1295373069.71998, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0463161468506', 'lastCheck': 1295373069.742228, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0501499176025', 'lastCheck': 1295373069.722121, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:51:14,285::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506724 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:16,300::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:16,847::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.515175 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:18,861::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:19,394::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501879 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 19:51:19,715::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:51:19,716::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:51:19,720::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:51:19,721::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:51:19,723::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:51:19,724::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:51:19,742::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:51:19,743::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:51:19,749::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:51:19,750::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:19,757::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:51:19,766::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:51:19,767::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:51:19,783::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:19,792::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:21,407::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:21,943::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504227 seconds, 2.0 MB/s\n'; = 0 Thread-18901::INFO::2011-01-18 19:51:22,630::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18901::DEBUG::2011-01-18 19:51:22,631::task::577::irs::Task 79eced6f-eb09-47fa-9410-057abddb2856: moving from state init -> state preparing Thread-18901::DEBUG::2011-01-18 19:51:22,631::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18901::DEBUG::2011-01-18 19:51:22,663::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000421 seconds, 4.9 MB/s\n'; = 0 Thread-18901::DEBUG::2011-01-18 19:51:22,664::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000421 seconds, 4.9 MB/s'], size: 2048 Thread-18901::DEBUG::2011-01-18 19:51:22,664::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18901::DEBUG::2011-01-18 19:51:22,665::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18901::DEBUG::2011-01-18 19:51:22,665::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18901::DEBUG::2011-01-18 19:51:22,665::task::577::irs::Task 79eced6f-eb09-47fa-9410-057abddb2856: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18901::DEBUG::2011-01-18 19:51:22,666::task::577::irs::Task 79eced6f-eb09-47fa-9410-057abddb2856: moving from state preparing -> state finished Thread-18901::DEBUG::2011-01-18 19:51:22,666::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18901::DEBUG::2011-01-18 19:51:22,666::task::577::irs::Task 79eced6f-eb09-47fa-9410-057abddb2856: ref 0 aborting False Thread-18901::INFO::2011-01-18 19:51:22,667::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18902::INFO::2011-01-18 19:51:22,675::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18902::DEBUG::2011-01-18 19:51:22,675::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: moving from state init -> state preparing Thread-18902::DEBUG::2011-01-18 19:51:22,675::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 41f8ad07-2c3d-483d-8668-a151f2dfc0bf acquire shared (120000) Thread-18902::DEBUG::2011-01-18 19:51:22,676::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18902::DEBUG::2011-01-18 19:51:22,676::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '41f8ad07-2c3d-483d-8668-a151f2dfc0bf' Thread-18902::DEBUG::2011-01-18 19:51:22,676::resource::524::irs::Owner 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18902::DEBUG::2011-01-18 19:51:22,676::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18902::DEBUG::2011-01-18 19:51:22,677::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: ref 1 aborting False Thread-18902::INFO::2011-01-18 19:51:22,677::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18902::DEBUG::2011-01-18 19:51:22,678::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18902::DEBUG::2011-01-18 19:51:22,678::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: moving from state preparing -> state finished Thread-18902::DEBUG::2011-01-18 19:51:22,679::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18902::DEBUG::2011-01-18 19:51:22,679::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 41f8ad07-2c3d-483d-8668-a151f2dfc0bf releasing Thread-18902::DEBUG::2011-01-18 19:51:22,679::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18902::DEBUG::2011-01-18 19:51:22,679::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18902::DEBUG::2011-01-18 19:51:22,680::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18902::DEBUG::2011-01-18 19:51:22,680::resource::503::irs::Owner 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18902::DEBUG::2011-01-18 19:51:22,680::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18902::DEBUG::2011-01-18 19:51:22,680::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18902::DEBUG::2011-01-18 19:51:22,681::task::577::irs::Task 41f8ad07-2c3d-483d-8668-a151f2dfc0bf: ref 0 aborting False Thread-18902::INFO::2011-01-18 19:51:22,681::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:51:23,956::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18903::INFO::2011-01-18 19:51:24,424::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18903::DEBUG::2011-01-18 19:51:24,424::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: moving from state init -> state preparing Thread-18903::DEBUG::2011-01-18 19:51:24,425::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4861800c-b1e4-4591-ae4d-296d35f6c351 acquire shared (120000) Thread-18903::DEBUG::2011-01-18 19:51:24,425::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18903::DEBUG::2011-01-18 19:51:24,425::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4861800c-b1e4-4591-ae4d-296d35f6c351' Thread-18903::DEBUG::2011-01-18 19:51:24,426::resource::524::irs::Owner 4861800c-b1e4-4591-ae4d-296d35f6c351: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18903::DEBUG::2011-01-18 19:51:24,426::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18903::DEBUG::2011-01-18 19:51:24,426::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: ref 1 aborting False Thread-18903::DEBUG::2011-01-18 19:51:24,427::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0478248596191', 'lastCheck': 1295373079.796701, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0467939376831', 'lastCheck': 1295373079.769809, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0478830337524', 'lastCheck': 1295373079.76373, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466768741608', 'lastCheck': 1295373079.7885699, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0509679317474', 'lastCheck': 1295373079.770879, 'valid': True, 'code': 0}} Thread-18903::DEBUG::2011-01-18 19:51:24,427::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: moving from state preparing -> state finished Thread-18903::DEBUG::2011-01-18 19:51:24,428::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18903::DEBUG::2011-01-18 19:51:24,428::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4861800c-b1e4-4591-ae4d-296d35f6c351 releasing Thread-18903::DEBUG::2011-01-18 19:51:24,428::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18903::DEBUG::2011-01-18 19:51:24,429::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18903::DEBUG::2011-01-18 19:51:24,429::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18903::DEBUG::2011-01-18 19:51:24,429::resource::503::irs::Owner 4861800c-b1e4-4591-ae4d-296d35f6c351: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18903::DEBUG::2011-01-18 19:51:24,430::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18903::DEBUG::2011-01-18 19:51:24,430::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18903::DEBUG::2011-01-18 19:51:24,430::task::577::irs::Task 4861800c-b1e4-4591-ae4d-296d35f6c351: ref 0 aborting False Thread-18903::INFO::2011-01-18 19:51:24,431::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0478248596191', 'lastCheck': 1295373079.796701, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0478830337524', 'lastCheck': 1295373079.76373, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0509679317474', 'lastCheck': 1295373079.770879, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466768741608', 'lastCheck': 1295373079.7885699, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0467939376831', 'lastCheck': 1295373079.769809, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:51:24,489::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50125 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:26,502::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:27,046::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510332 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:29,059::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:29,593::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502138 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 19:51:29,762::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:51:29,763::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:51:29,770::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:51:29,771::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:51:29,771::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:51:29,772::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:51:29,788::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:51:29,789::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:51:29,796::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:51:29,797::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:29,804::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:51:29,814::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:51:29,821::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:51:29,830::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:29,839::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:31,606::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:32,139::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500735 seconds, 2.0 MB/s\n'; = 0 Thread-18909::INFO::2011-01-18 19:51:32,734::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18909::DEBUG::2011-01-18 19:51:32,735::task::577::irs::Task 774427f4-7f8a-41a7-aafb-772185d10629: moving from state init -> state preparing Thread-18909::DEBUG::2011-01-18 19:51:32,735::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18909::DEBUG::2011-01-18 19:51:32,767::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000421 seconds, 4.9 MB/s\n'; = 0 Thread-18909::DEBUG::2011-01-18 19:51:32,767::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000421 seconds, 4.9 MB/s'], size: 2048 Thread-18909::DEBUG::2011-01-18 19:51:32,768::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18909::DEBUG::2011-01-18 19:51:32,768::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18909::DEBUG::2011-01-18 19:51:32,769::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18909::DEBUG::2011-01-18 19:51:32,769::task::577::irs::Task 774427f4-7f8a-41a7-aafb-772185d10629: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18909::DEBUG::2011-01-18 19:51:32,769::task::577::irs::Task 774427f4-7f8a-41a7-aafb-772185d10629: moving from state preparing -> state finished Thread-18909::DEBUG::2011-01-18 19:51:32,770::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18909::DEBUG::2011-01-18 19:51:32,770::task::577::irs::Task 774427f4-7f8a-41a7-aafb-772185d10629: ref 0 aborting False Thread-18909::INFO::2011-01-18 19:51:32,770::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18910::INFO::2011-01-18 19:51:32,778::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18910::DEBUG::2011-01-18 19:51:32,778::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: moving from state init -> state preparing Thread-18910::DEBUG::2011-01-18 19:51:32,779::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4b81d3d0-73ba-4caa-9e58-f668ddccd577 acquire shared (120000) Thread-18910::DEBUG::2011-01-18 19:51:32,779::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18910::DEBUG::2011-01-18 19:51:32,779::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4b81d3d0-73ba-4caa-9e58-f668ddccd577' Thread-18910::DEBUG::2011-01-18 19:51:32,780::resource::524::irs::Owner 4b81d3d0-73ba-4caa-9e58-f668ddccd577: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18910::DEBUG::2011-01-18 19:51:32,780::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18910::DEBUG::2011-01-18 19:51:32,780::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: ref 1 aborting False Thread-18910::INFO::2011-01-18 19:51:32,781::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18910::DEBUG::2011-01-18 19:51:32,781::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18910::DEBUG::2011-01-18 19:51:32,782::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: moving from state preparing -> state finished Thread-18910::DEBUG::2011-01-18 19:51:32,782::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18910::DEBUG::2011-01-18 19:51:32,782::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4b81d3d0-73ba-4caa-9e58-f668ddccd577 releasing Thread-18910::DEBUG::2011-01-18 19:51:32,783::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18910::DEBUG::2011-01-18 19:51:32,783::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18910::DEBUG::2011-01-18 19:51:32,783::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18910::DEBUG::2011-01-18 19:51:32,783::resource::503::irs::Owner 4b81d3d0-73ba-4caa-9e58-f668ddccd577: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18910::DEBUG::2011-01-18 19:51:32,784::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18910::DEBUG::2011-01-18 19:51:32,784::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18910::DEBUG::2011-01-18 19:51:32,784::task::577::irs::Task 4b81d3d0-73ba-4caa-9e58-f668ddccd577: ref 0 aborting False Thread-18910::INFO::2011-01-18 19:51:32,785::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:51:34,153::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:34,686::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501361 seconds, 2.0 MB/s\n'; = 0 Thread-18911::INFO::2011-01-18 19:51:34,701::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18911::DEBUG::2011-01-18 19:51:34,702::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: moving from state init -> state preparing Thread-18911::DEBUG::2011-01-18 19:51:34,702::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 676da56b-c0f4-4e67-ab5a-583bcd9484ef acquire shared (120000) Thread-18911::DEBUG::2011-01-18 19:51:34,702::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18911::DEBUG::2011-01-18 19:51:34,702::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '676da56b-c0f4-4e67-ab5a-583bcd9484ef' Thread-18911::DEBUG::2011-01-18 19:51:34,703::resource::524::irs::Owner 676da56b-c0f4-4e67-ab5a-583bcd9484ef: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18911::DEBUG::2011-01-18 19:51:34,703::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18911::DEBUG::2011-01-18 19:51:34,703::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: ref 1 aborting False Thread-18911::DEBUG::2011-01-18 19:51:34,704::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0470879077911', 'lastCheck': 1295373089.8429689, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0554480552673', 'lastCheck': 1295373089.825357, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.048553943634', 'lastCheck': 1295373089.811409, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477440357208', 'lastCheck': 1295373089.835624, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0474178791046', 'lastCheck': 1295373089.8187439, 'valid': True, 'code': 0}} Thread-18911::DEBUG::2011-01-18 19:51:34,704::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: moving from state preparing -> state finished Thread-18911::DEBUG::2011-01-18 19:51:34,704::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18911::DEBUG::2011-01-18 19:51:34,705::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 676da56b-c0f4-4e67-ab5a-583bcd9484ef releasing Thread-18911::DEBUG::2011-01-18 19:51:34,705::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18911::DEBUG::2011-01-18 19:51:34,705::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18911::DEBUG::2011-01-18 19:51:34,705::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18911::DEBUG::2011-01-18 19:51:34,706::resource::503::irs::Owner 676da56b-c0f4-4e67-ab5a-583bcd9484ef: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18911::DEBUG::2011-01-18 19:51:34,706::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18911::DEBUG::2011-01-18 19:51:34,706::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18911::DEBUG::2011-01-18 19:51:34,707::task::577::irs::Task 676da56b-c0f4-4e67-ab5a-583bcd9484ef: ref 0 aborting False Thread-18911::INFO::2011-01-18 19:51:34,707::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0470879077911', 'lastCheck': 1295373089.8429689, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.048553943634', 'lastCheck': 1295373089.811409, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0474178791046', 'lastCheck': 1295373089.8187439, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477440357208', 'lastCheck': 1295373089.835624, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0554480552673', 'lastCheck': 1295373089.825357, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:51:36,699::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:37,232::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500611 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:39,244::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:39,788::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511043 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 19:51:39,810::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:51:39,811::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:51:39,818::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:51:39,819::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:51:39,825::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:51:39,826::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:51:39,835::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:51:39,836::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:51:39,843::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:51:39,844::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:39,858::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:51:39,859::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:51:39,869::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:51:39,884::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:39,884::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:41,801::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:42,333::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500431 seconds, 2.0 MB/s\n'; = 0 Thread-18916::INFO::2011-01-18 19:51:42,854::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18916::DEBUG::2011-01-18 19:51:42,854::task::577::irs::Task 36d62049-804c-40dc-ae89-caa3d271b857: moving from state init -> state preparing Thread-18916::DEBUG::2011-01-18 19:51:42,855::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18916::DEBUG::2011-01-18 19:51:42,886::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s\n'; = 0 Thread-18916::DEBUG::2011-01-18 19:51:42,886::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s'], size: 2048 Thread-18916::DEBUG::2011-01-18 19:51:42,887::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18916::DEBUG::2011-01-18 19:51:42,887::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18916::DEBUG::2011-01-18 19:51:42,888::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18916::DEBUG::2011-01-18 19:51:42,888::task::577::irs::Task 36d62049-804c-40dc-ae89-caa3d271b857: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18916::DEBUG::2011-01-18 19:51:42,888::task::577::irs::Task 36d62049-804c-40dc-ae89-caa3d271b857: moving from state preparing -> state finished Thread-18916::DEBUG::2011-01-18 19:51:42,889::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18916::DEBUG::2011-01-18 19:51:42,889::task::577::irs::Task 36d62049-804c-40dc-ae89-caa3d271b857: ref 0 aborting False Thread-18916::INFO::2011-01-18 19:51:42,889::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18918::INFO::2011-01-18 19:51:42,897::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18918::DEBUG::2011-01-18 19:51:42,898::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: moving from state init -> state preparing Thread-18918::DEBUG::2011-01-18 19:51:42,898::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ca7da207-780c-442f-bccc-b8fd8efd331e acquire shared (120000) Thread-18918::DEBUG::2011-01-18 19:51:42,898::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18918::DEBUG::2011-01-18 19:51:42,899::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ca7da207-780c-442f-bccc-b8fd8efd331e' Thread-18918::DEBUG::2011-01-18 19:51:42,899::resource::524::irs::Owner ca7da207-780c-442f-bccc-b8fd8efd331e: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18918::DEBUG::2011-01-18 19:51:42,899::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18918::DEBUG::2011-01-18 19:51:42,899::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: ref 1 aborting False Thread-18918::INFO::2011-01-18 19:51:42,900::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18918::DEBUG::2011-01-18 19:51:42,900::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18918::DEBUG::2011-01-18 19:51:42,901::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: moving from state preparing -> state finished Thread-18918::DEBUG::2011-01-18 19:51:42,901::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18918::DEBUG::2011-01-18 19:51:42,901::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ca7da207-780c-442f-bccc-b8fd8efd331e releasing Thread-18918::DEBUG::2011-01-18 19:51:42,902::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18918::DEBUG::2011-01-18 19:51:42,902::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18918::DEBUG::2011-01-18 19:51:42,902::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18918::DEBUG::2011-01-18 19:51:42,903::resource::503::irs::Owner ca7da207-780c-442f-bccc-b8fd8efd331e: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18918::DEBUG::2011-01-18 19:51:42,903::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18918::DEBUG::2011-01-18 19:51:42,903::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18918::DEBUG::2011-01-18 19:51:42,903::task::577::irs::Task ca7da207-780c-442f-bccc-b8fd8efd331e: ref 0 aborting False Thread-18918::INFO::2011-01-18 19:51:42,904::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:51:44,346::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18919::INFO::2011-01-18 19:51:44,875::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18919::DEBUG::2011-01-18 19:51:44,875::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: moving from state init -> state preparing Thread-18919::DEBUG::2011-01-18 19:51:44,876::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b acquire shared (120000) Thread-18919::DEBUG::2011-01-18 19:51:44,876::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18919::DEBUG::2011-01-18 19:51:44,876::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1a1d39f4-43fd-4dd9-8e19-d4365bcc820b' Thread-18919::DEBUG::2011-01-18 19:51:44,877::resource::524::irs::Owner 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18919::DEBUG::2011-01-18 19:51:44,877::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18919::DEBUG::2011-01-18 19:51:44,878::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: ref 1 aborting False Thread-18919::DEBUG::2011-01-18 19:51:44,878::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450088977814', 'lastCheck': 1295373099.8879459, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0492911338806', 'lastCheck': 1295373099.8741641, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0548038482666', 'lastCheck': 1295373099.8656609, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0550129413605', 'lastCheck': 1295373099.889919, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0475800037384', 'lastCheck': 1295373099.8654909, 'valid': True, 'code': 0}} Thread-18919::DEBUG::2011-01-18 19:51:44,878::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: moving from state preparing -> state finished Thread-18919::DEBUG::2011-01-18 19:51:44,879::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18919::DEBUG::2011-01-18 19:51:44,879::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b releasing Thread-18919::DEBUG::2011-01-18 19:51:44,879::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Dummy-18546::DEBUG::2011-01-18 19:51:44,881::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502992 seconds, 2.0 MB/s\n'; = 0 Thread-18919::DEBUG::2011-01-18 19:51:44,881::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18919::DEBUG::2011-01-18 19:51:44,895::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18919::DEBUG::2011-01-18 19:51:44,896::resource::503::irs::Owner 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18919::DEBUG::2011-01-18 19:51:44,896::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18919::DEBUG::2011-01-18 19:51:44,896::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18919::DEBUG::2011-01-18 19:51:44,897::task::577::irs::Task 1a1d39f4-43fd-4dd9-8e19-d4365bcc820b: ref 0 aborting False Thread-18919::INFO::2011-01-18 19:51:44,897::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450088977814', 'lastCheck': 1295373099.8879459, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0548038482666', 'lastCheck': 1295373099.8656609, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0475800037384', 'lastCheck': 1295373099.8654909, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0550129413605', 'lastCheck': 1295373099.889919, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0492911338806', 'lastCheck': 1295373099.8741641, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:51:46,895::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:47,432::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504405 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:49,444::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 19:51:49,865::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18495::INFO::2011-01-18 19:51:49,865::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::DEBUG::2011-01-18 19:51:49,866::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:49,866::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:51:49,874::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:51:49,876::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:51:49,895::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:51:49,897::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:51:49,900::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:51:49,902::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:49,914::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:51:49,916::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:51:49,920::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:49,940::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:51:49,948::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:50,018::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.541047 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:52,031::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:52,563::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500601 seconds, 2.0 MB/s\n'; = 0 Thread-18924::INFO::2011-01-18 19:51:52,957::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18924::DEBUG::2011-01-18 19:51:52,958::task::577::irs::Task 2e829ee1-612b-4966-a8f3-6fa489ff239c: moving from state init -> state preparing Thread-18924::DEBUG::2011-01-18 19:51:52,958::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18924::DEBUG::2011-01-18 19:51:52,991::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000897 seconds, 2.3 MB/s\n'; = 0 Thread-18924::DEBUG::2011-01-18 19:51:52,991::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000897 seconds, 2.3 MB/s'], size: 2048 Thread-18924::DEBUG::2011-01-18 19:51:52,992::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18924::DEBUG::2011-01-18 19:51:52,992::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18924::DEBUG::2011-01-18 19:51:52,993::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18924::DEBUG::2011-01-18 19:51:52,993::task::577::irs::Task 2e829ee1-612b-4966-a8f3-6fa489ff239c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18924::DEBUG::2011-01-18 19:51:52,993::task::577::irs::Task 2e829ee1-612b-4966-a8f3-6fa489ff239c: moving from state preparing -> state finished Thread-18924::DEBUG::2011-01-18 19:51:52,994::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18924::DEBUG::2011-01-18 19:51:52,994::task::577::irs::Task 2e829ee1-612b-4966-a8f3-6fa489ff239c: ref 0 aborting False Thread-18924::INFO::2011-01-18 19:51:52,994::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18925::INFO::2011-01-18 19:51:53,003::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18925::DEBUG::2011-01-18 19:51:53,003::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: moving from state init -> state preparing Thread-18925::DEBUG::2011-01-18 19:51:53,003::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c3f69f21-b697-4d08-8313-6a9ab529a004 acquire shared (120000) Thread-18925::DEBUG::2011-01-18 19:51:53,004::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18925::DEBUG::2011-01-18 19:51:53,004::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c3f69f21-b697-4d08-8313-6a9ab529a004' Thread-18925::DEBUG::2011-01-18 19:51:53,004::resource::524::irs::Owner c3f69f21-b697-4d08-8313-6a9ab529a004: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18925::DEBUG::2011-01-18 19:51:53,004::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18925::DEBUG::2011-01-18 19:51:53,005::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: ref 1 aborting False Thread-18925::INFO::2011-01-18 19:51:53,005::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18925::DEBUG::2011-01-18 19:51:53,006::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18925::DEBUG::2011-01-18 19:51:53,006::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: moving from state preparing -> state finished Thread-18925::DEBUG::2011-01-18 19:51:53,007::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18925::DEBUG::2011-01-18 19:51:53,007::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c3f69f21-b697-4d08-8313-6a9ab529a004 releasing Thread-18925::DEBUG::2011-01-18 19:51:53,007::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18925::DEBUG::2011-01-18 19:51:53,007::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18925::DEBUG::2011-01-18 19:51:53,008::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18925::DEBUG::2011-01-18 19:51:53,008::resource::503::irs::Owner c3f69f21-b697-4d08-8313-6a9ab529a004: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18925::DEBUG::2011-01-18 19:51:53,008::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18925::DEBUG::2011-01-18 19:51:53,009::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18925::DEBUG::2011-01-18 19:51:53,009::task::577::irs::Task c3f69f21-b697-4d08-8313-6a9ab529a004: ref 0 aborting False Thread-18925::INFO::2011-01-18 19:51:53,009::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:51:54,576::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18927::INFO::2011-01-18 19:51:55,054::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18927::DEBUG::2011-01-18 19:51:55,054::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: moving from state init -> state preparing Thread-18927::DEBUG::2011-01-18 19:51:55,055::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c106d50-e725-47fc-8d7e-427a2176a97f acquire shared (120000) Thread-18927::DEBUG::2011-01-18 19:51:55,055::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18927::DEBUG::2011-01-18 19:51:55,055::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1c106d50-e725-47fc-8d7e-427a2176a97f' Thread-18927::DEBUG::2011-01-18 19:51:55,056::resource::524::irs::Owner 1c106d50-e725-47fc-8d7e-427a2176a97f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18927::DEBUG::2011-01-18 19:51:55,056::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18927::DEBUG::2011-01-18 19:51:55,057::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: ref 1 aborting False Thread-18927::DEBUG::2011-01-18 19:51:55,057::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490078926086', 'lastCheck': 1295373109.943897, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0506389141083', 'lastCheck': 1295373109.924521, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0542991161346', 'lastCheck': 1295373109.9197071, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0527739524841', 'lastCheck': 1295373109.9528069, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0572109222412', 'lastCheck': 1295373109.922071, 'valid': True, 'code': 0}} Thread-18927::DEBUG::2011-01-18 19:51:55,058::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: moving from state preparing -> state finished Thread-18927::DEBUG::2011-01-18 19:51:55,058::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18927::DEBUG::2011-01-18 19:51:55,058::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c106d50-e725-47fc-8d7e-427a2176a97f releasing Thread-18927::DEBUG::2011-01-18 19:51:55,059::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18927::DEBUG::2011-01-18 19:51:55,059::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18927::DEBUG::2011-01-18 19:51:55,059::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18927::DEBUG::2011-01-18 19:51:55,060::resource::503::irs::Owner 1c106d50-e725-47fc-8d7e-427a2176a97f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18927::DEBUG::2011-01-18 19:51:55,060::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18927::DEBUG::2011-01-18 19:51:55,061::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18927::DEBUG::2011-01-18 19:51:55,061::task::577::irs::Task 1c106d50-e725-47fc-8d7e-427a2176a97f: ref 0 aborting False Thread-18927::INFO::2011-01-18 19:51:55,061::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490078926086', 'lastCheck': 1295373109.943897, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0542991161346', 'lastCheck': 1295373109.9197071, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0572109222412', 'lastCheck': 1295373109.922071, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0527739524841', 'lastCheck': 1295373109.9528069, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0506389141083', 'lastCheck': 1295373109.924521, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:51:55,119::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511867 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:57,132::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:51:57,664::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500168 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:51:59,677::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::INFO::2011-01-18 19:51:59,919::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:51:59,919::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:51:59,922::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:51:59,923::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:51:59,924::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:51:59,927::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:51:59,944::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:51:59,946::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:51:59,953::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:51:59,955::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:51:59,965::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:51:59,966::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:51:59,969::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:51:59,990::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:51:59,999::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:00,242::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.532868 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:02,256::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:02,788::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500487 seconds, 2.0 MB/s\n'; = 0 Thread-18932::INFO::2011-01-18 19:52:03,072::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18932::DEBUG::2011-01-18 19:52:03,072::task::577::irs::Task f7620e9c-98e0-4d93-a7c9-d27f324d9cef: moving from state init -> state preparing Thread-18932::DEBUG::2011-01-18 19:52:03,073::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18932::DEBUG::2011-01-18 19:52:03,105::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000421 seconds, 4.9 MB/s\n'; = 0 Thread-18932::DEBUG::2011-01-18 19:52:03,105::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000421 seconds, 4.9 MB/s'], size: 2048 Thread-18932::DEBUG::2011-01-18 19:52:03,106::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18932::DEBUG::2011-01-18 19:52:03,106::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18932::DEBUG::2011-01-18 19:52:03,107::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18932::DEBUG::2011-01-18 19:52:03,107::task::577::irs::Task f7620e9c-98e0-4d93-a7c9-d27f324d9cef: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18932::DEBUG::2011-01-18 19:52:03,107::task::577::irs::Task f7620e9c-98e0-4d93-a7c9-d27f324d9cef: moving from state preparing -> state finished Thread-18932::DEBUG::2011-01-18 19:52:03,107::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18932::DEBUG::2011-01-18 19:52:03,108::task::577::irs::Task f7620e9c-98e0-4d93-a7c9-d27f324d9cef: ref 0 aborting False Thread-18932::INFO::2011-01-18 19:52:03,108::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18933::INFO::2011-01-18 19:52:03,116::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18933::DEBUG::2011-01-18 19:52:03,117::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: moving from state init -> state preparing Thread-18933::DEBUG::2011-01-18 19:52:03,117::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 19184260-c0c1-4504-b8f6-ab1371fb12cb acquire shared (120000) Thread-18933::DEBUG::2011-01-18 19:52:03,117::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18933::DEBUG::2011-01-18 19:52:03,117::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '19184260-c0c1-4504-b8f6-ab1371fb12cb' Thread-18933::DEBUG::2011-01-18 19:52:03,118::resource::524::irs::Owner 19184260-c0c1-4504-b8f6-ab1371fb12cb: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18933::DEBUG::2011-01-18 19:52:03,118::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18933::DEBUG::2011-01-18 19:52:03,118::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: ref 1 aborting False Thread-18933::INFO::2011-01-18 19:52:03,119::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18933::DEBUG::2011-01-18 19:52:03,120::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18933::DEBUG::2011-01-18 19:52:03,120::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: moving from state preparing -> state finished Thread-18933::DEBUG::2011-01-18 19:52:03,120::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18933::DEBUG::2011-01-18 19:52:03,121::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 19184260-c0c1-4504-b8f6-ab1371fb12cb releasing Thread-18933::DEBUG::2011-01-18 19:52:03,121::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18933::DEBUG::2011-01-18 19:52:03,121::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18933::DEBUG::2011-01-18 19:52:03,121::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18933::DEBUG::2011-01-18 19:52:03,122::resource::503::irs::Owner 19184260-c0c1-4504-b8f6-ab1371fb12cb: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18933::DEBUG::2011-01-18 19:52:03,122::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18933::DEBUG::2011-01-18 19:52:03,122::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18933::DEBUG::2011-01-18 19:52:03,122::task::577::irs::Task 19184260-c0c1-4504-b8f6-ab1371fb12cb: ref 0 aborting False Thread-18933::INFO::2011-01-18 19:52:03,123::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:52:04,802::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18935::INFO::2011-01-18 19:52:05,222::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18935::DEBUG::2011-01-18 19:52:05,223::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: moving from state init -> state preparing Thread-18935::DEBUG::2011-01-18 19:52:05,223::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9 acquire shared (120000) Thread-18935::DEBUG::2011-01-18 19:52:05,223::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18935::DEBUG::2011-01-18 19:52:05,224::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9' Thread-18935::DEBUG::2011-01-18 19:52:05,224::resource::524::irs::Owner 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18935::DEBUG::2011-01-18 19:52:05,224::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18935::DEBUG::2011-01-18 19:52:05,225::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: ref 1 aborting False Thread-18935::DEBUG::2011-01-18 19:52:05,225::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0500471591949', 'lastCheck': 1295373119.9940231, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0501039028168', 'lastCheck': 1295373119.9740889, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0555329322815', 'lastCheck': 1295373119.974381, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0512759685516', 'lastCheck': 1295373120.0041859, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0516419410706', 'lastCheck': 1295373119.973578, 'valid': True, 'code': 0}} Thread-18935::DEBUG::2011-01-18 19:52:05,226::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: moving from state preparing -> state finished Thread-18935::DEBUG::2011-01-18 19:52:05,226::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18935::DEBUG::2011-01-18 19:52:05,226::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9 releasing Thread-18935::DEBUG::2011-01-18 19:52:05,226::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18935::DEBUG::2011-01-18 19:52:05,227::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18935::DEBUG::2011-01-18 19:52:05,227::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18935::DEBUG::2011-01-18 19:52:05,227::resource::503::irs::Owner 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18935::DEBUG::2011-01-18 19:52:05,228::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18935::DEBUG::2011-01-18 19:52:05,228::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18935::DEBUG::2011-01-18 19:52:05,228::task::577::irs::Task 6ede9d3a-2f6c-45eb-93f6-adf16e86f3e9: ref 0 aborting False Thread-18935::INFO::2011-01-18 19:52:05,229::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0500471591949', 'lastCheck': 1295373119.9940231, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0555329322815', 'lastCheck': 1295373119.974381, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0516419410706', 'lastCheck': 1295373119.973578, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0512759685516', 'lastCheck': 1295373120.0041859, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0501039028168', 'lastCheck': 1295373119.9740889, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:52:05,341::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50722 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:07,354::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:07,886::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500363 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:09,899::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 19:52:09,973::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18495::INFO::2011-01-18 19:52:09,973::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::DEBUG::2011-01-18 19:52:09,974::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:52:09,974::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 19:52:09,975::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:52:09,976::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:52:09,994::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:52:09,996::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:52:10,004::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:52:10,005::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:52:10,019::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:52:10,021::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:52:10,022::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:52:10,042::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:52:10,055::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:10,465::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.534166 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:12,478::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:13,010::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500889 seconds, 2.0 MB/s\n'; = 0 Thread-18940::INFO::2011-01-18 19:52:13,175::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18940::DEBUG::2011-01-18 19:52:13,176::task::577::irs::Task 37125181-384f-4f51-992f-622e87dc5152: moving from state init -> state preparing Thread-18940::DEBUG::2011-01-18 19:52:13,176::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18940::DEBUG::2011-01-18 19:52:13,208::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s\n'; = 0 Thread-18940::DEBUG::2011-01-18 19:52:13,208::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s'], size: 2048 Thread-18940::DEBUG::2011-01-18 19:52:13,209::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18940::DEBUG::2011-01-18 19:52:13,209::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18940::DEBUG::2011-01-18 19:52:13,210::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18940::DEBUG::2011-01-18 19:52:13,210::task::577::irs::Task 37125181-384f-4f51-992f-622e87dc5152: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18940::DEBUG::2011-01-18 19:52:13,210::task::577::irs::Task 37125181-384f-4f51-992f-622e87dc5152: moving from state preparing -> state finished Thread-18940::DEBUG::2011-01-18 19:52:13,211::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18940::DEBUG::2011-01-18 19:52:13,211::task::577::irs::Task 37125181-384f-4f51-992f-622e87dc5152: ref 0 aborting False Thread-18940::INFO::2011-01-18 19:52:13,211::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18941::INFO::2011-01-18 19:52:13,220::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18941::DEBUG::2011-01-18 19:52:13,221::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: moving from state init -> state preparing Thread-18941::DEBUG::2011-01-18 19:52:13,221::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3cfb34f4-3d4b-42fe-a362-e62a36ebf923 acquire shared (120000) Thread-18941::DEBUG::2011-01-18 19:52:13,221::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18941::DEBUG::2011-01-18 19:52:13,222::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '3cfb34f4-3d4b-42fe-a362-e62a36ebf923' Thread-18941::DEBUG::2011-01-18 19:52:13,222::resource::524::irs::Owner 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18941::DEBUG::2011-01-18 19:52:13,222::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18941::DEBUG::2011-01-18 19:52:13,223::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: ref 1 aborting False Thread-18941::INFO::2011-01-18 19:52:13,223::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18941::DEBUG::2011-01-18 19:52:13,224::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18941::DEBUG::2011-01-18 19:52:13,224::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: moving from state preparing -> state finished Thread-18941::DEBUG::2011-01-18 19:52:13,224::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18941::DEBUG::2011-01-18 19:52:13,225::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3cfb34f4-3d4b-42fe-a362-e62a36ebf923 releasing Thread-18941::DEBUG::2011-01-18 19:52:13,225::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18941::DEBUG::2011-01-18 19:52:13,225::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18941::DEBUG::2011-01-18 19:52:13,226::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18941::DEBUG::2011-01-18 19:52:13,226::resource::503::irs::Owner 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18941::DEBUG::2011-01-18 19:52:13,226::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18941::DEBUG::2011-01-18 19:52:13,226::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18941::DEBUG::2011-01-18 19:52:13,227::task::577::irs::Task 3cfb34f4-3d4b-42fe-a362-e62a36ebf923: ref 0 aborting False Thread-18941::INFO::2011-01-18 19:52:13,227::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:52:15,024::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18943::INFO::2011-01-18 19:52:15,384::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18943::DEBUG::2011-01-18 19:52:15,385::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: moving from state init -> state preparing Thread-18943::DEBUG::2011-01-18 19:52:15,385::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fa86ba12-2919-4af9-9af8-6625057052f0 acquire shared (120000) Thread-18943::DEBUG::2011-01-18 19:52:15,386::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18943::DEBUG::2011-01-18 19:52:15,386::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fa86ba12-2919-4af9-9af8-6625057052f0' Thread-18943::DEBUG::2011-01-18 19:52:15,387::resource::524::irs::Owner fa86ba12-2919-4af9-9af8-6625057052f0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18943::DEBUG::2011-01-18 19:52:15,387::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18943::DEBUG::2011-01-18 19:52:15,387::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: ref 1 aborting False Thread-18943::DEBUG::2011-01-18 19:52:15,388::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0522401332855', 'lastCheck': 1295373130.0461161, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0527861118317', 'lastCheck': 1295373130.0272031, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0558779239655', 'lastCheck': 1295373130.029727, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0561320781708', 'lastCheck': 1295373130.059999, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0532999038696', 'lastCheck': 1295373130.0261619, 'valid': True, 'code': 0}} Thread-18943::DEBUG::2011-01-18 19:52:15,388::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: moving from state preparing -> state finished Thread-18943::DEBUG::2011-01-18 19:52:15,389::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18943::DEBUG::2011-01-18 19:52:15,389::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fa86ba12-2919-4af9-9af8-6625057052f0 releasing Thread-18943::DEBUG::2011-01-18 19:52:15,389::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18943::DEBUG::2011-01-18 19:52:15,390::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18943::DEBUG::2011-01-18 19:52:15,390::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18943::DEBUG::2011-01-18 19:52:15,390::resource::503::irs::Owner fa86ba12-2919-4af9-9af8-6625057052f0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18943::DEBUG::2011-01-18 19:52:15,391::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18943::DEBUG::2011-01-18 19:52:15,391::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18943::DEBUG::2011-01-18 19:52:15,391::task::577::irs::Task fa86ba12-2919-4af9-9af8-6625057052f0: ref 0 aborting False Thread-18943::INFO::2011-01-18 19:52:15,392::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0522401332855', 'lastCheck': 1295373130.0461161, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0558779239655', 'lastCheck': 1295373130.029727, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0532999038696', 'lastCheck': 1295373130.0261619, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0561320781708', 'lastCheck': 1295373130.059999, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0527861118317', 'lastCheck': 1295373130.0272031, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:52:15,563::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507028 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:17,575::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:18,109::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501868 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:52:20,025::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:52:20,026::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:52:20,026::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::INFO::2011-01-18 19:52:20,029::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::DEBUG::2011-01-18 19:52:20,030::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:52:20,030::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:52:20,046::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:52:20,047::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:52:20,060::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:52:20,061::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:52:20,066::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:52:20,074::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:52:20,075::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:52:20,091::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:52:20,101::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:20,122::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:20,668::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511812 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:22,681::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:23,214::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501915 seconds, 2.0 MB/s\n'; = 0 Thread-18948::INFO::2011-01-18 19:52:23,280::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18948::DEBUG::2011-01-18 19:52:23,280::task::577::irs::Task 0a02558d-283b-4a9e-98e6-1d8c5945309c: moving from state init -> state preparing Thread-18948::DEBUG::2011-01-18 19:52:23,281::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18948::DEBUG::2011-01-18 19:52:23,313::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00088 seconds, 2.3 MB/s\n'; = 0 Thread-18948::DEBUG::2011-01-18 19:52:23,313::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00088 seconds, 2.3 MB/s'], size: 2048 Thread-18948::DEBUG::2011-01-18 19:52:23,313::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18948::DEBUG::2011-01-18 19:52:23,314::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18948::DEBUG::2011-01-18 19:52:23,314::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18948::DEBUG::2011-01-18 19:52:23,315::task::577::irs::Task 0a02558d-283b-4a9e-98e6-1d8c5945309c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18948::DEBUG::2011-01-18 19:52:23,315::task::577::irs::Task 0a02558d-283b-4a9e-98e6-1d8c5945309c: moving from state preparing -> state finished Thread-18948::DEBUG::2011-01-18 19:52:23,315::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18948::DEBUG::2011-01-18 19:52:23,316::task::577::irs::Task 0a02558d-283b-4a9e-98e6-1d8c5945309c: ref 0 aborting False Thread-18948::INFO::2011-01-18 19:52:23,316::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18949::INFO::2011-01-18 19:52:23,325::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18949::DEBUG::2011-01-18 19:52:23,326::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: moving from state init -> state preparing Thread-18949::DEBUG::2011-01-18 19:52:23,326::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: cfe68410-78d1-476f-8024-7edc83823db0 acquire shared (120000) Thread-18949::DEBUG::2011-01-18 19:52:23,326::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18949::DEBUG::2011-01-18 19:52:23,326::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'cfe68410-78d1-476f-8024-7edc83823db0' Thread-18949::DEBUG::2011-01-18 19:52:23,327::resource::524::irs::Owner cfe68410-78d1-476f-8024-7edc83823db0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18949::DEBUG::2011-01-18 19:52:23,327::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18949::DEBUG::2011-01-18 19:52:23,327::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: ref 1 aborting False Thread-18949::INFO::2011-01-18 19:52:23,328::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18949::DEBUG::2011-01-18 19:52:23,329::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18949::DEBUG::2011-01-18 19:52:23,329::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: moving from state preparing -> state finished Thread-18949::DEBUG::2011-01-18 19:52:23,329::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18949::DEBUG::2011-01-18 19:52:23,330::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: cfe68410-78d1-476f-8024-7edc83823db0 releasing Thread-18949::DEBUG::2011-01-18 19:52:23,330::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18949::DEBUG::2011-01-18 19:52:23,330::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18949::DEBUG::2011-01-18 19:52:23,330::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18949::DEBUG::2011-01-18 19:52:23,331::resource::503::irs::Owner cfe68410-78d1-476f-8024-7edc83823db0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18949::DEBUG::2011-01-18 19:52:23,331::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18949::DEBUG::2011-01-18 19:52:23,331::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18949::DEBUG::2011-01-18 19:52:23,331::task::577::irs::Task cfe68410-78d1-476f-8024-7edc83823db0: ref 0 aborting False Thread-18949::INFO::2011-01-18 19:52:23,332::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:52:25,228::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18951::INFO::2011-01-18 19:52:25,550::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18951::DEBUG::2011-01-18 19:52:25,551::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: moving from state init -> state preparing Thread-18951::DEBUG::2011-01-18 19:52:25,551::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb acquire shared (120000) Thread-18951::DEBUG::2011-01-18 19:52:25,552::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18951::DEBUG::2011-01-18 19:52:25,552::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '7b6cdb0f-dd3d-4329-9a1a-131f717a27cb' Thread-18951::DEBUG::2011-01-18 19:52:25,552::resource::524::irs::Owner 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18951::DEBUG::2011-01-18 19:52:25,553::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18951::DEBUG::2011-01-18 19:52:25,553::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: ref 1 aborting False Thread-18951::DEBUG::2011-01-18 19:52:25,554::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490899085999', 'lastCheck': 1295373140.09499, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0534291267395', 'lastCheck': 1295373140.080312, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0515079498291', 'lastCheck': 1295373140.080452, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.046718120575', 'lastCheck': 1295373140.1066461, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0457201004028', 'lastCheck': 1295373140.0715671, 'valid': True, 'code': 0}} Thread-18951::DEBUG::2011-01-18 19:52:25,554::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: moving from state preparing -> state finished Thread-18951::DEBUG::2011-01-18 19:52:25,554::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18951::DEBUG::2011-01-18 19:52:25,555::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb releasing Thread-18951::DEBUG::2011-01-18 19:52:25,555::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18951::DEBUG::2011-01-18 19:52:25,555::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18951::DEBUG::2011-01-18 19:52:25,556::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18951::DEBUG::2011-01-18 19:52:25,556::resource::503::irs::Owner 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18951::DEBUG::2011-01-18 19:52:25,556::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18951::DEBUG::2011-01-18 19:52:25,557::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18951::DEBUG::2011-01-18 19:52:25,557::task::577::irs::Task 7b6cdb0f-dd3d-4329-9a1a-131f717a27cb: ref 0 aborting False Thread-18951::INFO::2011-01-18 19:52:25,558::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490899085999', 'lastCheck': 1295373140.09499, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0515079498291', 'lastCheck': 1295373140.080452, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0457201004028', 'lastCheck': 1295373140.0715671, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.046718120575', 'lastCheck': 1295373140.1066461, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0534291267395', 'lastCheck': 1295373140.080312, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:52:25,765::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505436 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:27,777::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:28,311::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501677 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:52:30,070::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:52:30,071::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:52:30,080::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 19:52:30,080::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 19:52:30,081::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:52:30,082::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:52:30,095::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:52:30,096::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:52:30,106::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:52:30,107::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:52:30,111::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:52:30,123::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:52:30,131::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:52:30,138::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:52:30,150::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:30,326::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:30,867::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509978 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:32,880::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18956::INFO::2011-01-18 19:52:33,395::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18956::DEBUG::2011-01-18 19:52:33,395::task::577::irs::Task 59411c20-f2cc-4db9-90b8-296a876a0c7f: moving from state init -> state preparing Thread-18956::DEBUG::2011-01-18 19:52:33,396::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:33,416::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502198 seconds, 2.0 MB/s\n'; = 0 Thread-18956::DEBUG::2011-01-18 19:52:33,432::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000439 seconds, 4.7 MB/s\n'; = 0 Thread-18956::DEBUG::2011-01-18 19:52:33,433::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000439 seconds, 4.7 MB/s'], size: 2048 Thread-18956::DEBUG::2011-01-18 19:52:33,433::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18956::DEBUG::2011-01-18 19:52:33,433::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18956::DEBUG::2011-01-18 19:52:33,434::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18956::DEBUG::2011-01-18 19:52:33,434::task::577::irs::Task 59411c20-f2cc-4db9-90b8-296a876a0c7f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18956::DEBUG::2011-01-18 19:52:33,435::task::577::irs::Task 59411c20-f2cc-4db9-90b8-296a876a0c7f: moving from state preparing -> state finished Thread-18956::DEBUG::2011-01-18 19:52:33,435::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18956::DEBUG::2011-01-18 19:52:33,435::task::577::irs::Task 59411c20-f2cc-4db9-90b8-296a876a0c7f: ref 0 aborting False Thread-18956::INFO::2011-01-18 19:52:33,436::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18957::INFO::2011-01-18 19:52:33,444::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18957::DEBUG::2011-01-18 19:52:33,445::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: moving from state init -> state preparing Thread-18957::DEBUG::2011-01-18 19:52:33,445::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 536a4c49-8698-4a2c-b8f1-9240e5184ef0 acquire shared (120000) Thread-18957::DEBUG::2011-01-18 19:52:33,445::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18957::DEBUG::2011-01-18 19:52:33,446::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '536a4c49-8698-4a2c-b8f1-9240e5184ef0' Thread-18957::DEBUG::2011-01-18 19:52:33,446::resource::524::irs::Owner 536a4c49-8698-4a2c-b8f1-9240e5184ef0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18957::DEBUG::2011-01-18 19:52:33,446::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18957::DEBUG::2011-01-18 19:52:33,447::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: ref 1 aborting False Thread-18957::INFO::2011-01-18 19:52:33,447::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18957::DEBUG::2011-01-18 19:52:33,448::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18957::DEBUG::2011-01-18 19:52:33,448::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: moving from state preparing -> state finished Thread-18957::DEBUG::2011-01-18 19:52:33,448::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18957::DEBUG::2011-01-18 19:52:33,449::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 536a4c49-8698-4a2c-b8f1-9240e5184ef0 releasing Thread-18957::DEBUG::2011-01-18 19:52:33,449::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18957::DEBUG::2011-01-18 19:52:33,449::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18957::DEBUG::2011-01-18 19:52:33,449::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18957::DEBUG::2011-01-18 19:52:33,450::resource::503::irs::Owner 536a4c49-8698-4a2c-b8f1-9240e5184ef0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18957::DEBUG::2011-01-18 19:52:33,450::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18957::DEBUG::2011-01-18 19:52:33,450::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18957::DEBUG::2011-01-18 19:52:33,451::task::577::irs::Task 536a4c49-8698-4a2c-b8f1-9240e5184ef0: ref 0 aborting False Thread-18957::INFO::2011-01-18 19:52:33,451::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:52:35,430::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18959::INFO::2011-01-18 19:52:35,715::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18959::DEBUG::2011-01-18 19:52:35,715::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: moving from state init -> state preparing Thread-18959::DEBUG::2011-01-18 19:52:35,716::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 559b87bd-6409-47e9-afc1-655ebe7ebc94 acquire shared (120000) Thread-18959::DEBUG::2011-01-18 19:52:35,716::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18959::DEBUG::2011-01-18 19:52:35,717::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '559b87bd-6409-47e9-afc1-655ebe7ebc94' Thread-18959::DEBUG::2011-01-18 19:52:35,717::resource::524::irs::Owner 559b87bd-6409-47e9-afc1-655ebe7ebc94: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18959::DEBUG::2011-01-18 19:52:35,717::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18959::DEBUG::2011-01-18 19:52:35,718::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: ref 1 aborting False Thread-18959::DEBUG::2011-01-18 19:52:35,718::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0473189353943', 'lastCheck': 1295373150.142194, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0544490814209', 'lastCheck': 1295373150.1351321, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0485548973083', 'lastCheck': 1295373150.1284659, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0497019290924', 'lastCheck': 1295373150.1556029, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0460779666901', 'lastCheck': 1295373150.1169109, 'valid': True, 'code': 0}} Thread-18959::DEBUG::2011-01-18 19:52:35,719::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: moving from state preparing -> state finished Thread-18959::DEBUG::2011-01-18 19:52:35,719::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18959::DEBUG::2011-01-18 19:52:35,720::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 559b87bd-6409-47e9-afc1-655ebe7ebc94 releasing Thread-18959::DEBUG::2011-01-18 19:52:35,720::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18959::DEBUG::2011-01-18 19:52:35,721::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18959::DEBUG::2011-01-18 19:52:35,721::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18959::DEBUG::2011-01-18 19:52:35,721::resource::503::irs::Owner 559b87bd-6409-47e9-afc1-655ebe7ebc94: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18959::DEBUG::2011-01-18 19:52:35,722::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18959::DEBUG::2011-01-18 19:52:35,722::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18959::DEBUG::2011-01-18 19:52:35,722::task::577::irs::Task 559b87bd-6409-47e9-afc1-655ebe7ebc94: ref 0 aborting False Thread-18959::INFO::2011-01-18 19:52:35,723::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0473189353943', 'lastCheck': 1295373150.142194, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0485548973083', 'lastCheck': 1295373150.1284659, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0460779666901', 'lastCheck': 1295373150.1169109, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0497019290924', 'lastCheck': 1295373150.1556029, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0544490814209', 'lastCheck': 1295373150.1351321, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:52:35,967::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504837 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:37,979::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:38,513::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501522 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:52:40,116::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:52:40,117::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:52:40,128::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:52:40,129::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:52:40,135::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:52:40,136::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:52:40,142::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:52:40,143::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:52:40,155::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:52:40,156::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:52:40,160::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:52:40,173::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:52:40,174::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:52:40,184::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:52:40,197::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:40,526::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:41,448::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503233 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:43,460::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18964::INFO::2011-01-18 19:52:43,507::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18964::DEBUG::2011-01-18 19:52:43,508::task::577::irs::Task 53e1c7b6-ece2-4daf-94d2-8e04cc76f415: moving from state init -> state preparing Thread-18964::DEBUG::2011-01-18 19:52:43,508::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18964::DEBUG::2011-01-18 19:52:43,541::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000949 seconds, 2.2 MB/s\n'; = 0 Thread-18964::DEBUG::2011-01-18 19:52:43,542::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000949 seconds, 2.2 MB/s'], size: 2048 Thread-18964::DEBUG::2011-01-18 19:52:43,542::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18964::DEBUG::2011-01-18 19:52:43,542::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18964::DEBUG::2011-01-18 19:52:43,543::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18964::DEBUG::2011-01-18 19:52:43,543::task::577::irs::Task 53e1c7b6-ece2-4daf-94d2-8e04cc76f415: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18964::DEBUG::2011-01-18 19:52:43,544::task::577::irs::Task 53e1c7b6-ece2-4daf-94d2-8e04cc76f415: moving from state preparing -> state finished Thread-18964::DEBUG::2011-01-18 19:52:43,544::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18964::DEBUG::2011-01-18 19:52:43,545::task::577::irs::Task 53e1c7b6-ece2-4daf-94d2-8e04cc76f415: ref 0 aborting False Thread-18964::INFO::2011-01-18 19:52:43,545::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18965::INFO::2011-01-18 19:52:43,553::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18965::DEBUG::2011-01-18 19:52:43,554::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: moving from state init -> state preparing Thread-18965::DEBUG::2011-01-18 19:52:43,554::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7d62ef58-0278-4b2f-a4f8-303de87fba4a acquire shared (120000) Thread-18965::DEBUG::2011-01-18 19:52:43,555::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18965::DEBUG::2011-01-18 19:52:43,555::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '7d62ef58-0278-4b2f-a4f8-303de87fba4a' Thread-18965::DEBUG::2011-01-18 19:52:43,555::resource::524::irs::Owner 7d62ef58-0278-4b2f-a4f8-303de87fba4a: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18965::DEBUG::2011-01-18 19:52:43,555::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18965::DEBUG::2011-01-18 19:52:43,556::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: ref 1 aborting False Thread-18965::INFO::2011-01-18 19:52:43,556::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18965::DEBUG::2011-01-18 19:52:43,557::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18965::DEBUG::2011-01-18 19:52:43,557::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: moving from state preparing -> state finished Thread-18965::DEBUG::2011-01-18 19:52:43,558::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18965::DEBUG::2011-01-18 19:52:43,558::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7d62ef58-0278-4b2f-a4f8-303de87fba4a releasing Thread-18965::DEBUG::2011-01-18 19:52:43,559::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18965::DEBUG::2011-01-18 19:52:43,559::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18965::DEBUG::2011-01-18 19:52:43,559::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18965::DEBUG::2011-01-18 19:52:43,559::resource::503::irs::Owner 7d62ef58-0278-4b2f-a4f8-303de87fba4a: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18965::DEBUG::2011-01-18 19:52:43,560::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18965::DEBUG::2011-01-18 19:52:43,560::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18965::DEBUG::2011-01-18 19:52:43,560::task::577::irs::Task 7d62ef58-0278-4b2f-a4f8-303de87fba4a: ref 0 aborting False Thread-18965::INFO::2011-01-18 19:52:43,561::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:52:43,994::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502026 seconds, 2.0 MB/s\n'; = 0 Thread-18967::INFO::2011-01-18 19:52:45,879::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18967::DEBUG::2011-01-18 19:52:45,879::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: moving from state init -> state preparing Thread-18967::DEBUG::2011-01-18 19:52:45,880::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1e897648-2336-43d5-85a5-bb444a8a97da acquire shared (120000) Thread-18967::DEBUG::2011-01-18 19:52:45,880::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18967::DEBUG::2011-01-18 19:52:45,880::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1e897648-2336-43d5-85a5-bb444a8a97da' Thread-18967::DEBUG::2011-01-18 19:52:45,881::resource::524::irs::Owner 1e897648-2336-43d5-85a5-bb444a8a97da: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18967::DEBUG::2011-01-18 19:52:45,881::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18967::DEBUG::2011-01-18 19:52:45,881::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: ref 1 aborting False Thread-18967::DEBUG::2011-01-18 19:52:45,881::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0472719669342', 'lastCheck': 1295373160.1891479, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0442779064178', 'lastCheck': 1295373160.179143, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0506219863892', 'lastCheck': 1295373160.1784849, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0467710494995', 'lastCheck': 1295373160.2017081, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0489120483398', 'lastCheck': 1295373160.165751, 'valid': True, 'code': 0}} Thread-18967::DEBUG::2011-01-18 19:52:45,882::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: moving from state preparing -> state finished Thread-18967::DEBUG::2011-01-18 19:52:45,882::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18967::DEBUG::2011-01-18 19:52:45,882::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1e897648-2336-43d5-85a5-bb444a8a97da releasing Thread-18967::DEBUG::2011-01-18 19:52:45,883::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18967::DEBUG::2011-01-18 19:52:45,883::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18967::DEBUG::2011-01-18 19:52:45,883::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18967::DEBUG::2011-01-18 19:52:45,884::resource::503::irs::Owner 1e897648-2336-43d5-85a5-bb444a8a97da: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18967::DEBUG::2011-01-18 19:52:45,884::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18967::DEBUG::2011-01-18 19:52:45,884::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18967::DEBUG::2011-01-18 19:52:45,884::task::577::irs::Task 1e897648-2336-43d5-85a5-bb444a8a97da: ref 0 aborting False Thread-18967::INFO::2011-01-18 19:52:45,885::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0472719669342', 'lastCheck': 1295373160.1891479, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0506219863892', 'lastCheck': 1295373160.1784849, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0489120483398', 'lastCheck': 1295373160.165751, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0467710494995', 'lastCheck': 1295373160.2017081, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0442779064178', 'lastCheck': 1295373160.179143, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:52:46,007::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:46,542::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502081 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:48,554::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:49,097::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511115 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:52:50,164::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:52:50,165::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:52:50,178::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:52:50,179::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:52:50,180::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:52:50,181::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:52:50,189::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:52:50,190::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:52:50,201::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:52:50,202::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:52:50,209::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:52:50,220::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:52:50,222::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:52:50,230::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:52:50,241::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:51,110::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:51,645::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502413 seconds, 2.0 MB/s\n'; = 0 Thread-18972::INFO::2011-01-18 19:52:53,618::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18972::DEBUG::2011-01-18 19:52:53,619::task::577::irs::Task 5dbc00b4-7843-4cdb-a427-3f700c3699c4: moving from state init -> state preparing Thread-18972::DEBUG::2011-01-18 19:52:53,619::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18972::DEBUG::2011-01-18 19:52:53,651::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s\n'; = 0 Thread-18972::DEBUG::2011-01-18 19:52:53,651::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s'], size: 2048 Thread-18972::DEBUG::2011-01-18 19:52:53,652::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18972::DEBUG::2011-01-18 19:52:53,652::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18972::DEBUG::2011-01-18 19:52:53,653::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18972::DEBUG::2011-01-18 19:52:53,653::task::577::irs::Task 5dbc00b4-7843-4cdb-a427-3f700c3699c4: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18972::DEBUG::2011-01-18 19:52:53,653::task::577::irs::Task 5dbc00b4-7843-4cdb-a427-3f700c3699c4: moving from state preparing -> state finished Thread-18972::DEBUG::2011-01-18 19:52:53,654::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18972::DEBUG::2011-01-18 19:52:53,654::task::577::irs::Task 5dbc00b4-7843-4cdb-a427-3f700c3699c4: ref 0 aborting False Thread-18972::INFO::2011-01-18 19:52:53,654::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Dummy-18546::DEBUG::2011-01-18 19:52:53,657::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18973::INFO::2011-01-18 19:52:53,664::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18973::DEBUG::2011-01-18 19:52:53,664::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: moving from state init -> state preparing Thread-18973::DEBUG::2011-01-18 19:52:53,665::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0a256888-d7e1-4fed-b30a-4f5350f372d6 acquire shared (120000) Thread-18973::DEBUG::2011-01-18 19:52:53,665::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18973::DEBUG::2011-01-18 19:52:53,665::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0a256888-d7e1-4fed-b30a-4f5350f372d6' Thread-18973::DEBUG::2011-01-18 19:52:53,666::resource::524::irs::Owner 0a256888-d7e1-4fed-b30a-4f5350f372d6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18973::DEBUG::2011-01-18 19:52:53,666::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18973::DEBUG::2011-01-18 19:52:53,666::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: ref 1 aborting False Thread-18973::INFO::2011-01-18 19:52:53,667::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18973::DEBUG::2011-01-18 19:52:53,668::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18973::DEBUG::2011-01-18 19:52:53,668::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: moving from state preparing -> state finished Thread-18973::DEBUG::2011-01-18 19:52:53,669::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18973::DEBUG::2011-01-18 19:52:53,669::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0a256888-d7e1-4fed-b30a-4f5350f372d6 releasing Thread-18973::DEBUG::2011-01-18 19:52:53,669::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18973::DEBUG::2011-01-18 19:52:53,669::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18973::DEBUG::2011-01-18 19:52:53,670::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18973::DEBUG::2011-01-18 19:52:53,670::resource::503::irs::Owner 0a256888-d7e1-4fed-b30a-4f5350f372d6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18973::DEBUG::2011-01-18 19:52:53,670::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18973::DEBUG::2011-01-18 19:52:53,671::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18973::DEBUG::2011-01-18 19:52:53,671::task::577::irs::Task 0a256888-d7e1-4fed-b30a-4f5350f372d6: ref 0 aborting False Thread-18973::INFO::2011-01-18 19:52:53,671::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:52:54,192::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502304 seconds, 2.0 MB/s\n'; = 0 Thread-18975::INFO::2011-01-18 19:52:56,066::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18975::DEBUG::2011-01-18 19:52:56,066::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: moving from state init -> state preparing Thread-18975::DEBUG::2011-01-18 19:52:56,066::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 00fd22e9-3323-4bd4-97b0-2d2a6b65231c acquire shared (120000) Thread-18975::DEBUG::2011-01-18 19:52:56,067::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18975::DEBUG::2011-01-18 19:52:56,067::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '00fd22e9-3323-4bd4-97b0-2d2a6b65231c' Thread-18975::DEBUG::2011-01-18 19:52:56,067::resource::524::irs::Owner 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18975::DEBUG::2011-01-18 19:52:56,067::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18975::DEBUG::2011-01-18 19:52:56,068::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: ref 1 aborting False Thread-18975::DEBUG::2011-01-18 19:52:56,068::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0469691753387', 'lastCheck': 1295373170.2358861, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0461640357971', 'lastCheck': 1295373170.22616, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0477080345154', 'lastCheck': 1295373170.225605, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0450510978699', 'lastCheck': 1295373170.245914, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0488851070404', 'lastCheck': 1295373170.2137251, 'valid': True, 'code': 0}} Thread-18975::DEBUG::2011-01-18 19:52:56,068::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: moving from state preparing -> state finished Thread-18975::DEBUG::2011-01-18 19:52:56,069::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18975::DEBUG::2011-01-18 19:52:56,069::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 00fd22e9-3323-4bd4-97b0-2d2a6b65231c releasing Thread-18975::DEBUG::2011-01-18 19:52:56,069::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18975::DEBUG::2011-01-18 19:52:56,070::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18975::DEBUG::2011-01-18 19:52:56,070::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18975::DEBUG::2011-01-18 19:52:56,070::resource::503::irs::Owner 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18975::DEBUG::2011-01-18 19:52:56,070::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18975::DEBUG::2011-01-18 19:52:56,071::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18975::DEBUG::2011-01-18 19:52:56,071::task::577::irs::Task 00fd22e9-3323-4bd4-97b0-2d2a6b65231c: ref 0 aborting False Thread-18975::INFO::2011-01-18 19:52:56,071::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0469691753387', 'lastCheck': 1295373170.2358861, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0477080345154', 'lastCheck': 1295373170.225605, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0488851070404', 'lastCheck': 1295373170.2137251, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0450510978699', 'lastCheck': 1295373170.245914, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0461640357971', 'lastCheck': 1295373170.22616, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:52:56,205::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:56,738::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500693 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:52:58,750::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:52:59,284::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502863 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:53:00,212::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:53:00,213::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:53:00,225::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:53:00,226::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:53:00,226::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:53:00,227::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:53:00,236::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:53:00,237::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:53:00,246::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:53:00,247::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:53:00,253::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:53:00,269::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:53:00,272::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:53:00,280::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:53:00,288::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:01,298::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:01,841::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511427 seconds, 2.0 MB/s\n'; = 0 Thread-18980::INFO::2011-01-18 19:53:03,723::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18980::DEBUG::2011-01-18 19:53:03,723::task::577::irs::Task c82b68c3-93be-4eee-bfc4-ed3197b1ac7c: moving from state init -> state preparing Thread-18980::DEBUG::2011-01-18 19:53:03,724::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18980::DEBUG::2011-01-18 19:53:03,755::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000444 seconds, 4.6 MB/s\n'; = 0 Thread-18980::DEBUG::2011-01-18 19:53:03,756::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000444 seconds, 4.6 MB/s'], size: 2048 Thread-18980::DEBUG::2011-01-18 19:53:03,756::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18980::DEBUG::2011-01-18 19:53:03,757::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18980::DEBUG::2011-01-18 19:53:03,757::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18980::DEBUG::2011-01-18 19:53:03,758::task::577::irs::Task c82b68c3-93be-4eee-bfc4-ed3197b1ac7c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18980::DEBUG::2011-01-18 19:53:03,758::task::577::irs::Task c82b68c3-93be-4eee-bfc4-ed3197b1ac7c: moving from state preparing -> state finished Thread-18980::DEBUG::2011-01-18 19:53:03,758::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18980::DEBUG::2011-01-18 19:53:03,758::task::577::irs::Task c82b68c3-93be-4eee-bfc4-ed3197b1ac7c: ref 0 aborting False Thread-18980::INFO::2011-01-18 19:53:03,759::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18981::INFO::2011-01-18 19:53:03,767::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18981::DEBUG::2011-01-18 19:53:03,767::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: moving from state init -> state preparing Thread-18981::DEBUG::2011-01-18 19:53:03,768::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4fa3668c-5b8e-4988-949a-f882b4c84172 acquire shared (120000) Thread-18981::DEBUG::2011-01-18 19:53:03,768::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18981::DEBUG::2011-01-18 19:53:03,768::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4fa3668c-5b8e-4988-949a-f882b4c84172' Thread-18981::DEBUG::2011-01-18 19:53:03,769::resource::524::irs::Owner 4fa3668c-5b8e-4988-949a-f882b4c84172: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18981::DEBUG::2011-01-18 19:53:03,769::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18981::DEBUG::2011-01-18 19:53:03,769::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: ref 1 aborting False Thread-18981::INFO::2011-01-18 19:53:03,770::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18981::DEBUG::2011-01-18 19:53:03,770::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18981::DEBUG::2011-01-18 19:53:03,771::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: moving from state preparing -> state finished Thread-18981::DEBUG::2011-01-18 19:53:03,771::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18981::DEBUG::2011-01-18 19:53:03,771::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4fa3668c-5b8e-4988-949a-f882b4c84172 releasing Thread-18981::DEBUG::2011-01-18 19:53:03,772::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18981::DEBUG::2011-01-18 19:53:03,772::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18981::DEBUG::2011-01-18 19:53:03,772::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18981::DEBUG::2011-01-18 19:53:03,773::resource::503::irs::Owner 4fa3668c-5b8e-4988-949a-f882b4c84172: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18981::DEBUG::2011-01-18 19:53:03,773::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18981::DEBUG::2011-01-18 19:53:03,773::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18981::DEBUG::2011-01-18 19:53:03,773::task::577::irs::Task 4fa3668c-5b8e-4988-949a-f882b4c84172: ref 0 aborting False Thread-18981::INFO::2011-01-18 19:53:03,774::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:53:03,853::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:04,394::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509056 seconds, 2.0 MB/s\n'; = 0 Thread-18983::INFO::2011-01-18 19:53:06,232::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18983::DEBUG::2011-01-18 19:53:06,233::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: moving from state init -> state preparing Thread-18983::DEBUG::2011-01-18 19:53:06,233::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5adfbbd5-9544-40fd-b687-a6eb25cc422b acquire shared (120000) Thread-18983::DEBUG::2011-01-18 19:53:06,233::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18983::DEBUG::2011-01-18 19:53:06,234::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5adfbbd5-9544-40fd-b687-a6eb25cc422b' Thread-18983::DEBUG::2011-01-18 19:53:06,234::resource::524::irs::Owner 5adfbbd5-9544-40fd-b687-a6eb25cc422b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18983::DEBUG::2011-01-18 19:53:06,234::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18983::DEBUG::2011-01-18 19:53:06,235::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: ref 1 aborting False Thread-18983::DEBUG::2011-01-18 19:53:06,235::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0478270053864', 'lastCheck': 1295373180.28371, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0469949245453', 'lastCheck': 1295373180.273468, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0526769161224', 'lastCheck': 1295373180.27758, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471441745758', 'lastCheck': 1295373180.2930651, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0458741188049', 'lastCheck': 1295373180.2587121, 'valid': True, 'code': 0}} Thread-18983::DEBUG::2011-01-18 19:53:06,235::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: moving from state preparing -> state finished Thread-18983::DEBUG::2011-01-18 19:53:06,236::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18983::DEBUG::2011-01-18 19:53:06,236::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5adfbbd5-9544-40fd-b687-a6eb25cc422b releasing Thread-18983::DEBUG::2011-01-18 19:53:06,236::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18983::DEBUG::2011-01-18 19:53:06,236::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18983::DEBUG::2011-01-18 19:53:06,237::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18983::DEBUG::2011-01-18 19:53:06,237::resource::503::irs::Owner 5adfbbd5-9544-40fd-b687-a6eb25cc422b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18983::DEBUG::2011-01-18 19:53:06,237::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18983::DEBUG::2011-01-18 19:53:06,238::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18983::DEBUG::2011-01-18 19:53:06,238::task::577::irs::Task 5adfbbd5-9544-40fd-b687-a6eb25cc422b: ref 0 aborting False Thread-18983::INFO::2011-01-18 19:53:06,238::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0478270053864', 'lastCheck': 1295373180.28371, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0526769161224', 'lastCheck': 1295373180.27758, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0458741188049', 'lastCheck': 1295373180.2587121, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471441745758', 'lastCheck': 1295373180.2930651, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0469949245453', 'lastCheck': 1295373180.273468, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:53:06,407::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:06,941::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501159 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:08,954::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:09,488::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502419 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:53:10,257::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:53:10,258::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:53:10,273::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:53:10,274::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:53:10,277::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:53:10,278::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:53:10,283::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:53:10,285::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:53:10,293::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:53:10,294::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:53:10,298::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:53:10,316::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:53:10,316::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:53:10,328::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:53:10,335::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:11,501::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:12,043::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510153 seconds, 2.0 MB/s\n'; = 0 Thread-18988::INFO::2011-01-18 19:53:13,828::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18988::DEBUG::2011-01-18 19:53:13,829::task::577::irs::Task 93228e1b-fbd3-4f87-a500-fc2373c49451: moving from state init -> state preparing Thread-18988::DEBUG::2011-01-18 19:53:13,829::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18988::DEBUG::2011-01-18 19:53:13,861::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000451 seconds, 4.5 MB/s\n'; = 0 Thread-18988::DEBUG::2011-01-18 19:53:13,862::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000451 seconds, 4.5 MB/s'], size: 2048 Thread-18988::DEBUG::2011-01-18 19:53:13,862::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18988::DEBUG::2011-01-18 19:53:13,862::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18988::DEBUG::2011-01-18 19:53:13,863::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18988::DEBUG::2011-01-18 19:53:13,863::task::577::irs::Task 93228e1b-fbd3-4f87-a500-fc2373c49451: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18988::DEBUG::2011-01-18 19:53:13,864::task::577::irs::Task 93228e1b-fbd3-4f87-a500-fc2373c49451: moving from state preparing -> state finished Thread-18988::DEBUG::2011-01-18 19:53:13,864::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18988::DEBUG::2011-01-18 19:53:13,864::task::577::irs::Task 93228e1b-fbd3-4f87-a500-fc2373c49451: ref 0 aborting False Thread-18988::INFO::2011-01-18 19:53:13,864::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18989::INFO::2011-01-18 19:53:13,872::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18989::DEBUG::2011-01-18 19:53:13,873::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: moving from state init -> state preparing Thread-18989::DEBUG::2011-01-18 19:53:13,873::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd acquire shared (120000) Thread-18989::DEBUG::2011-01-18 19:53:13,873::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18989::DEBUG::2011-01-18 19:53:13,874::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '29b7a0c4-829c-41d4-9caa-3ad3ac8324bd' Thread-18989::DEBUG::2011-01-18 19:53:13,874::resource::524::irs::Owner 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18989::DEBUG::2011-01-18 19:53:13,874::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18989::DEBUG::2011-01-18 19:53:13,875::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: ref 1 aborting False Thread-18989::INFO::2011-01-18 19:53:13,875::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18989::DEBUG::2011-01-18 19:53:13,876::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18989::DEBUG::2011-01-18 19:53:13,876::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: moving from state preparing -> state finished Thread-18989::DEBUG::2011-01-18 19:53:13,876::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18989::DEBUG::2011-01-18 19:53:13,877::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd releasing Thread-18989::DEBUG::2011-01-18 19:53:13,877::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18989::DEBUG::2011-01-18 19:53:13,877::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18989::DEBUG::2011-01-18 19:53:13,878::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18989::DEBUG::2011-01-18 19:53:13,878::resource::503::irs::Owner 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18989::DEBUG::2011-01-18 19:53:13,878::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18989::DEBUG::2011-01-18 19:53:13,878::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18989::DEBUG::2011-01-18 19:53:13,879::task::577::irs::Task 29b7a0c4-829c-41d4-9caa-3ad3ac8324bd: ref 0 aborting False Thread-18989::INFO::2011-01-18 19:53:13,879::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:53:14,056::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:14,592::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504962 seconds, 2.0 MB/s\n'; = 0 Thread-18991::INFO::2011-01-18 19:53:16,409::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18991::DEBUG::2011-01-18 19:53:16,410::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: moving from state init -> state preparing Thread-18991::DEBUG::2011-01-18 19:53:16,410::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: cc71f452-7509-45a1-86d1-3ad21d66a980 acquire shared (120000) Thread-18991::DEBUG::2011-01-18 19:53:16,410::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18991::DEBUG::2011-01-18 19:53:16,411::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'cc71f452-7509-45a1-86d1-3ad21d66a980' Thread-18991::DEBUG::2011-01-18 19:53:16,411::resource::524::irs::Owner cc71f452-7509-45a1-86d1-3ad21d66a980: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18991::DEBUG::2011-01-18 19:53:16,411::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18991::DEBUG::2011-01-18 19:53:16,411::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: ref 1 aborting False Thread-18991::DEBUG::2011-01-18 19:53:16,412::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0489659309387', 'lastCheck': 1295373190.331898, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0492539405823', 'lastCheck': 1295373190.322217, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0461668968201', 'lastCheck': 1295373190.3231649, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471019744873', 'lastCheck': 1295373190.340013, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463590621948', 'lastCheck': 1295373190.304209, 'valid': True, 'code': 0}} Thread-18991::DEBUG::2011-01-18 19:53:16,412::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: moving from state preparing -> state finished Thread-18991::DEBUG::2011-01-18 19:53:16,413::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18991::DEBUG::2011-01-18 19:53:16,413::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: cc71f452-7509-45a1-86d1-3ad21d66a980 releasing Thread-18991::DEBUG::2011-01-18 19:53:16,413::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18991::DEBUG::2011-01-18 19:53:16,413::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18991::DEBUG::2011-01-18 19:53:16,414::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18991::DEBUG::2011-01-18 19:53:16,414::resource::503::irs::Owner cc71f452-7509-45a1-86d1-3ad21d66a980: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18991::DEBUG::2011-01-18 19:53:16,414::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18991::DEBUG::2011-01-18 19:53:16,415::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18991::DEBUG::2011-01-18 19:53:16,415::task::577::irs::Task cc71f452-7509-45a1-86d1-3ad21d66a980: ref 0 aborting False Thread-18991::INFO::2011-01-18 19:53:16,415::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0489659309387', 'lastCheck': 1295373190.331898, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0461668968201', 'lastCheck': 1295373190.3231649, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463590621948', 'lastCheck': 1295373190.304209, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471019744873', 'lastCheck': 1295373190.340013, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0492539405823', 'lastCheck': 1295373190.322217, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:53:16,605::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:17,137::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500813 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:19,150::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:19,683::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501968 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:53:20,303::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:53:20,304::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:53:20,322::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:53:20,323::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:53:20,323::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:53:20,324::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:53:20,332::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:53:20,333::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:53:20,340::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:53:20,341::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:53:20,345::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:53:20,367::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:53:20,367::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:53:20,376::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:53:20,383::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:21,697::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:22,238::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509517 seconds, 2.0 MB/s\n'; = 0 Thread-18996::INFO::2011-01-18 19:53:23,931::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18996::DEBUG::2011-01-18 19:53:23,932::task::577::irs::Task 5fa8cebd-7449-4058-aec8-85e9f570d2bc: moving from state init -> state preparing Thread-18996::DEBUG::2011-01-18 19:53:23,932::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-18996::DEBUG::2011-01-18 19:53:23,964::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000565 seconds, 3.6 MB/s\n'; = 0 Thread-18996::DEBUG::2011-01-18 19:53:23,964::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000565 seconds, 3.6 MB/s'], size: 2048 Thread-18996::DEBUG::2011-01-18 19:53:23,965::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-18996::DEBUG::2011-01-18 19:53:23,965::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-18996::DEBUG::2011-01-18 19:53:23,966::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-18996::DEBUG::2011-01-18 19:53:23,966::task::577::irs::Task 5fa8cebd-7449-4058-aec8-85e9f570d2bc: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18996::DEBUG::2011-01-18 19:53:23,966::task::577::irs::Task 5fa8cebd-7449-4058-aec8-85e9f570d2bc: moving from state preparing -> state finished Thread-18996::DEBUG::2011-01-18 19:53:23,967::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18996::DEBUG::2011-01-18 19:53:23,967::task::577::irs::Task 5fa8cebd-7449-4058-aec8-85e9f570d2bc: ref 0 aborting False Thread-18996::INFO::2011-01-18 19:53:23,967::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-18997::INFO::2011-01-18 19:53:23,976::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-18997::DEBUG::2011-01-18 19:53:23,976::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: moving from state init -> state preparing Thread-18997::DEBUG::2011-01-18 19:53:23,976::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0efb7bf-b8c8-4f08-b8ac-e70762e74662 acquire shared (120000) Thread-18997::DEBUG::2011-01-18 19:53:23,977::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18997::DEBUG::2011-01-18 19:53:23,977::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c0efb7bf-b8c8-4f08-b8ac-e70762e74662' Thread-18997::DEBUG::2011-01-18 19:53:23,977::resource::524::irs::Owner c0efb7bf-b8c8-4f08-b8ac-e70762e74662: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18997::DEBUG::2011-01-18 19:53:23,978::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18997::DEBUG::2011-01-18 19:53:23,978::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: ref 1 aborting False Thread-18997::INFO::2011-01-18 19:53:23,978::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-18997::DEBUG::2011-01-18 19:53:23,979::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18997::DEBUG::2011-01-18 19:53:23,979::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: moving from state preparing -> state finished Thread-18997::DEBUG::2011-01-18 19:53:23,980::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18997::DEBUG::2011-01-18 19:53:23,980::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0efb7bf-b8c8-4f08-b8ac-e70762e74662 releasing Thread-18997::DEBUG::2011-01-18 19:53:23,980::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18997::DEBUG::2011-01-18 19:53:23,981::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18997::DEBUG::2011-01-18 19:53:23,981::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18997::DEBUG::2011-01-18 19:53:23,981::resource::503::irs::Owner c0efb7bf-b8c8-4f08-b8ac-e70762e74662: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18997::DEBUG::2011-01-18 19:53:23,981::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18997::DEBUG::2011-01-18 19:53:23,982::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18997::DEBUG::2011-01-18 19:53:23,982::task::577::irs::Task c0efb7bf-b8c8-4f08-b8ac-e70762e74662: ref 0 aborting False Thread-18997::INFO::2011-01-18 19:53:23,983::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:53:24,251::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:24,818::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.534997 seconds, 1.9 MB/s\n'; = 0 Thread-18999::INFO::2011-01-18 19:53:26,586::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-18999::DEBUG::2011-01-18 19:53:26,586::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: moving from state init -> state preparing Thread-18999::DEBUG::2011-01-18 19:53:26,586::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0a45eced-8c8c-489f-91d4-c9ec162143ff acquire shared (120000) Thread-18999::DEBUG::2011-01-18 19:53:26,587::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-18999::DEBUG::2011-01-18 19:53:26,587::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0a45eced-8c8c-489f-91d4-c9ec162143ff' Thread-18999::DEBUG::2011-01-18 19:53:26,587::resource::524::irs::Owner 0a45eced-8c8c-489f-91d4-c9ec162143ff: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18999::DEBUG::2011-01-18 19:53:26,587::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-18999::DEBUG::2011-01-18 19:53:26,588::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: ref 1 aborting False Thread-18999::DEBUG::2011-01-18 19:53:26,588::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0478570461273', 'lastCheck': 1295373200.379766, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0513570308685', 'lastCheck': 1295373200.3732181, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0488271713257', 'lastCheck': 1295373200.3721471, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484139919281', 'lastCheck': 1295373200.3883359, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0474920272827', 'lastCheck': 1295373200.351335, 'valid': True, 'code': 0}} Thread-18999::DEBUG::2011-01-18 19:53:26,589::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: moving from state preparing -> state finished Thread-18999::DEBUG::2011-01-18 19:53:26,589::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-18999::DEBUG::2011-01-18 19:53:26,589::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0a45eced-8c8c-489f-91d4-c9ec162143ff releasing Thread-18999::DEBUG::2011-01-18 19:53:26,589::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-18999::DEBUG::2011-01-18 19:53:26,590::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-18999::DEBUG::2011-01-18 19:53:26,590::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-18999::DEBUG::2011-01-18 19:53:26,590::resource::503::irs::Owner 0a45eced-8c8c-489f-91d4-c9ec162143ff: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-18999::DEBUG::2011-01-18 19:53:26,591::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-18999::DEBUG::2011-01-18 19:53:26,591::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-18999::DEBUG::2011-01-18 19:53:26,591::task::577::irs::Task 0a45eced-8c8c-489f-91d4-c9ec162143ff: ref 0 aborting False Thread-18999::INFO::2011-01-18 19:53:26,591::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0478570461273', 'lastCheck': 1295373200.379766, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0488271713257', 'lastCheck': 1295373200.3721471, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0474920272827', 'lastCheck': 1295373200.351335, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484139919281', 'lastCheck': 1295373200.3883359, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0513570308685', 'lastCheck': 1295373200.3732181, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:53:26,832::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:27,364::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500293 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:29,376::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:29,910::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501946 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:53:30,350::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:53:30,351::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:53:30,372::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:53:30,373::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:53:30,376::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:53:30,377::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:53:30,379::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:53:30,381::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:53:30,388::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:53:30,390::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:53:30,394::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:53:30,416::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:53:30,417::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:53:30,421::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:53:30,430::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:31,923::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:32,464::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509672 seconds, 2.0 MB/s\n'; = 0 Thread-19004::INFO::2011-01-18 19:53:34,037::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19004::DEBUG::2011-01-18 19:53:34,037::task::577::irs::Task 007f273f-3784-4ad3-9980-f097e093d99a: moving from state init -> state preparing Thread-19004::DEBUG::2011-01-18 19:53:34,037::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19004::DEBUG::2011-01-18 19:53:34,069::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s\n'; = 0 Thread-19004::DEBUG::2011-01-18 19:53:34,070::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s'], size: 2048 Thread-19004::DEBUG::2011-01-18 19:53:34,070::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19004::DEBUG::2011-01-18 19:53:34,070::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19004::DEBUG::2011-01-18 19:53:34,071::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19004::DEBUG::2011-01-18 19:53:34,071::task::577::irs::Task 007f273f-3784-4ad3-9980-f097e093d99a: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19004::DEBUG::2011-01-18 19:53:34,072::task::577::irs::Task 007f273f-3784-4ad3-9980-f097e093d99a: moving from state preparing -> state finished Thread-19004::DEBUG::2011-01-18 19:53:34,072::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19004::DEBUG::2011-01-18 19:53:34,072::task::577::irs::Task 007f273f-3784-4ad3-9980-f097e093d99a: ref 0 aborting False Thread-19004::INFO::2011-01-18 19:53:34,072::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19005::INFO::2011-01-18 19:53:34,080::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19005::DEBUG::2011-01-18 19:53:34,081::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: moving from state init -> state preparing Thread-19005::DEBUG::2011-01-18 19:53:34,081::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1eb4c618-181b-441b-ae30-1bab77d84253 acquire shared (120000) Thread-19005::DEBUG::2011-01-18 19:53:34,082::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19005::DEBUG::2011-01-18 19:53:34,082::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1eb4c618-181b-441b-ae30-1bab77d84253' Thread-19005::DEBUG::2011-01-18 19:53:34,082::resource::524::irs::Owner 1eb4c618-181b-441b-ae30-1bab77d84253: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19005::DEBUG::2011-01-18 19:53:34,082::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19005::DEBUG::2011-01-18 19:53:34,083::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: ref 1 aborting False Thread-19005::INFO::2011-01-18 19:53:34,083::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19005::DEBUG::2011-01-18 19:53:34,084::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19005::DEBUG::2011-01-18 19:53:34,084::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: moving from state preparing -> state finished Thread-19005::DEBUG::2011-01-18 19:53:34,085::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19005::DEBUG::2011-01-18 19:53:34,085::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1eb4c618-181b-441b-ae30-1bab77d84253 releasing Thread-19005::DEBUG::2011-01-18 19:53:34,085::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19005::DEBUG::2011-01-18 19:53:34,085::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19005::DEBUG::2011-01-18 19:53:34,086::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19005::DEBUG::2011-01-18 19:53:34,086::resource::503::irs::Owner 1eb4c618-181b-441b-ae30-1bab77d84253: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19005::DEBUG::2011-01-18 19:53:34,086::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19005::DEBUG::2011-01-18 19:53:34,087::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19005::DEBUG::2011-01-18 19:53:34,087::task::577::irs::Task 1eb4c618-181b-441b-ae30-1bab77d84253: ref 0 aborting False Thread-19005::INFO::2011-01-18 19:53:34,087::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:53:34,477::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:35,014::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505887 seconds, 2.0 MB/s\n'; = 0 Thread-19007::INFO::2011-01-18 19:53:36,758::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19007::DEBUG::2011-01-18 19:53:36,758::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: moving from state init -> state preparing Thread-19007::DEBUG::2011-01-18 19:53:36,758::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3eeb2953-1d4a-4215-9b42-96c3a487e38d acquire shared (120000) Thread-19007::DEBUG::2011-01-18 19:53:36,759::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19007::DEBUG::2011-01-18 19:53:36,759::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '3eeb2953-1d4a-4215-9b42-96c3a487e38d' Thread-19007::DEBUG::2011-01-18 19:53:36,759::resource::524::irs::Owner 3eeb2953-1d4a-4215-9b42-96c3a487e38d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19007::DEBUG::2011-01-18 19:53:36,759::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19007::DEBUG::2011-01-18 19:53:36,760::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: ref 1 aborting False Thread-19007::DEBUG::2011-01-18 19:53:36,760::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0463800430298', 'lastCheck': 1295373210.425385, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0461990833282', 'lastCheck': 1295373210.422071, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0524301528931', 'lastCheck': 1295373210.4242921, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0470929145813', 'lastCheck': 1295373210.434994, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0493900775909', 'lastCheck': 1295373210.400243, 'valid': True, 'code': 0}} Thread-19007::DEBUG::2011-01-18 19:53:36,760::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: moving from state preparing -> state finished Thread-19007::DEBUG::2011-01-18 19:53:36,761::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19007::DEBUG::2011-01-18 19:53:36,761::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3eeb2953-1d4a-4215-9b42-96c3a487e38d releasing Thread-19007::DEBUG::2011-01-18 19:53:36,761::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19007::DEBUG::2011-01-18 19:53:36,762::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19007::DEBUG::2011-01-18 19:53:36,762::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19007::DEBUG::2011-01-18 19:53:36,762::resource::503::irs::Owner 3eeb2953-1d4a-4215-9b42-96c3a487e38d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19007::DEBUG::2011-01-18 19:53:36,762::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19007::DEBUG::2011-01-18 19:53:36,763::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19007::DEBUG::2011-01-18 19:53:36,763::task::577::irs::Task 3eeb2953-1d4a-4215-9b42-96c3a487e38d: ref 0 aborting False Thread-19007::INFO::2011-01-18 19:53:36,763::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0463800430298', 'lastCheck': 1295373210.425385, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0524301528931', 'lastCheck': 1295373210.4242921, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0493900775909', 'lastCheck': 1295373210.400243, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0470929145813', 'lastCheck': 1295373210.434994, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0461990833282', 'lastCheck': 1295373210.422071, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:53:37,026::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:37,558::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500449 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:39,570::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:40,107::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503258 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:53:40,400::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:53:40,400::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:53:40,422::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:53:40,422::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:53:40,425::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::INFO::2011-01-18 19:53:40,426::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::DEBUG::2011-01-18 19:53:40,427::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:53:40,428::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:53:40,435::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:53:40,436::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:53:40,441::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:53:40,467::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:53:40,467::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:53:40,475::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:53:40,480::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:42,120::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:42,661::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509504 seconds, 2.0 MB/s\n'; = 0 Thread-19012::INFO::2011-01-18 19:53:44,140::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19012::DEBUG::2011-01-18 19:53:44,140::task::577::irs::Task e6b734cf-3c5c-48e7-a968-889aa3e3df1e: moving from state init -> state preparing Thread-19012::DEBUG::2011-01-18 19:53:44,141::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19012::DEBUG::2011-01-18 19:53:44,172::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000443 seconds, 4.6 MB/s\n'; = 0 Thread-19012::DEBUG::2011-01-18 19:53:44,172::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000443 seconds, 4.6 MB/s'], size: 2048 Thread-19012::DEBUG::2011-01-18 19:53:44,173::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19012::DEBUG::2011-01-18 19:53:44,173::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19012::DEBUG::2011-01-18 19:53:44,174::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19012::DEBUG::2011-01-18 19:53:44,174::task::577::irs::Task e6b734cf-3c5c-48e7-a968-889aa3e3df1e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19012::DEBUG::2011-01-18 19:53:44,174::task::577::irs::Task e6b734cf-3c5c-48e7-a968-889aa3e3df1e: moving from state preparing -> state finished Thread-19012::DEBUG::2011-01-18 19:53:44,175::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19012::DEBUG::2011-01-18 19:53:44,175::task::577::irs::Task e6b734cf-3c5c-48e7-a968-889aa3e3df1e: ref 0 aborting False Thread-19012::INFO::2011-01-18 19:53:44,175::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19013::INFO::2011-01-18 19:53:44,184::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19013::DEBUG::2011-01-18 19:53:44,184::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: moving from state init -> state preparing Thread-19013::DEBUG::2011-01-18 19:53:44,185::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ea27e472-e1a3-4f69-b35a-a2c5d49ece78 acquire shared (120000) Thread-19013::DEBUG::2011-01-18 19:53:44,185::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19013::DEBUG::2011-01-18 19:53:44,185::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ea27e472-e1a3-4f69-b35a-a2c5d49ece78' Thread-19013::DEBUG::2011-01-18 19:53:44,185::resource::524::irs::Owner ea27e472-e1a3-4f69-b35a-a2c5d49ece78: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19013::DEBUG::2011-01-18 19:53:44,186::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19013::DEBUG::2011-01-18 19:53:44,186::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: ref 1 aborting False Thread-19013::INFO::2011-01-18 19:53:44,186::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19013::DEBUG::2011-01-18 19:53:44,187::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19013::DEBUG::2011-01-18 19:53:44,188::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: moving from state preparing -> state finished Thread-19013::DEBUG::2011-01-18 19:53:44,188::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19013::DEBUG::2011-01-18 19:53:44,188::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ea27e472-e1a3-4f69-b35a-a2c5d49ece78 releasing Thread-19013::DEBUG::2011-01-18 19:53:44,188::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19013::DEBUG::2011-01-18 19:53:44,189::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19013::DEBUG::2011-01-18 19:53:44,189::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19013::DEBUG::2011-01-18 19:53:44,189::resource::503::irs::Owner ea27e472-e1a3-4f69-b35a-a2c5d49ece78: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19013::DEBUG::2011-01-18 19:53:44,190::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19013::DEBUG::2011-01-18 19:53:44,190::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19013::DEBUG::2011-01-18 19:53:44,190::task::577::irs::Task ea27e472-e1a3-4f69-b35a-a2c5d49ece78: ref 0 aborting False Thread-19013::INFO::2011-01-18 19:53:44,190::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:53:44,674::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:45,208::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502698 seconds, 2.0 MB/s\n'; = 0 Thread-19015::INFO::2011-01-18 19:53:46,920::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19015::DEBUG::2011-01-18 19:53:46,921::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: moving from state init -> state preparing Thread-19015::DEBUG::2011-01-18 19:53:46,921::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a3481a88-93d5-44f4-a12e-093caf08eb60 acquire shared (120000) Thread-19015::DEBUG::2011-01-18 19:53:46,922::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19015::DEBUG::2011-01-18 19:53:46,922::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a3481a88-93d5-44f4-a12e-093caf08eb60' Thread-19015::DEBUG::2011-01-18 19:53:46,922::resource::524::irs::Owner a3481a88-93d5-44f4-a12e-093caf08eb60: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19015::DEBUG::2011-01-18 19:53:46,922::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19015::DEBUG::2011-01-18 19:53:46,923::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: ref 1 aborting False Thread-19015::DEBUG::2011-01-18 19:53:46,923::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0524599552155', 'lastCheck': 1295373220.4783831, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0493099689484', 'lastCheck': 1295373220.4711659, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0498440265656', 'lastCheck': 1295373220.4748051, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0493581295013', 'lastCheck': 1295373220.484246, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.047835111618', 'lastCheck': 1295373220.4477251, 'valid': True, 'code': 0}} Thread-19015::DEBUG::2011-01-18 19:53:46,923::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: moving from state preparing -> state finished Thread-19015::DEBUG::2011-01-18 19:53:46,924::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19015::DEBUG::2011-01-18 19:53:46,924::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a3481a88-93d5-44f4-a12e-093caf08eb60 releasing Thread-19015::DEBUG::2011-01-18 19:53:46,924::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19015::DEBUG::2011-01-18 19:53:46,925::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19015::DEBUG::2011-01-18 19:53:46,925::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19015::DEBUG::2011-01-18 19:53:46,925::resource::503::irs::Owner a3481a88-93d5-44f4-a12e-093caf08eb60: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19015::DEBUG::2011-01-18 19:53:46,925::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19015::DEBUG::2011-01-18 19:53:46,926::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19015::DEBUG::2011-01-18 19:53:46,926::task::577::irs::Task a3481a88-93d5-44f4-a12e-093caf08eb60: ref 0 aborting False Thread-19015::INFO::2011-01-18 19:53:46,926::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0524599552155', 'lastCheck': 1295373220.4783831, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0498440265656', 'lastCheck': 1295373220.4748051, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.047835111618', 'lastCheck': 1295373220.4477251, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0493581295013', 'lastCheck': 1295373220.484246, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0493099689484', 'lastCheck': 1295373220.4711659, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:53:47,220::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:47,753::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500571 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:49,765::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:50,299::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502886 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:53:50,446::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:53:50,447::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:53:50,471::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:53:50,472::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:53:50,475::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:53:50,476::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:53:50,479::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:53:50,480::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:53:50,484::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:53:50,485::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:53:50,489::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:53:50,511::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:53:50,518::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:53:50,520::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:53:50,528::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:52,312::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:52,852::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.508657 seconds, 2.0 MB/s\n'; = 0 Thread-19020::INFO::2011-01-18 19:53:54,243::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19020::DEBUG::2011-01-18 19:53:54,243::task::577::irs::Task 917c8e79-9bfc-4c5d-9ac6-493e78883245: moving from state init -> state preparing Thread-19020::DEBUG::2011-01-18 19:53:54,244::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19020::DEBUG::2011-01-18 19:53:54,275::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000356 seconds, 5.8 MB/s\n'; = 0 Thread-19020::DEBUG::2011-01-18 19:53:54,276::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000356 seconds, 5.8 MB/s'], size: 2048 Thread-19020::DEBUG::2011-01-18 19:53:54,276::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19020::DEBUG::2011-01-18 19:53:54,276::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19020::DEBUG::2011-01-18 19:53:54,277::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19020::DEBUG::2011-01-18 19:53:54,277::task::577::irs::Task 917c8e79-9bfc-4c5d-9ac6-493e78883245: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19020::DEBUG::2011-01-18 19:53:54,278::task::577::irs::Task 917c8e79-9bfc-4c5d-9ac6-493e78883245: moving from state preparing -> state finished Thread-19020::DEBUG::2011-01-18 19:53:54,278::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19020::DEBUG::2011-01-18 19:53:54,278::task::577::irs::Task 917c8e79-9bfc-4c5d-9ac6-493e78883245: ref 0 aborting False Thread-19020::INFO::2011-01-18 19:53:54,278::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19021::INFO::2011-01-18 19:53:54,287::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19021::DEBUG::2011-01-18 19:53:54,287::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: moving from state init -> state preparing Thread-19021::DEBUG::2011-01-18 19:53:54,288::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9a5f6cad-7b30-468c-99a5-87f8ccb91560 acquire shared (120000) Thread-19021::DEBUG::2011-01-18 19:53:54,288::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19021::DEBUG::2011-01-18 19:53:54,288::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9a5f6cad-7b30-468c-99a5-87f8ccb91560' Thread-19021::DEBUG::2011-01-18 19:53:54,289::resource::524::irs::Owner 9a5f6cad-7b30-468c-99a5-87f8ccb91560: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19021::DEBUG::2011-01-18 19:53:54,289::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19021::DEBUG::2011-01-18 19:53:54,289::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: ref 1 aborting False Thread-19021::INFO::2011-01-18 19:53:54,290::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19021::DEBUG::2011-01-18 19:53:54,290::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19021::DEBUG::2011-01-18 19:53:54,291::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: moving from state preparing -> state finished Thread-19021::DEBUG::2011-01-18 19:53:54,291::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19021::DEBUG::2011-01-18 19:53:54,291::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9a5f6cad-7b30-468c-99a5-87f8ccb91560 releasing Thread-19021::DEBUG::2011-01-18 19:53:54,291::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19021::DEBUG::2011-01-18 19:53:54,292::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19021::DEBUG::2011-01-18 19:53:54,292::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19021::DEBUG::2011-01-18 19:53:54,292::resource::503::irs::Owner 9a5f6cad-7b30-468c-99a5-87f8ccb91560: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19021::DEBUG::2011-01-18 19:53:54,293::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19021::DEBUG::2011-01-18 19:53:54,293::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19021::DEBUG::2011-01-18 19:53:54,293::task::577::irs::Task 9a5f6cad-7b30-468c-99a5-87f8ccb91560: ref 0 aborting False Thread-19021::INFO::2011-01-18 19:53:54,294::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:53:54,865::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:55,398::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501734 seconds, 2.0 MB/s\n'; = 0 Thread-19023::INFO::2011-01-18 19:53:57,085::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19023::DEBUG::2011-01-18 19:53:57,086::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: moving from state init -> state preparing Thread-19023::DEBUG::2011-01-18 19:53:57,086::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a5fa171d-a332-4783-8ff1-9b6a3aabea24 acquire shared (120000) Thread-19023::DEBUG::2011-01-18 19:53:57,086::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19023::DEBUG::2011-01-18 19:53:57,087::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a5fa171d-a332-4783-8ff1-9b6a3aabea24' Thread-19023::DEBUG::2011-01-18 19:53:57,087::resource::524::irs::Owner a5fa171d-a332-4783-8ff1-9b6a3aabea24: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19023::DEBUG::2011-01-18 19:53:57,087::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19023::DEBUG::2011-01-18 19:53:57,087::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: ref 1 aborting False Thread-19023::DEBUG::2011-01-18 19:53:57,088::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451610088348', 'lastCheck': 1295373230.5240941, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0438098907471', 'lastCheck': 1295373230.514668, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0497560501099', 'lastCheck': 1295373230.5246351, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0489301681519', 'lastCheck': 1295373230.5328381, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0482590198517', 'lastCheck': 1295373230.495116, 'valid': True, 'code': 0}} Thread-19023::DEBUG::2011-01-18 19:53:57,088::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: moving from state preparing -> state finished Thread-19023::DEBUG::2011-01-18 19:53:57,089::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19023::DEBUG::2011-01-18 19:53:57,089::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a5fa171d-a332-4783-8ff1-9b6a3aabea24 releasing Thread-19023::DEBUG::2011-01-18 19:53:57,089::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19023::DEBUG::2011-01-18 19:53:57,089::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19023::DEBUG::2011-01-18 19:53:57,090::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19023::DEBUG::2011-01-18 19:53:57,090::resource::503::irs::Owner a5fa171d-a332-4783-8ff1-9b6a3aabea24: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19023::DEBUG::2011-01-18 19:53:57,090::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19023::DEBUG::2011-01-18 19:53:57,090::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19023::DEBUG::2011-01-18 19:53:57,091::task::577::irs::Task a5fa171d-a332-4783-8ff1-9b6a3aabea24: ref 0 aborting False Thread-19023::INFO::2011-01-18 19:53:57,091::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451610088348', 'lastCheck': 1295373230.5240941, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0497560501099', 'lastCheck': 1295373230.5246351, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0482590198517', 'lastCheck': 1295373230.495116, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0489301681519', 'lastCheck': 1295373230.5328381, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0438098907471', 'lastCheck': 1295373230.514668, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:53:57,410::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:53:57,944::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500357 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:53:59,956::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:00,492::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502856 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:54:00,506::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:54:00,507::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:54:00,514::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:54:00,515::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:54:00,524::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::INFO::2011-01-18 19:54:00,524::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::DEBUG::2011-01-18 19:54:00,525::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:54:00,526::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:54:00,533::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:54:00,534::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:54:00,548::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:54:00,556::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:54:00,566::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:54:00,573::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:54:00,574::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:02,506::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:03,047::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50967 seconds, 2.0 MB/s\n'; = 0 Thread-19028::INFO::2011-01-18 19:54:04,347::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19028::DEBUG::2011-01-18 19:54:04,347::task::577::irs::Task 578a85d4-eb05-4fd3-9f60-34a2ee378a8e: moving from state init -> state preparing Thread-19028::DEBUG::2011-01-18 19:54:04,348::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19028::DEBUG::2011-01-18 19:54:04,379::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000435 seconds, 4.7 MB/s\n'; = 0 Thread-19028::DEBUG::2011-01-18 19:54:04,380::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000435 seconds, 4.7 MB/s'], size: 2048 Thread-19028::DEBUG::2011-01-18 19:54:04,380::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19028::DEBUG::2011-01-18 19:54:04,381::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19028::DEBUG::2011-01-18 19:54:04,381::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19028::DEBUG::2011-01-18 19:54:04,382::task::577::irs::Task 578a85d4-eb05-4fd3-9f60-34a2ee378a8e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19028::DEBUG::2011-01-18 19:54:04,382::task::577::irs::Task 578a85d4-eb05-4fd3-9f60-34a2ee378a8e: moving from state preparing -> state finished Thread-19028::DEBUG::2011-01-18 19:54:04,382::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19028::DEBUG::2011-01-18 19:54:04,383::task::577::irs::Task 578a85d4-eb05-4fd3-9f60-34a2ee378a8e: ref 0 aborting False Thread-19028::INFO::2011-01-18 19:54:04,383::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19029::INFO::2011-01-18 19:54:04,391::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19029::DEBUG::2011-01-18 19:54:04,392::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: moving from state init -> state preparing Thread-19029::DEBUG::2011-01-18 19:54:04,392::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c4ed66c9-76b7-4538-afdd-a361e2f4fa15 acquire shared (120000) Thread-19029::DEBUG::2011-01-18 19:54:04,392::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19029::DEBUG::2011-01-18 19:54:04,392::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c4ed66c9-76b7-4538-afdd-a361e2f4fa15' Thread-19029::DEBUG::2011-01-18 19:54:04,393::resource::524::irs::Owner c4ed66c9-76b7-4538-afdd-a361e2f4fa15: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19029::DEBUG::2011-01-18 19:54:04,393::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19029::DEBUG::2011-01-18 19:54:04,393::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: ref 1 aborting False Thread-19029::INFO::2011-01-18 19:54:04,394::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19029::DEBUG::2011-01-18 19:54:04,394::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19029::DEBUG::2011-01-18 19:54:04,395::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: moving from state preparing -> state finished Thread-19029::DEBUG::2011-01-18 19:54:04,395::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19029::DEBUG::2011-01-18 19:54:04,395::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c4ed66c9-76b7-4538-afdd-a361e2f4fa15 releasing Thread-19029::DEBUG::2011-01-18 19:54:04,396::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19029::DEBUG::2011-01-18 19:54:04,396::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19029::DEBUG::2011-01-18 19:54:04,396::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19029::DEBUG::2011-01-18 19:54:04,397::resource::503::irs::Owner c4ed66c9-76b7-4538-afdd-a361e2f4fa15: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19029::DEBUG::2011-01-18 19:54:04,397::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19029::DEBUG::2011-01-18 19:54:04,397::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19029::DEBUG::2011-01-18 19:54:04,397::task::577::irs::Task c4ed66c9-76b7-4538-afdd-a361e2f4fa15: ref 0 aborting False Thread-19029::INFO::2011-01-18 19:54:04,398::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:54:05,061::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:05,603::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510226 seconds, 2.0 MB/s\n'; = 0 Thread-19031::INFO::2011-01-18 19:54:07,268::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19031::DEBUG::2011-01-18 19:54:07,269::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: moving from state init -> state preparing Thread-19031::DEBUG::2011-01-18 19:54:07,269::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 547d3c96-8f60-4c89-8f56-8a3e39580546 acquire shared (120000) Thread-19031::DEBUG::2011-01-18 19:54:07,269::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19031::DEBUG::2011-01-18 19:54:07,269::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '547d3c96-8f60-4c89-8f56-8a3e39580546' Thread-19031::DEBUG::2011-01-18 19:54:07,270::resource::524::irs::Owner 547d3c96-8f60-4c89-8f56-8a3e39580546: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19031::DEBUG::2011-01-18 19:54:07,270::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19031::DEBUG::2011-01-18 19:54:07,270::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: ref 1 aborting False Thread-19031::DEBUG::2011-01-18 19:54:07,271::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0461790561676', 'lastCheck': 1295373240.57008, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0468928813934', 'lastCheck': 1295373240.560756, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0535688400269', 'lastCheck': 1295373240.5782149, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0470771789551', 'lastCheck': 1295373240.5799961, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463359355927', 'lastCheck': 1295373240.552871, 'valid': True, 'code': 0}} Thread-19031::DEBUG::2011-01-18 19:54:07,271::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: moving from state preparing -> state finished Thread-19031::DEBUG::2011-01-18 19:54:07,271::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19031::DEBUG::2011-01-18 19:54:07,272::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 547d3c96-8f60-4c89-8f56-8a3e39580546 releasing Thread-19031::DEBUG::2011-01-18 19:54:07,272::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19031::DEBUG::2011-01-18 19:54:07,272::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19031::DEBUG::2011-01-18 19:54:07,272::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19031::DEBUG::2011-01-18 19:54:07,273::resource::503::irs::Owner 547d3c96-8f60-4c89-8f56-8a3e39580546: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19031::DEBUG::2011-01-18 19:54:07,273::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19031::DEBUG::2011-01-18 19:54:07,273::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19031::DEBUG::2011-01-18 19:54:07,274::task::577::irs::Task 547d3c96-8f60-4c89-8f56-8a3e39580546: ref 0 aborting False Thread-19031::INFO::2011-01-18 19:54:07,274::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0461790561676', 'lastCheck': 1295373240.57008, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0535688400269', 'lastCheck': 1295373240.5782149, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463359355927', 'lastCheck': 1295373240.552871, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0470771789551', 'lastCheck': 1295373240.5799961, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0468928813934', 'lastCheck': 1295373240.560756, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:54:07,617::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:08,152::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503151 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:10,165::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 19:54:10,553::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:54:10,553::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:54:10,560::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:54:10,561::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:54:10,570::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:54:10,571::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:54:10,578::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:54:10,579::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:54:10,579::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:54:10,583::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:54:10,596::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:54:10,597::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata count=1' (cwd None) Thread-18494::DEBUG::2011-01-18 19:54:10,606::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:54:10,608::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata count=1' (cwd None) Thread-18493::DEBUG::2011-01-18 19:54:10,618::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:54:10,621::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:54:10,631::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000446 seconds, 4.6 MB/s\n'; = 0 Thread-18497::DEBUG::2011-01-18 19:54:10,631::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000446 seconds, 4.6 MB/s'], size: 2048 Thread-18497::DEBUG::2011-01-18 19:54:10,631::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_4', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE25,uuid:oT9Njr-43C6-OFn2-Pb1m-OHmv-q1ko-qWVZfU,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE24,uuid:zAhT6X-lhHA-0tpM-y8Ir-qdYz-cToH-QS34Qd,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE26,uuid:iai1Ih-p3aO-aJfa-m0Vu-bbUI-Bzmt-faQpU3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE27,uuid:Po2nTz-ZVf1-9CUn-XrvV-KFvh-bVc0-0UlRfc,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE28,uuid:7RfWRw-dleE-FJGk-unwH-mCIt-vjvO-cFlwEV,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE29,uuid:o0eNOA-eXTU-lOuo-1pOl-S9Kc-t3SS-qmqoxq,pestart:0,pecount:95,mapoffset:475', 'ROLE=Regular', 'SDUUID=d36e088c-e33f-41c9-9799-60f27d683f24', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=Rg9Ok4-Ts62-7x69-dnoq-vXMJ-1kxr-7V4hzD', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=506390723e870e52d768c8a93509b36b71d536b4'] Thread-18497::DEBUG::2011-01-18 19:54:10,632::metadata::89::irs::metadata.__validate() __cksum(md) = 506390723e870e52d768c8a93509b36b71d536b4 Thread-18496::DEBUG::2011-01-18 19:54:10,634::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:54:10,634::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata count=1' (cwd None) Thread-18494::DEBUG::2011-01-18 19:54:10,648::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000474 seconds, 4.3 MB/s\n'; = 0 Thread-18494::DEBUG::2011-01-18 19:54:10,649::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000474 seconds, 4.3 MB/s'], size: 2048 Thread-18494::DEBUG::2011-01-18 19:54:10,649::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=None', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE0,uuid:JhuxXz-oY2f-VTKM-jZw1-vjeb-1yfc-4DEMhe,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE1,uuid:3aUVw3-VXRN-GbIT-jnEQ-RmUc-Kqcf-cj2Q3x,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE2,uuid:OFmc1C-VUM2-UeEr-4PaC-e2G4-YjTo-0aIgd3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE3,uuid:kyzPWM-1lW2-zYaO-2BIR-W66P-XrsG-fpehsp,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE4,uuid:EacnTZ-z822-xe9v-9t6A-1u3S-t96k-bOlSQM,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE5,uuid:N8Yas4-g1Rl-y3qt-Zb1d-t4ty-y8Iv-5LxYUR,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE6,uuid:aAF0AR-v83k-qND9-ZwAN-3p89-o9p0-rAF1zi,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE7,uuid:Qf3LTH-Ai55-3Lp0-FKFJ-zmfX-yyf8-yEyqIf,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=zSkJHd-z2vi-SfdH-OmXK-HHD2-HSSF-I7j139', 'MASTER_VERSION=0', '_SHA_CKSUM=6ac9d8deed2c8198ad87a15fde0e9be690649fe9'] Thread-18494::DEBUG::2011-01-18 19:54:10,650::metadata::89::irs::metadata.__validate() __cksum(md) = 6ac9d8deed2c8198ad87a15fde0e9be690649fe9 Thread-18496::DEBUG::2011-01-18 19:54:10,670::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00051 seconds, 4.0 MB/s\n'; = 0 Thread-18496::DEBUG::2011-01-18 19:54:10,670::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00051 seconds, 4.0 MB/s'], size: 2048 Thread-18496::DEBUG::2011-01-18 19:54:10,671::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_5', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE30,uuid:6OMUem-Ea8u-ePsj-ZtiI-PS2g-9lar-vDE1yw,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE31,uuid:rp1dI7-UPsb-ZzJX-eptN-usNA-7bhM-O2aeC0,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE32,uuid:REuolt-m2qg-IguX-yQ6Q-a88i-QbOk-KfxuNR,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE33,uuid:auCyUI-Qzi4-nPej-g5ji-3O7c-PNdD-YSr4HX,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE34,uuid:nxQIzE-gINr-2WGk-fBFz-xWdc-VKpc-0AkgEu,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE35,uuid:9rYRaB-6vqa-jeNi-8d70-Olyy-x5FR-Sfd9rm,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE36,uuid:aj40O1-nJLf-RfMK-vPfA-zy3M-CGZP-gFOulR,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE37,uuid:vCUrIv-sXPe-09Ze-EYzV-cj0C-67iG-ukcW5V,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=YlGdeL-gaDB-Es97-ogbJ-3LdW-crm3-jWw9cH', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=f0ac78701aec46eb830881e3c6db5e3fa21ea53c'] Thread-18496::DEBUG::2011-01-18 19:54:10,671::metadata::89::irs::metadata.__validate() __cksum(md) = f0ac78701aec46eb830881e3c6db5e3fa21ea53c Dummy-18546::DEBUG::2011-01-18 19:54:10,732::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.535102 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:12,746::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:13,287::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50986 seconds, 2.0 MB/s\n'; = 0 Thread-19036::INFO::2011-01-18 19:54:14,461::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19036::DEBUG::2011-01-18 19:54:14,462::task::577::irs::Task 118945f6-7610-49c9-b156-abf497480829: moving from state init -> state preparing Thread-19036::DEBUG::2011-01-18 19:54:14,462::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19036::DEBUG::2011-01-18 19:54:14,494::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000449 seconds, 4.6 MB/s\n'; = 0 Thread-19036::DEBUG::2011-01-18 19:54:14,494::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000449 seconds, 4.6 MB/s'], size: 2048 Thread-19036::DEBUG::2011-01-18 19:54:14,495::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19036::DEBUG::2011-01-18 19:54:14,495::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19036::DEBUG::2011-01-18 19:54:14,496::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19036::DEBUG::2011-01-18 19:54:14,496::task::577::irs::Task 118945f6-7610-49c9-b156-abf497480829: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19036::DEBUG::2011-01-18 19:54:14,497::task::577::irs::Task 118945f6-7610-49c9-b156-abf497480829: moving from state preparing -> state finished Thread-19036::DEBUG::2011-01-18 19:54:14,497::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19036::DEBUG::2011-01-18 19:54:14,497::task::577::irs::Task 118945f6-7610-49c9-b156-abf497480829: ref 0 aborting False Thread-19036::INFO::2011-01-18 19:54:14,498::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19037::INFO::2011-01-18 19:54:14,506::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19037::DEBUG::2011-01-18 19:54:14,506::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: moving from state init -> state preparing Thread-19037::DEBUG::2011-01-18 19:54:14,506::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: af2d3130-8d27-4bd5-97eb-cffe66dd2b73 acquire shared (120000) Thread-19037::DEBUG::2011-01-18 19:54:14,507::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19037::DEBUG::2011-01-18 19:54:14,507::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'af2d3130-8d27-4bd5-97eb-cffe66dd2b73' Thread-19037::DEBUG::2011-01-18 19:54:14,507::resource::524::irs::Owner af2d3130-8d27-4bd5-97eb-cffe66dd2b73: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19037::DEBUG::2011-01-18 19:54:14,508::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19037::DEBUG::2011-01-18 19:54:14,508::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: ref 1 aborting False Thread-19037::INFO::2011-01-18 19:54:14,508::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19037::DEBUG::2011-01-18 19:54:14,509::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19037::DEBUG::2011-01-18 19:54:14,510::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: moving from state preparing -> state finished Thread-19037::DEBUG::2011-01-18 19:54:14,510::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19037::DEBUG::2011-01-18 19:54:14,510::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: af2d3130-8d27-4bd5-97eb-cffe66dd2b73 releasing Thread-19037::DEBUG::2011-01-18 19:54:14,511::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19037::DEBUG::2011-01-18 19:54:14,511::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19037::DEBUG::2011-01-18 19:54:14,511::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19037::DEBUG::2011-01-18 19:54:14,511::resource::503::irs::Owner af2d3130-8d27-4bd5-97eb-cffe66dd2b73: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19037::DEBUG::2011-01-18 19:54:14,512::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19037::DEBUG::2011-01-18 19:54:14,512::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19037::DEBUG::2011-01-18 19:54:14,512::task::577::irs::Task af2d3130-8d27-4bd5-97eb-cffe66dd2b73: ref 0 aborting False Thread-19037::INFO::2011-01-18 19:54:14,513::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:54:15,300::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:15,835::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503661 seconds, 2.0 MB/s\n'; = 0 Thread-19039::INFO::2011-01-18 19:54:17,433::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19039::DEBUG::2011-01-18 19:54:17,433::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: moving from state init -> state preparing Thread-19039::DEBUG::2011-01-18 19:54:17,433::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 958efda1-1bb7-4904-b183-941382b95061 acquire shared (120000) Thread-19039::DEBUG::2011-01-18 19:54:17,434::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19039::DEBUG::2011-01-18 19:54:17,434::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '958efda1-1bb7-4904-b183-941382b95061' Thread-19039::DEBUG::2011-01-18 19:54:17,434::resource::524::irs::Owner 958efda1-1bb7-4904-b183-941382b95061: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19039::DEBUG::2011-01-18 19:54:17,434::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19039::DEBUG::2011-01-18 19:54:17,435::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: ref 1 aborting False Thread-19039::DEBUG::2011-01-18 19:54:17,435::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0542571544647', 'lastCheck': 1295373250.6241741, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0943579673767', 'lastCheck': 1295373250.654309, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0487279891968', 'lastCheck': 1295373250.6266029, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0956859588623', 'lastCheck': 1295373250.67555, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0825810432434', 'lastCheck': 1295373250.6354351, 'valid': True, 'code': 0}} Thread-19039::DEBUG::2011-01-18 19:54:17,435::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: moving from state preparing -> state finished Thread-19039::DEBUG::2011-01-18 19:54:17,436::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19039::DEBUG::2011-01-18 19:54:17,436::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 958efda1-1bb7-4904-b183-941382b95061 releasing Thread-19039::DEBUG::2011-01-18 19:54:17,436::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19039::DEBUG::2011-01-18 19:54:17,437::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19039::DEBUG::2011-01-18 19:54:17,437::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19039::DEBUG::2011-01-18 19:54:17,437::resource::503::irs::Owner 958efda1-1bb7-4904-b183-941382b95061: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19039::DEBUG::2011-01-18 19:54:17,437::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19039::DEBUG::2011-01-18 19:54:17,438::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19039::DEBUG::2011-01-18 19:54:17,438::task::577::irs::Task 958efda1-1bb7-4904-b183-941382b95061: ref 0 aborting False Thread-19039::INFO::2011-01-18 19:54:17,438::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0542571544647', 'lastCheck': 1295373250.6241741, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0487279891968', 'lastCheck': 1295373250.6266029, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0825810432434', 'lastCheck': 1295373250.6354351, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0956859588623', 'lastCheck': 1295373250.67555, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0943579673767', 'lastCheck': 1295373250.654309, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:54:17,849::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:18,386::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505383 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:20,398::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:54:20,624::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:54:20,625::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:54:20,627::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:54:20,628::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:54:20,635::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:54:20,636::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:54:20,654::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:54:20,655::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:54:20,669::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:54:20,675::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:54:20,676::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:54:20,676::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:54:20,687::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:54:20,699::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:54:20,719::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:20,967::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.536147 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:22,980::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:23,525::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512329 seconds, 2.0 MB/s\n'; = 0 Thread-19044::INFO::2011-01-18 19:54:24,567::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19044::DEBUG::2011-01-18 19:54:24,567::task::577::irs::Task 1720c02a-1c5f-4db4-97da-7181ea722aaa: moving from state init -> state preparing Thread-19044::DEBUG::2011-01-18 19:54:24,568::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19044::DEBUG::2011-01-18 19:54:24,599::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000466 seconds, 4.4 MB/s\n'; = 0 Thread-19044::DEBUG::2011-01-18 19:54:24,600::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000466 seconds, 4.4 MB/s'], size: 2048 Thread-19044::DEBUG::2011-01-18 19:54:24,600::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19044::DEBUG::2011-01-18 19:54:24,600::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19044::DEBUG::2011-01-18 19:54:24,601::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19044::DEBUG::2011-01-18 19:54:24,601::task::577::irs::Task 1720c02a-1c5f-4db4-97da-7181ea722aaa: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19044::DEBUG::2011-01-18 19:54:24,602::task::577::irs::Task 1720c02a-1c5f-4db4-97da-7181ea722aaa: moving from state preparing -> state finished Thread-19044::DEBUG::2011-01-18 19:54:24,602::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19044::DEBUG::2011-01-18 19:54:24,602::task::577::irs::Task 1720c02a-1c5f-4db4-97da-7181ea722aaa: ref 0 aborting False Thread-19044::INFO::2011-01-18 19:54:24,603::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19045::INFO::2011-01-18 19:54:24,611::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19045::DEBUG::2011-01-18 19:54:24,611::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: moving from state init -> state preparing Thread-19045::DEBUG::2011-01-18 19:54:24,612::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: bcc679d8-49d5-4550-9ad6-2cb824e5c162 acquire shared (120000) Thread-19045::DEBUG::2011-01-18 19:54:24,612::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19045::DEBUG::2011-01-18 19:54:24,612::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'bcc679d8-49d5-4550-9ad6-2cb824e5c162' Thread-19045::DEBUG::2011-01-18 19:54:24,613::resource::524::irs::Owner bcc679d8-49d5-4550-9ad6-2cb824e5c162: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19045::DEBUG::2011-01-18 19:54:24,613::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19045::DEBUG::2011-01-18 19:54:24,613::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: ref 1 aborting False Thread-19045::INFO::2011-01-18 19:54:24,614::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19045::DEBUG::2011-01-18 19:54:24,614::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19045::DEBUG::2011-01-18 19:54:24,615::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: moving from state preparing -> state finished Thread-19045::DEBUG::2011-01-18 19:54:24,615::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19045::DEBUG::2011-01-18 19:54:24,615::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: bcc679d8-49d5-4550-9ad6-2cb824e5c162 releasing Thread-19045::DEBUG::2011-01-18 19:54:24,616::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19045::DEBUG::2011-01-18 19:54:24,616::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19045::DEBUG::2011-01-18 19:54:24,616::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19045::DEBUG::2011-01-18 19:54:24,616::resource::503::irs::Owner bcc679d8-49d5-4550-9ad6-2cb824e5c162: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19045::DEBUG::2011-01-18 19:54:24,617::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19045::DEBUG::2011-01-18 19:54:24,617::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19045::DEBUG::2011-01-18 19:54:24,617::task::577::irs::Task bcc679d8-49d5-4550-9ad6-2cb824e5c162: ref 0 aborting False Thread-19045::INFO::2011-01-18 19:54:24,618::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:54:25,538::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:26,073::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502869 seconds, 2.0 MB/s\n'; = 0 Thread-19047::INFO::2011-01-18 19:54:27,604::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19047::DEBUG::2011-01-18 19:54:27,604::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: moving from state init -> state preparing Thread-19047::DEBUG::2011-01-18 19:54:27,604::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 32527653-a985-4761-b982-86e6278e4ce7 acquire shared (120000) Thread-19047::DEBUG::2011-01-18 19:54:27,605::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19047::DEBUG::2011-01-18 19:54:27,605::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '32527653-a985-4761-b982-86e6278e4ce7' Thread-19047::DEBUG::2011-01-18 19:54:27,605::resource::524::irs::Owner 32527653-a985-4761-b982-86e6278e4ce7: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19047::DEBUG::2011-01-18 19:54:27,606::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19047::DEBUG::2011-01-18 19:54:27,606::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: ref 1 aborting False Thread-19047::DEBUG::2011-01-18 19:54:27,606::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.052365064621', 'lastCheck': 1295373260.676245, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0488388538361', 'lastCheck': 1295373260.702714, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0574259757996', 'lastCheck': 1295373260.6845369, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487959384918', 'lastCheck': 1295373260.7238109, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0574731826782', 'lastCheck': 1295373260.6923611, 'valid': True, 'code': 0}} Thread-19047::DEBUG::2011-01-18 19:54:27,607::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: moving from state preparing -> state finished Thread-19047::DEBUG::2011-01-18 19:54:27,607::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19047::DEBUG::2011-01-18 19:54:27,607::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 32527653-a985-4761-b982-86e6278e4ce7 releasing Thread-19047::DEBUG::2011-01-18 19:54:27,607::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19047::DEBUG::2011-01-18 19:54:27,608::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19047::DEBUG::2011-01-18 19:54:27,608::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19047::DEBUG::2011-01-18 19:54:27,608::resource::503::irs::Owner 32527653-a985-4761-b982-86e6278e4ce7: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19047::DEBUG::2011-01-18 19:54:27,609::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19047::DEBUG::2011-01-18 19:54:27,609::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19047::DEBUG::2011-01-18 19:54:27,609::task::577::irs::Task 32527653-a985-4761-b982-86e6278e4ce7: ref 0 aborting False Thread-19047::INFO::2011-01-18 19:54:27,609::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.052365064621', 'lastCheck': 1295373260.676245, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0574259757996', 'lastCheck': 1295373260.6845369, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0574731826782', 'lastCheck': 1295373260.6923611, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487959384918', 'lastCheck': 1295373260.7238109, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0488388538361', 'lastCheck': 1295373260.702714, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:54:28,085::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:28,618::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501499 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:30,632::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:54:30,676::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:54:30,676::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:54:30,684::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:54:30,685::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:54:30,692::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:54:30,693::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:54:30,702::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:54:30,703::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:54:30,719::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:54:30,723::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:54:30,724::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:54:30,733::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:54:30,739::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:54:30,749::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:54:30,771::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:31,196::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.532385 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:33,210::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:33,754::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512072 seconds, 2.0 MB/s\n'; = 0 Thread-19052::INFO::2011-01-18 19:54:34,670::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19052::DEBUG::2011-01-18 19:54:34,671::task::577::irs::Task 7b3b5cd9-c2ca-44f1-b174-501bdc521a54: moving from state init -> state preparing Thread-19052::DEBUG::2011-01-18 19:54:34,671::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19052::DEBUG::2011-01-18 19:54:34,703::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000468 seconds, 4.4 MB/s\n'; = 0 Thread-19052::DEBUG::2011-01-18 19:54:34,703::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000468 seconds, 4.4 MB/s'], size: 2048 Thread-19052::DEBUG::2011-01-18 19:54:34,704::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19052::DEBUG::2011-01-18 19:54:34,704::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19052::DEBUG::2011-01-18 19:54:34,705::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19052::DEBUG::2011-01-18 19:54:34,705::task::577::irs::Task 7b3b5cd9-c2ca-44f1-b174-501bdc521a54: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19052::DEBUG::2011-01-18 19:54:34,705::task::577::irs::Task 7b3b5cd9-c2ca-44f1-b174-501bdc521a54: moving from state preparing -> state finished Thread-19052::DEBUG::2011-01-18 19:54:34,706::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19052::DEBUG::2011-01-18 19:54:34,706::task::577::irs::Task 7b3b5cd9-c2ca-44f1-b174-501bdc521a54: ref 0 aborting False Thread-19052::INFO::2011-01-18 19:54:34,706::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19053::INFO::2011-01-18 19:54:34,715::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19053::DEBUG::2011-01-18 19:54:34,715::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: moving from state init -> state preparing Thread-19053::DEBUG::2011-01-18 19:54:34,716::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dae2cc23-40f4-4838-b590-e3563791c020 acquire shared (120000) Thread-19053::DEBUG::2011-01-18 19:54:34,716::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19053::DEBUG::2011-01-18 19:54:34,716::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'dae2cc23-40f4-4838-b590-e3563791c020' Thread-19053::DEBUG::2011-01-18 19:54:34,716::resource::524::irs::Owner dae2cc23-40f4-4838-b590-e3563791c020: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19053::DEBUG::2011-01-18 19:54:34,717::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19053::DEBUG::2011-01-18 19:54:34,717::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: ref 1 aborting False Thread-19053::INFO::2011-01-18 19:54:34,718::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19053::DEBUG::2011-01-18 19:54:34,718::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19053::DEBUG::2011-01-18 19:54:34,719::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: moving from state preparing -> state finished Thread-19053::DEBUG::2011-01-18 19:54:34,719::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19053::DEBUG::2011-01-18 19:54:34,719::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dae2cc23-40f4-4838-b590-e3563791c020 releasing Thread-19053::DEBUG::2011-01-18 19:54:34,720::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19053::DEBUG::2011-01-18 19:54:34,720::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19053::DEBUG::2011-01-18 19:54:34,720::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19053::DEBUG::2011-01-18 19:54:34,720::resource::503::irs::Owner dae2cc23-40f4-4838-b590-e3563791c020: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19053::DEBUG::2011-01-18 19:54:34,721::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19053::DEBUG::2011-01-18 19:54:34,721::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19053::DEBUG::2011-01-18 19:54:34,721::task::577::irs::Task dae2cc23-40f4-4838-b590-e3563791c020: ref 0 aborting False Thread-19053::INFO::2011-01-18 19:54:34,722::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:54:35,768::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:36,302::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501931 seconds, 2.0 MB/s\n'; = 0 Thread-19055::INFO::2011-01-18 19:54:37,766::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19055::DEBUG::2011-01-18 19:54:37,766::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: moving from state init -> state preparing Thread-19055::DEBUG::2011-01-18 19:54:37,766::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 16cbf77c-2e61-4614-b737-4f622b52d3cc acquire shared (120000) Thread-19055::DEBUG::2011-01-18 19:54:37,767::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19055::DEBUG::2011-01-18 19:54:37,767::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '16cbf77c-2e61-4614-b737-4f622b52d3cc' Thread-19055::DEBUG::2011-01-18 19:54:37,767::resource::524::irs::Owner 16cbf77c-2e61-4614-b737-4f622b52d3cc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19055::DEBUG::2011-01-18 19:54:37,767::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19055::DEBUG::2011-01-18 19:54:37,768::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: ref 1 aborting False Thread-19055::DEBUG::2011-01-18 19:54:37,768::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0496070384979', 'lastCheck': 1295373270.7254601, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0528120994568', 'lastCheck': 1295373270.7546921, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0556950569153', 'lastCheck': 1295373270.739608, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0524671077728', 'lastCheck': 1295373270.776329, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0512461662292', 'lastCheck': 1295373270.7431681, 'valid': True, 'code': 0}} Thread-19055::DEBUG::2011-01-18 19:54:37,768::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: moving from state preparing -> state finished Thread-19055::DEBUG::2011-01-18 19:54:37,769::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19055::DEBUG::2011-01-18 19:54:37,769::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 16cbf77c-2e61-4614-b737-4f622b52d3cc releasing Thread-19055::DEBUG::2011-01-18 19:54:37,769::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19055::DEBUG::2011-01-18 19:54:37,770::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19055::DEBUG::2011-01-18 19:54:37,770::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19055::DEBUG::2011-01-18 19:54:37,770::resource::503::irs::Owner 16cbf77c-2e61-4614-b737-4f622b52d3cc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19055::DEBUG::2011-01-18 19:54:37,770::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19055::DEBUG::2011-01-18 19:54:37,771::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19055::DEBUG::2011-01-18 19:54:37,771::task::577::irs::Task 16cbf77c-2e61-4614-b737-4f622b52d3cc: ref 0 aborting False Thread-19055::INFO::2011-01-18 19:54:37,771::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0496070384979', 'lastCheck': 1295373270.7254601, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0556950569153', 'lastCheck': 1295373270.739608, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0512461662292', 'lastCheck': 1295373270.7431681, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0524671077728', 'lastCheck': 1295373270.776329, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0528120994568', 'lastCheck': 1295373270.7546921, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:54:38,315::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:38,848::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50087 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:54:40,724::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:54:40,725::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:54:40,739::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:54:40,740::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:54:40,743::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:54:40,744::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:54:40,754::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:54:40,755::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:54:40,765::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:54:40,775::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:54:40,777::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:54:40,785::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:54:40,787::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:54:40,797::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:54:40,821::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:40,861::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:41,396::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502507 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:43,408::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:43,960::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.520283 seconds, 2.0 MB/s\n'; = 0 Thread-19060::INFO::2011-01-18 19:54:44,775::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19060::DEBUG::2011-01-18 19:54:44,775::task::577::irs::Task eb886424-a716-4b58-8f09-574765291d36: moving from state init -> state preparing Thread-19060::DEBUG::2011-01-18 19:54:44,776::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19060::DEBUG::2011-01-18 19:54:44,808::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000439 seconds, 4.7 MB/s\n'; = 0 Thread-19060::DEBUG::2011-01-18 19:54:44,808::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000439 seconds, 4.7 MB/s'], size: 2048 Thread-19060::DEBUG::2011-01-18 19:54:44,808::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19060::DEBUG::2011-01-18 19:54:44,809::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19060::DEBUG::2011-01-18 19:54:44,809::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19060::DEBUG::2011-01-18 19:54:44,810::task::577::irs::Task eb886424-a716-4b58-8f09-574765291d36: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19060::DEBUG::2011-01-18 19:54:44,810::task::577::irs::Task eb886424-a716-4b58-8f09-574765291d36: moving from state preparing -> state finished Thread-19060::DEBUG::2011-01-18 19:54:44,810::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19060::DEBUG::2011-01-18 19:54:44,811::task::577::irs::Task eb886424-a716-4b58-8f09-574765291d36: ref 0 aborting False Thread-19060::INFO::2011-01-18 19:54:44,811::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19061::INFO::2011-01-18 19:54:44,820::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19061::DEBUG::2011-01-18 19:54:44,820::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: moving from state init -> state preparing Thread-19061::DEBUG::2011-01-18 19:54:44,821::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b01d5cf4-ce43-4164-908d-47cafceaca19 acquire shared (120000) Thread-19061::DEBUG::2011-01-18 19:54:44,821::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19061::DEBUG::2011-01-18 19:54:44,821::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b01d5cf4-ce43-4164-908d-47cafceaca19' Thread-19061::DEBUG::2011-01-18 19:54:44,822::resource::524::irs::Owner b01d5cf4-ce43-4164-908d-47cafceaca19: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19061::DEBUG::2011-01-18 19:54:44,822::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19061::DEBUG::2011-01-18 19:54:44,822::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: ref 1 aborting False Thread-19061::INFO::2011-01-18 19:54:44,823::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19061::DEBUG::2011-01-18 19:54:44,823::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19061::DEBUG::2011-01-18 19:54:44,824::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: moving from state preparing -> state finished Thread-19061::DEBUG::2011-01-18 19:54:44,824::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19061::DEBUG::2011-01-18 19:54:44,825::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b01d5cf4-ce43-4164-908d-47cafceaca19 releasing Thread-19061::DEBUG::2011-01-18 19:54:44,825::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19061::DEBUG::2011-01-18 19:54:44,825::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19061::DEBUG::2011-01-18 19:54:44,825::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19061::DEBUG::2011-01-18 19:54:44,826::resource::503::irs::Owner b01d5cf4-ce43-4164-908d-47cafceaca19: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19061::DEBUG::2011-01-18 19:54:44,826::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19061::DEBUG::2011-01-18 19:54:44,826::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19061::DEBUG::2011-01-18 19:54:44,826::task::577::irs::Task b01d5cf4-ce43-4164-908d-47cafceaca19: ref 0 aborting False Thread-19061::INFO::2011-01-18 19:54:44,827::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:54:45,974::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:46,508::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502559 seconds, 2.0 MB/s\n'; = 0 Thread-19063::INFO::2011-01-18 19:54:47,930::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19063::DEBUG::2011-01-18 19:54:47,930::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: moving from state init -> state preparing Thread-19063::DEBUG::2011-01-18 19:54:47,931::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fb6b90c6-7913-44b7-90ae-52bf5cadf575 acquire shared (120000) Thread-19063::DEBUG::2011-01-18 19:54:47,931::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19063::DEBUG::2011-01-18 19:54:47,931::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fb6b90c6-7913-44b7-90ae-52bf5cadf575' Thread-19063::DEBUG::2011-01-18 19:54:47,932::resource::524::irs::Owner fb6b90c6-7913-44b7-90ae-52bf5cadf575: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19063::DEBUG::2011-01-18 19:54:47,932::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19063::DEBUG::2011-01-18 19:54:47,932::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: ref 1 aborting False Thread-19063::DEBUG::2011-01-18 19:54:47,932::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0460860729218', 'lastCheck': 1295373280.770926, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0488500595093', 'lastCheck': 1295373280.8028121, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0532858371735', 'lastCheck': 1295373280.7921519, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494759082794', 'lastCheck': 1295373280.8253529, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0472478866577', 'lastCheck': 1295373280.7901959, 'valid': True, 'code': 0}} Thread-19063::DEBUG::2011-01-18 19:54:47,933::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: moving from state preparing -> state finished Thread-19063::DEBUG::2011-01-18 19:54:47,933::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19063::DEBUG::2011-01-18 19:54:47,933::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fb6b90c6-7913-44b7-90ae-52bf5cadf575 releasing Thread-19063::DEBUG::2011-01-18 19:54:47,934::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19063::DEBUG::2011-01-18 19:54:47,934::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19063::DEBUG::2011-01-18 19:54:47,934::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19063::DEBUG::2011-01-18 19:54:47,935::resource::503::irs::Owner fb6b90c6-7913-44b7-90ae-52bf5cadf575: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19063::DEBUG::2011-01-18 19:54:47,935::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19063::DEBUG::2011-01-18 19:54:47,935::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19063::DEBUG::2011-01-18 19:54:47,935::task::577::irs::Task fb6b90c6-7913-44b7-90ae-52bf5cadf575: ref 0 aborting False Thread-19063::INFO::2011-01-18 19:54:47,936::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0460860729218', 'lastCheck': 1295373280.770926, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0532858371735', 'lastCheck': 1295373280.7921519, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0472478866577', 'lastCheck': 1295373280.7901959, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494759082794', 'lastCheck': 1295373280.8253529, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0488500595093', 'lastCheck': 1295373280.8028121, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:54:48,522::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:49,055::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501246 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:54:50,770::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:54:50,771::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:54:50,790::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:54:50,791::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:54:50,793::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:54:50,795::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:54:50,803::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:54:50,804::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:54:50,811::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:54:50,825::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:54:50,826::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:54:50,833::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:54:50,841::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:54:50,845::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:54:50,868::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:51,067::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:51,601::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503081 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:54:53,614::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:54,146::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500416 seconds, 2.0 MB/s\n'; = 0 Thread-19068::INFO::2011-01-18 19:54:54,878::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19068::DEBUG::2011-01-18 19:54:54,878::task::577::irs::Task 32f4fbad-7335-43cd-808d-1196d4fe5d59: moving from state init -> state preparing Thread-19068::DEBUG::2011-01-18 19:54:54,879::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19068::DEBUG::2011-01-18 19:54:54,910::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000413 seconds, 5.0 MB/s\n'; = 0 Thread-19068::DEBUG::2011-01-18 19:54:54,911::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000413 seconds, 5.0 MB/s'], size: 2048 Thread-19068::DEBUG::2011-01-18 19:54:54,911::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19068::DEBUG::2011-01-18 19:54:54,911::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19068::DEBUG::2011-01-18 19:54:54,912::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19068::DEBUG::2011-01-18 19:54:54,912::task::577::irs::Task 32f4fbad-7335-43cd-808d-1196d4fe5d59: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19068::DEBUG::2011-01-18 19:54:54,913::task::577::irs::Task 32f4fbad-7335-43cd-808d-1196d4fe5d59: moving from state preparing -> state finished Thread-19068::DEBUG::2011-01-18 19:54:54,913::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19068::DEBUG::2011-01-18 19:54:54,913::task::577::irs::Task 32f4fbad-7335-43cd-808d-1196d4fe5d59: ref 0 aborting False Thread-19068::INFO::2011-01-18 19:54:54,914::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19069::INFO::2011-01-18 19:54:54,922::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19069::DEBUG::2011-01-18 19:54:54,922::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: moving from state init -> state preparing Thread-19069::DEBUG::2011-01-18 19:54:54,922::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5643237d-edde-4427-92d5-9babdd88e058 acquire shared (120000) Thread-19069::DEBUG::2011-01-18 19:54:54,923::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19069::DEBUG::2011-01-18 19:54:54,923::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5643237d-edde-4427-92d5-9babdd88e058' Thread-19069::DEBUG::2011-01-18 19:54:54,923::resource::524::irs::Owner 5643237d-edde-4427-92d5-9babdd88e058: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19069::DEBUG::2011-01-18 19:54:54,924::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19069::DEBUG::2011-01-18 19:54:54,924::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: ref 1 aborting False Thread-19069::INFO::2011-01-18 19:54:54,924::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19069::DEBUG::2011-01-18 19:54:54,925::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19069::DEBUG::2011-01-18 19:54:54,925::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: moving from state preparing -> state finished Thread-19069::DEBUG::2011-01-18 19:54:54,926::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19069::DEBUG::2011-01-18 19:54:54,926::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5643237d-edde-4427-92d5-9babdd88e058 releasing Thread-19069::DEBUG::2011-01-18 19:54:54,926::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19069::DEBUG::2011-01-18 19:54:54,927::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19069::DEBUG::2011-01-18 19:54:54,927::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19069::DEBUG::2011-01-18 19:54:54,927::resource::503::irs::Owner 5643237d-edde-4427-92d5-9babdd88e058: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19069::DEBUG::2011-01-18 19:54:54,927::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19069::DEBUG::2011-01-18 19:54:54,928::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19069::DEBUG::2011-01-18 19:54:54,928::task::577::irs::Task 5643237d-edde-4427-92d5-9babdd88e058: ref 0 aborting False Thread-19069::INFO::2011-01-18 19:54:54,928::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:54:56,159::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:56,702::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511231 seconds, 2.0 MB/s\n'; = 0 Thread-19071::INFO::2011-01-18 19:54:58,094::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19071::DEBUG::2011-01-18 19:54:58,094::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: moving from state init -> state preparing Thread-19071::DEBUG::2011-01-18 19:54:58,095::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1d59800f-737c-479d-80a8-a60b2965160c acquire shared (120000) Thread-19071::DEBUG::2011-01-18 19:54:58,095::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19071::DEBUG::2011-01-18 19:54:58,095::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1d59800f-737c-479d-80a8-a60b2965160c' Thread-19071::DEBUG::2011-01-18 19:54:58,095::resource::524::irs::Owner 1d59800f-737c-479d-80a8-a60b2965160c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19071::DEBUG::2011-01-18 19:54:58,096::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19071::DEBUG::2011-01-18 19:54:58,096::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: ref 1 aborting False Thread-19071::DEBUG::2011-01-18 19:54:58,096::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0466940402985', 'lastCheck': 1295373290.817534, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0479419231415', 'lastCheck': 1295373290.8508129, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0532598495483', 'lastCheck': 1295373290.8463359, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0486211776733', 'lastCheck': 1295373290.8734801, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0476908683777', 'lastCheck': 1295373290.8375859, 'valid': True, 'code': 0}} Thread-19071::DEBUG::2011-01-18 19:54:58,097::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: moving from state preparing -> state finished Thread-19071::DEBUG::2011-01-18 19:54:58,097::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19071::DEBUG::2011-01-18 19:54:58,097::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1d59800f-737c-479d-80a8-a60b2965160c releasing Thread-19071::DEBUG::2011-01-18 19:54:58,098::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19071::DEBUG::2011-01-18 19:54:58,098::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19071::DEBUG::2011-01-18 19:54:58,098::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19071::DEBUG::2011-01-18 19:54:58,098::resource::503::irs::Owner 1d59800f-737c-479d-80a8-a60b2965160c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19071::DEBUG::2011-01-18 19:54:58,099::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19071::DEBUG::2011-01-18 19:54:58,099::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19071::DEBUG::2011-01-18 19:54:58,099::task::577::irs::Task 1d59800f-737c-479d-80a8-a60b2965160c: ref 0 aborting False Thread-19071::INFO::2011-01-18 19:54:58,099::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0466940402985', 'lastCheck': 1295373290.817534, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0532598495483', 'lastCheck': 1295373290.8463359, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0476908683777', 'lastCheck': 1295373290.8375859, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0486211776733', 'lastCheck': 1295373290.8734801, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0479419231415', 'lastCheck': 1295373290.8508129, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:54:58,714::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:54:59,247::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500553 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:55:00,816::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:55:00,817::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:55:00,837::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:55:00,838::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:55:00,846::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:55:00,847::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:55:00,851::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:55:00,852::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:55:00,857::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:55:00,873::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:55:00,873::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:55:00,878::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:55:00,887::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:55:00,894::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:55:00,916::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:01,260::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:01,794::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502476 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:03,808::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:04,343::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503048 seconds, 2.0 MB/s\n'; = 0 Thread-19076::INFO::2011-01-18 19:55:04,980::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19076::DEBUG::2011-01-18 19:55:04,980::task::577::irs::Task 0b74682c-6b65-4862-9c90-e446eed9ccca: moving from state init -> state preparing Thread-19076::DEBUG::2011-01-18 19:55:04,981::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19076::DEBUG::2011-01-18 19:55:05,012::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000469 seconds, 4.4 MB/s\n'; = 0 Thread-19076::DEBUG::2011-01-18 19:55:05,012::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000469 seconds, 4.4 MB/s'], size: 2048 Thread-19076::DEBUG::2011-01-18 19:55:05,013::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19076::DEBUG::2011-01-18 19:55:05,013::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19076::DEBUG::2011-01-18 19:55:05,014::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19076::DEBUG::2011-01-18 19:55:05,014::task::577::irs::Task 0b74682c-6b65-4862-9c90-e446eed9ccca: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19076::DEBUG::2011-01-18 19:55:05,014::task::577::irs::Task 0b74682c-6b65-4862-9c90-e446eed9ccca: moving from state preparing -> state finished Thread-19076::DEBUG::2011-01-18 19:55:05,015::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19076::DEBUG::2011-01-18 19:55:05,015::task::577::irs::Task 0b74682c-6b65-4862-9c90-e446eed9ccca: ref 0 aborting False Thread-19076::INFO::2011-01-18 19:55:05,015::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19077::INFO::2011-01-18 19:55:05,024::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19077::DEBUG::2011-01-18 19:55:05,024::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: moving from state init -> state preparing Thread-19077::DEBUG::2011-01-18 19:55:05,024::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa acquire shared (120000) Thread-19077::DEBUG::2011-01-18 19:55:05,025::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19077::DEBUG::2011-01-18 19:55:05,025::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9a2461c6-9e6b-4bfe-9d6a-4286f62889aa' Thread-19077::DEBUG::2011-01-18 19:55:05,025::resource::524::irs::Owner 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19077::DEBUG::2011-01-18 19:55:05,025::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19077::DEBUG::2011-01-18 19:55:05,026::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: ref 1 aborting False Thread-19077::INFO::2011-01-18 19:55:05,026::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19077::DEBUG::2011-01-18 19:55:05,027::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19077::DEBUG::2011-01-18 19:55:05,027::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: moving from state preparing -> state finished Thread-19077::DEBUG::2011-01-18 19:55:05,027::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19077::DEBUG::2011-01-18 19:55:05,028::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa releasing Thread-19077::DEBUG::2011-01-18 19:55:05,028::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19077::DEBUG::2011-01-18 19:55:05,028::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19077::DEBUG::2011-01-18 19:55:05,029::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19077::DEBUG::2011-01-18 19:55:05,029::resource::503::irs::Owner 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19077::DEBUG::2011-01-18 19:55:05,029::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19077::DEBUG::2011-01-18 19:55:05,029::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19077::DEBUG::2011-01-18 19:55:05,030::task::577::irs::Task 9a2461c6-9e6b-4bfe-9d6a-4286f62889aa: ref 0 aborting False Thread-19077::INFO::2011-01-18 19:55:05,030::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:55:06,356::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:06,900::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510806 seconds, 2.0 MB/s\n'; = 0 Thread-19079::INFO::2011-01-18 19:55:08,278::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19079::DEBUG::2011-01-18 19:55:08,279::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: moving from state init -> state preparing Thread-19079::DEBUG::2011-01-18 19:55:08,279::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 15513131-f387-4678-a1f3-bc3d9aaf8ef7 acquire shared (120000) Thread-19079::DEBUG::2011-01-18 19:55:08,279::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19079::DEBUG::2011-01-18 19:55:08,280::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '15513131-f387-4678-a1f3-bc3d9aaf8ef7' Thread-19079::DEBUG::2011-01-18 19:55:08,280::resource::524::irs::Owner 15513131-f387-4678-a1f3-bc3d9aaf8ef7: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19079::DEBUG::2011-01-18 19:55:08,280::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19079::DEBUG::2011-01-18 19:55:08,280::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: ref 1 aborting False Thread-19079::DEBUG::2011-01-18 19:55:08,281::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0459561347961', 'lastCheck': 1295373300.8627961, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0474779605865', 'lastCheck': 1295373300.898356, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0472218990326', 'lastCheck': 1295373300.893085, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484888553619', 'lastCheck': 1295373300.9213729, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0458478927612', 'lastCheck': 1295373300.882746, 'valid': True, 'code': 0}} Thread-19079::DEBUG::2011-01-18 19:55:08,281::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: moving from state preparing -> state finished Thread-19079::DEBUG::2011-01-18 19:55:08,281::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19079::DEBUG::2011-01-18 19:55:08,282::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 15513131-f387-4678-a1f3-bc3d9aaf8ef7 releasing Thread-19079::DEBUG::2011-01-18 19:55:08,282::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19079::DEBUG::2011-01-18 19:55:08,282::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19079::DEBUG::2011-01-18 19:55:08,283::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19079::DEBUG::2011-01-18 19:55:08,283::resource::503::irs::Owner 15513131-f387-4678-a1f3-bc3d9aaf8ef7: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19079::DEBUG::2011-01-18 19:55:08,283::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19079::DEBUG::2011-01-18 19:55:08,283::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19079::DEBUG::2011-01-18 19:55:08,284::task::577::irs::Task 15513131-f387-4678-a1f3-bc3d9aaf8ef7: ref 0 aborting False Thread-19079::INFO::2011-01-18 19:55:08,284::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0459561347961', 'lastCheck': 1295373300.8627961, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0472218990326', 'lastCheck': 1295373300.893085, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0458478927612', 'lastCheck': 1295373300.882746, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484888553619', 'lastCheck': 1295373300.9213729, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0474779605865', 'lastCheck': 1295373300.898356, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:55:08,913::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:09,448::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502843 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:55:10,862::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:55:10,863::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:55:10,882::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:55:10,883::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:55:10,893::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:55:10,894::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:55:10,898::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:55:10,899::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:55:10,903::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:55:10,920::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:55:10,921::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:55:10,925::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:55:10,935::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:55:10,941::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:55:10,964::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:11,462::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:11,996::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501211 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:14,009::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:14,544::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503794 seconds, 2.0 MB/s\n'; = 0 Thread-19084::INFO::2011-01-18 19:55:15,084::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19084::DEBUG::2011-01-18 19:55:15,084::task::577::irs::Task 355c9ec2-97ab-4cee-ba04-dcf3a8bb6ff1: moving from state init -> state preparing Thread-19084::DEBUG::2011-01-18 19:55:15,085::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19084::DEBUG::2011-01-18 19:55:15,116::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000655 seconds, 3.1 MB/s\n'; = 0 Thread-19084::DEBUG::2011-01-18 19:55:15,117::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000655 seconds, 3.1 MB/s'], size: 2048 Thread-19084::DEBUG::2011-01-18 19:55:15,117::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19084::DEBUG::2011-01-18 19:55:15,118::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19084::DEBUG::2011-01-18 19:55:15,118::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19084::DEBUG::2011-01-18 19:55:15,119::task::577::irs::Task 355c9ec2-97ab-4cee-ba04-dcf3a8bb6ff1: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19084::DEBUG::2011-01-18 19:55:15,119::task::577::irs::Task 355c9ec2-97ab-4cee-ba04-dcf3a8bb6ff1: moving from state preparing -> state finished Thread-19084::DEBUG::2011-01-18 19:55:15,119::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19084::DEBUG::2011-01-18 19:55:15,120::task::577::irs::Task 355c9ec2-97ab-4cee-ba04-dcf3a8bb6ff1: ref 0 aborting False Thread-19084::INFO::2011-01-18 19:55:15,120::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19085::INFO::2011-01-18 19:55:15,132::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19085::DEBUG::2011-01-18 19:55:15,133::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: moving from state init -> state preparing Thread-19085::DEBUG::2011-01-18 19:55:15,133::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8db9bd60-639c-486c-b42c-87567840b6d4 acquire shared (120000) Thread-19085::DEBUG::2011-01-18 19:55:15,133::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19085::DEBUG::2011-01-18 19:55:15,134::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8db9bd60-639c-486c-b42c-87567840b6d4' Thread-19085::DEBUG::2011-01-18 19:55:15,134::resource::524::irs::Owner 8db9bd60-639c-486c-b42c-87567840b6d4: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19085::DEBUG::2011-01-18 19:55:15,134::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19085::DEBUG::2011-01-18 19:55:15,135::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: ref 1 aborting False Thread-19085::INFO::2011-01-18 19:55:15,135::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19085::DEBUG::2011-01-18 19:55:15,136::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19085::DEBUG::2011-01-18 19:55:15,136::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: moving from state preparing -> state finished Thread-19085::DEBUG::2011-01-18 19:55:15,136::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19085::DEBUG::2011-01-18 19:55:15,137::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8db9bd60-639c-486c-b42c-87567840b6d4 releasing Thread-19085::DEBUG::2011-01-18 19:55:15,137::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19085::DEBUG::2011-01-18 19:55:15,137::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19085::DEBUG::2011-01-18 19:55:15,137::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19085::DEBUG::2011-01-18 19:55:15,138::resource::503::irs::Owner 8db9bd60-639c-486c-b42c-87567840b6d4: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19085::DEBUG::2011-01-18 19:55:15,138::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19085::DEBUG::2011-01-18 19:55:15,138::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19085::DEBUG::2011-01-18 19:55:15,139::task::577::irs::Task 8db9bd60-639c-486c-b42c-87567840b6d4: ref 0 aborting False Thread-19085::INFO::2011-01-18 19:55:15,139::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:55:16,558::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:17,100::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509933 seconds, 2.0 MB/s\n'; = 0 Thread-19087::INFO::2011-01-18 19:55:18,450::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19087::DEBUG::2011-01-18 19:55:18,451::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: moving from state init -> state preparing Thread-19087::DEBUG::2011-01-18 19:55:18,451::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9d36733b-5649-4cd1-81df-930a734ae633 acquire shared (120000) Thread-19087::DEBUG::2011-01-18 19:55:18,451::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19087::DEBUG::2011-01-18 19:55:18,452::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9d36733b-5649-4cd1-81df-930a734ae633' Thread-19087::DEBUG::2011-01-18 19:55:18,452::resource::524::irs::Owner 9d36733b-5649-4cd1-81df-930a734ae633: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19087::DEBUG::2011-01-18 19:55:18,452::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19087::DEBUG::2011-01-18 19:55:18,452::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: ref 1 aborting False Thread-19087::DEBUG::2011-01-18 19:55:18,453::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464868545532', 'lastCheck': 1295373310.909354, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0474810600281', 'lastCheck': 1295373310.945358, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0477781295776', 'lastCheck': 1295373310.9406381, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484569072723', 'lastCheck': 1295373310.9693339, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0486559867859', 'lastCheck': 1295373310.930522, 'valid': True, 'code': 0}} Thread-19087::DEBUG::2011-01-18 19:55:18,453::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: moving from state preparing -> state finished Thread-19087::DEBUG::2011-01-18 19:55:18,453::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19087::DEBUG::2011-01-18 19:55:18,454::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9d36733b-5649-4cd1-81df-930a734ae633 releasing Thread-19087::DEBUG::2011-01-18 19:55:18,454::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19087::DEBUG::2011-01-18 19:55:18,454::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19087::DEBUG::2011-01-18 19:55:18,454::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19087::DEBUG::2011-01-18 19:55:18,455::resource::503::irs::Owner 9d36733b-5649-4cd1-81df-930a734ae633: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19087::DEBUG::2011-01-18 19:55:18,455::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19087::DEBUG::2011-01-18 19:55:18,455::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19087::DEBUG::2011-01-18 19:55:18,456::task::577::irs::Task 9d36733b-5649-4cd1-81df-930a734ae633: ref 0 aborting False Thread-19087::INFO::2011-01-18 19:55:18,456::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464868545532', 'lastCheck': 1295373310.909354, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0477781295776', 'lastCheck': 1295373310.9406381, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0486559867859', 'lastCheck': 1295373310.930522, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484569072723', 'lastCheck': 1295373310.9693339, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0474810600281', 'lastCheck': 1295373310.945358, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:55:19,113::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:19,648::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503777 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:55:20,908::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:55:20,909::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:55:20,930::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:55:20,931::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:55:20,940::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:55:20,941::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:55:20,945::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:55:20,946::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:55:20,949::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:55:20,968::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:55:20,969::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:55:20,973::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:55:20,983::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:55:20,988::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:55:21,011::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:21,662::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:22,196::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501424 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:24,209::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:24,746::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505591 seconds, 2.0 MB/s\n'; = 0 Thread-19092::INFO::2011-01-18 19:55:25,193::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19092::DEBUG::2011-01-18 19:55:25,193::task::577::irs::Task b37f230e-d656-4c42-ad63-02af99d60e06: moving from state init -> state preparing Thread-19092::DEBUG::2011-01-18 19:55:25,194::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19092::DEBUG::2011-01-18 19:55:25,225::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000467 seconds, 4.4 MB/s\n'; = 0 Thread-19092::DEBUG::2011-01-18 19:55:25,226::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000467 seconds, 4.4 MB/s'], size: 2048 Thread-19092::DEBUG::2011-01-18 19:55:25,226::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19092::DEBUG::2011-01-18 19:55:25,227::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19092::DEBUG::2011-01-18 19:55:25,228::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19092::DEBUG::2011-01-18 19:55:25,228::task::577::irs::Task b37f230e-d656-4c42-ad63-02af99d60e06: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19092::DEBUG::2011-01-18 19:55:25,228::task::577::irs::Task b37f230e-d656-4c42-ad63-02af99d60e06: moving from state preparing -> state finished Thread-19092::DEBUG::2011-01-18 19:55:25,229::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19092::DEBUG::2011-01-18 19:55:25,229::task::577::irs::Task b37f230e-d656-4c42-ad63-02af99d60e06: ref 0 aborting False Thread-19092::INFO::2011-01-18 19:55:25,229::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19093::INFO::2011-01-18 19:55:25,238::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19093::DEBUG::2011-01-18 19:55:25,238::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: moving from state init -> state preparing Thread-19093::DEBUG::2011-01-18 19:55:25,239::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8674a4dc-dec9-447a-81d5-da135458b1cf acquire shared (120000) Thread-19093::DEBUG::2011-01-18 19:55:25,239::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19093::DEBUG::2011-01-18 19:55:25,239::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8674a4dc-dec9-447a-81d5-da135458b1cf' Thread-19093::DEBUG::2011-01-18 19:55:25,240::resource::524::irs::Owner 8674a4dc-dec9-447a-81d5-da135458b1cf: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19093::DEBUG::2011-01-18 19:55:25,240::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19093::DEBUG::2011-01-18 19:55:25,240::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: ref 1 aborting False Thread-19093::INFO::2011-01-18 19:55:25,241::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19093::DEBUG::2011-01-18 19:55:25,241::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19093::DEBUG::2011-01-18 19:55:25,242::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: moving from state preparing -> state finished Thread-19093::DEBUG::2011-01-18 19:55:25,242::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19093::DEBUG::2011-01-18 19:55:25,242::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8674a4dc-dec9-447a-81d5-da135458b1cf releasing Thread-19093::DEBUG::2011-01-18 19:55:25,243::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19093::DEBUG::2011-01-18 19:55:25,243::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19093::DEBUG::2011-01-18 19:55:25,243::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19093::DEBUG::2011-01-18 19:55:25,243::resource::503::irs::Owner 8674a4dc-dec9-447a-81d5-da135458b1cf: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19093::DEBUG::2011-01-18 19:55:25,244::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19093::DEBUG::2011-01-18 19:55:25,244::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19093::DEBUG::2011-01-18 19:55:25,244::task::577::irs::Task 8674a4dc-dec9-447a-81d5-da135458b1cf: ref 0 aborting False Thread-19093::INFO::2011-01-18 19:55:25,245::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:55:26,760::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:27,302::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510132 seconds, 2.0 MB/s\n'; = 0 Thread-19095::INFO::2011-01-18 19:55:28,614::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19095::DEBUG::2011-01-18 19:55:28,614::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: moving from state init -> state preparing Thread-19095::DEBUG::2011-01-18 19:55:28,615::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 34498969-185a-437f-8fcd-0770ecdeca98 acquire shared (120000) Thread-19095::DEBUG::2011-01-18 19:55:28,615::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19095::DEBUG::2011-01-18 19:55:28,615::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '34498969-185a-437f-8fcd-0770ecdeca98' Thread-19095::DEBUG::2011-01-18 19:55:28,616::resource::524::irs::Owner 34498969-185a-437f-8fcd-0770ecdeca98: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19095::DEBUG::2011-01-18 19:55:28,616::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19095::DEBUG::2011-01-18 19:55:28,616::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: ref 1 aborting False Thread-19095::DEBUG::2011-01-18 19:55:28,617::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464220046997', 'lastCheck': 1295373320.9552641, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0471131801605', 'lastCheck': 1295373320.9919951, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476050376892', 'lastCheck': 1295373320.9874811, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0473108291626', 'lastCheck': 1295373321.0161829, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0496821403503', 'lastCheck': 1295373320.9795711, 'valid': True, 'code': 0}} Thread-19095::DEBUG::2011-01-18 19:55:28,617::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: moving from state preparing -> state finished Thread-19095::DEBUG::2011-01-18 19:55:28,617::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19095::DEBUG::2011-01-18 19:55:28,618::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 34498969-185a-437f-8fcd-0770ecdeca98 releasing Thread-19095::DEBUG::2011-01-18 19:55:28,618::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19095::DEBUG::2011-01-18 19:55:28,618::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19095::DEBUG::2011-01-18 19:55:28,618::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19095::DEBUG::2011-01-18 19:55:28,619::resource::503::irs::Owner 34498969-185a-437f-8fcd-0770ecdeca98: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19095::DEBUG::2011-01-18 19:55:28,619::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19095::DEBUG::2011-01-18 19:55:28,619::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19095::DEBUG::2011-01-18 19:55:28,620::task::577::irs::Task 34498969-185a-437f-8fcd-0770ecdeca98: ref 0 aborting False Thread-19095::INFO::2011-01-18 19:55:28,620::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464220046997', 'lastCheck': 1295373320.9552641, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476050376892', 'lastCheck': 1295373320.9874811, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0496821403503', 'lastCheck': 1295373320.9795711, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0473108291626', 'lastCheck': 1295373321.0161829, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0471131801605', 'lastCheck': 1295373320.9919951, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:55:29,316::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:29,852::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504133 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:55:30,954::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:55:30,955::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:55:30,979::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:55:30,980::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:55:30,987::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:55:30,988::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:55:30,992::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:55:30,993::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:55:30,996::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:55:31,015::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:55:31,016::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:55:31,023::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:55:31,029::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:55:31,036::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:55:31,057::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:31,867::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:32,399::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500305 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:34,414::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:34,949::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503028 seconds, 2.0 MB/s\n'; = 0 Thread-19100::INFO::2011-01-18 19:55:35,300::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19100::DEBUG::2011-01-18 19:55:35,300::task::577::irs::Task ba9f4d2b-0340-4d60-91b5-10e3ffb05b90: moving from state init -> state preparing Thread-19100::DEBUG::2011-01-18 19:55:35,301::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19100::DEBUG::2011-01-18 19:55:35,333::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000708 seconds, 2.9 MB/s\n'; = 0 Thread-19100::DEBUG::2011-01-18 19:55:35,333::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000708 seconds, 2.9 MB/s'], size: 2048 Thread-19100::DEBUG::2011-01-18 19:55:35,334::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19100::DEBUG::2011-01-18 19:55:35,334::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19100::DEBUG::2011-01-18 19:55:35,335::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19100::DEBUG::2011-01-18 19:55:35,335::task::577::irs::Task ba9f4d2b-0340-4d60-91b5-10e3ffb05b90: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19100::DEBUG::2011-01-18 19:55:35,335::task::577::irs::Task ba9f4d2b-0340-4d60-91b5-10e3ffb05b90: moving from state preparing -> state finished Thread-19100::DEBUG::2011-01-18 19:55:35,336::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19100::DEBUG::2011-01-18 19:55:35,336::task::577::irs::Task ba9f4d2b-0340-4d60-91b5-10e3ffb05b90: ref 0 aborting False Thread-19100::INFO::2011-01-18 19:55:35,336::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19101::INFO::2011-01-18 19:55:35,345::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19101::DEBUG::2011-01-18 19:55:35,345::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: moving from state init -> state preparing Thread-19101::DEBUG::2011-01-18 19:55:35,346::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fc6e5997-0bd0-4345-b322-fe342a4d1f2d acquire shared (120000) Thread-19101::DEBUG::2011-01-18 19:55:35,346::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19101::DEBUG::2011-01-18 19:55:35,346::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fc6e5997-0bd0-4345-b322-fe342a4d1f2d' Thread-19101::DEBUG::2011-01-18 19:55:35,347::resource::524::irs::Owner fc6e5997-0bd0-4345-b322-fe342a4d1f2d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19101::DEBUG::2011-01-18 19:55:35,347::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19101::DEBUG::2011-01-18 19:55:35,347::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: ref 1 aborting False Thread-19101::INFO::2011-01-18 19:55:35,348::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19101::DEBUG::2011-01-18 19:55:35,348::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19101::DEBUG::2011-01-18 19:55:35,349::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: moving from state preparing -> state finished Thread-19101::DEBUG::2011-01-18 19:55:35,349::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19101::DEBUG::2011-01-18 19:55:35,349::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fc6e5997-0bd0-4345-b322-fe342a4d1f2d releasing Thread-19101::DEBUG::2011-01-18 19:55:35,350::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19101::DEBUG::2011-01-18 19:55:35,350::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19101::DEBUG::2011-01-18 19:55:35,350::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19101::DEBUG::2011-01-18 19:55:35,350::resource::503::irs::Owner fc6e5997-0bd0-4345-b322-fe342a4d1f2d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19101::DEBUG::2011-01-18 19:55:35,351::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19101::DEBUG::2011-01-18 19:55:35,351::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19101::DEBUG::2011-01-18 19:55:35,351::task::577::irs::Task fc6e5997-0bd0-4345-b322-fe342a4d1f2d: ref 0 aborting False Thread-19101::INFO::2011-01-18 19:55:35,352::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:55:36,963::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:37,505::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509653 seconds, 2.0 MB/s\n'; = 0 Thread-19103::INFO::2011-01-18 19:55:38,777::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19103::DEBUG::2011-01-18 19:55:38,777::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: moving from state init -> state preparing Thread-19103::DEBUG::2011-01-18 19:55:38,778::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 942136ff-ff77-4baa-a6ba-670293ae2007 acquire shared (120000) Thread-19103::DEBUG::2011-01-18 19:55:38,778::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19103::DEBUG::2011-01-18 19:55:38,778::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '942136ff-ff77-4baa-a6ba-670293ae2007' Thread-19103::DEBUG::2011-01-18 19:55:38,778::resource::524::irs::Owner 942136ff-ff77-4baa-a6ba-670293ae2007: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19103::DEBUG::2011-01-18 19:55:38,779::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19103::DEBUG::2011-01-18 19:55:38,779::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: ref 1 aborting False Thread-19103::DEBUG::2011-01-18 19:55:38,779::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0466389656067', 'lastCheck': 1295373331.0014789, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0475959777832', 'lastCheck': 1295373331.039465, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476369857788', 'lastCheck': 1295373331.0346069, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0464298725128', 'lastCheck': 1295373331.0622859, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0498960018158', 'lastCheck': 1295373331.0288889, 'valid': True, 'code': 0}} Thread-19103::DEBUG::2011-01-18 19:55:38,780::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: moving from state preparing -> state finished Thread-19103::DEBUG::2011-01-18 19:55:38,780::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19103::DEBUG::2011-01-18 19:55:38,780::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 942136ff-ff77-4baa-a6ba-670293ae2007 releasing Thread-19103::DEBUG::2011-01-18 19:55:38,781::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19103::DEBUG::2011-01-18 19:55:38,781::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19103::DEBUG::2011-01-18 19:55:38,781::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19103::DEBUG::2011-01-18 19:55:38,782::resource::503::irs::Owner 942136ff-ff77-4baa-a6ba-670293ae2007: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19103::DEBUG::2011-01-18 19:55:38,782::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19103::DEBUG::2011-01-18 19:55:38,782::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19103::DEBUG::2011-01-18 19:55:38,783::task::577::irs::Task 942136ff-ff77-4baa-a6ba-670293ae2007: ref 0 aborting False Thread-19103::INFO::2011-01-18 19:55:38,783::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0466389656067', 'lastCheck': 1295373331.0014789, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476369857788', 'lastCheck': 1295373331.0346069, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0498960018158', 'lastCheck': 1295373331.0288889, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0464298725128', 'lastCheck': 1295373331.0622859, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0475959777832', 'lastCheck': 1295373331.039465, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:55:39,517::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:40,054::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504691 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:55:41,000::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:55:41,001::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:55:41,029::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:55:41,030::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:55:41,034::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:55:41,035::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:55:41,039::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:55:41,040::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:55:41,042::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:55:41,061::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:55:41,062::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:55:41,071::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:55:41,077::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:55:41,082::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:55:41,105::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:42,067::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:42,598::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.499929 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:44,613::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:45,147::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502511 seconds, 2.0 MB/s\n'; = 0 Thread-19108::INFO::2011-01-18 19:55:45,418::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19108::DEBUG::2011-01-18 19:55:45,418::task::577::irs::Task 567167d7-0ccd-4139-adbe-cc8e93a2b245: moving from state init -> state preparing Thread-19108::DEBUG::2011-01-18 19:55:45,419::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19108::DEBUG::2011-01-18 19:55:45,450::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000589 seconds, 3.5 MB/s\n'; = 0 Thread-19108::DEBUG::2011-01-18 19:55:45,451::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000589 seconds, 3.5 MB/s'], size: 2048 Thread-19108::DEBUG::2011-01-18 19:55:45,451::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19108::DEBUG::2011-01-18 19:55:45,451::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19108::DEBUG::2011-01-18 19:55:45,452::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19108::DEBUG::2011-01-18 19:55:45,452::task::577::irs::Task 567167d7-0ccd-4139-adbe-cc8e93a2b245: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19108::DEBUG::2011-01-18 19:55:45,453::task::577::irs::Task 567167d7-0ccd-4139-adbe-cc8e93a2b245: moving from state preparing -> state finished Thread-19108::DEBUG::2011-01-18 19:55:45,453::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19108::DEBUG::2011-01-18 19:55:45,453::task::577::irs::Task 567167d7-0ccd-4139-adbe-cc8e93a2b245: ref 0 aborting False Thread-19108::INFO::2011-01-18 19:55:45,454::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19109::INFO::2011-01-18 19:55:45,462::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19109::DEBUG::2011-01-18 19:55:45,462::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: moving from state init -> state preparing Thread-19109::DEBUG::2011-01-18 19:55:45,462::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 75f6af70-1dff-4e9a-af7e-c89534ebb7b1 acquire shared (120000) Thread-19109::DEBUG::2011-01-18 19:55:45,463::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19109::DEBUG::2011-01-18 19:55:45,463::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '75f6af70-1dff-4e9a-af7e-c89534ebb7b1' Thread-19109::DEBUG::2011-01-18 19:55:45,463::resource::524::irs::Owner 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19109::DEBUG::2011-01-18 19:55:45,463::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19109::DEBUG::2011-01-18 19:55:45,464::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: ref 1 aborting False Thread-19109::INFO::2011-01-18 19:55:45,464::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19109::DEBUG::2011-01-18 19:55:45,465::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19109::DEBUG::2011-01-18 19:55:45,465::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: moving from state preparing -> state finished Thread-19109::DEBUG::2011-01-18 19:55:45,465::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19109::DEBUG::2011-01-18 19:55:45,466::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 75f6af70-1dff-4e9a-af7e-c89534ebb7b1 releasing Thread-19109::DEBUG::2011-01-18 19:55:45,466::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19109::DEBUG::2011-01-18 19:55:45,466::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19109::DEBUG::2011-01-18 19:55:45,467::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19109::DEBUG::2011-01-18 19:55:45,467::resource::503::irs::Owner 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19109::DEBUG::2011-01-18 19:55:45,467::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19109::DEBUG::2011-01-18 19:55:45,467::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19109::DEBUG::2011-01-18 19:55:45,468::task::577::irs::Task 75f6af70-1dff-4e9a-af7e-c89534ebb7b1: ref 0 aborting False Thread-19109::INFO::2011-01-18 19:55:45,468::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:55:47,160::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:47,701::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509618 seconds, 2.0 MB/s\n'; = 0 Thread-19111::INFO::2011-01-18 19:55:48,939::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19111::DEBUG::2011-01-18 19:55:48,939::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: moving from state init -> state preparing Thread-19111::DEBUG::2011-01-18 19:55:48,940::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 544758ef-97d7-436f-9c82-f9e51e2fb775 acquire shared (120000) Thread-19111::DEBUG::2011-01-18 19:55:48,940::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19111::DEBUG::2011-01-18 19:55:48,940::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '544758ef-97d7-436f-9c82-f9e51e2fb775' Thread-19111::DEBUG::2011-01-18 19:55:48,940::resource::524::irs::Owner 544758ef-97d7-436f-9c82-f9e51e2fb775: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19111::DEBUG::2011-01-18 19:55:48,941::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19111::DEBUG::2011-01-18 19:55:48,941::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: ref 1 aborting False Thread-19111::DEBUG::2011-01-18 19:55:48,941::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.046774148941', 'lastCheck': 1295373341.0476151, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0472300052643', 'lastCheck': 1295373341.086108, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0483770370483', 'lastCheck': 1295373341.082303, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487420558929', 'lastCheck': 1295373341.1106031, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.047089099884', 'lastCheck': 1295373341.075948, 'valid': True, 'code': 0}} Thread-19111::DEBUG::2011-01-18 19:55:48,942::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: moving from state preparing -> state finished Thread-19111::DEBUG::2011-01-18 19:55:48,942::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19111::DEBUG::2011-01-18 19:55:48,942::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 544758ef-97d7-436f-9c82-f9e51e2fb775 releasing Thread-19111::DEBUG::2011-01-18 19:55:48,943::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19111::DEBUG::2011-01-18 19:55:48,943::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19111::DEBUG::2011-01-18 19:55:48,943::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19111::DEBUG::2011-01-18 19:55:48,943::resource::503::irs::Owner 544758ef-97d7-436f-9c82-f9e51e2fb775: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19111::DEBUG::2011-01-18 19:55:48,944::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19111::DEBUG::2011-01-18 19:55:48,944::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19111::DEBUG::2011-01-18 19:55:48,944::task::577::irs::Task 544758ef-97d7-436f-9c82-f9e51e2fb775: ref 0 aborting False Thread-19111::INFO::2011-01-18 19:55:48,945::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.046774148941', 'lastCheck': 1295373341.0476151, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0483770370483', 'lastCheck': 1295373341.082303, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.047089099884', 'lastCheck': 1295373341.075948, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487420558929', 'lastCheck': 1295373341.1106031, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0472300052643', 'lastCheck': 1295373341.086108, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:55:49,714::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:50,249::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503341 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:55:51,046::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:55:51,047::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:55:51,076::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:55:51,077::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:55:51,082::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:55:51,083::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:55:51,086::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:55:51,087::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:55:51,088::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:55:51,110::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:55:51,111::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:55:51,119::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:55:51,124::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:55:51,133::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:55:51,154::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:52,262::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:52,793::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500049 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:55:54,806::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:55,342::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504869 seconds, 2.0 MB/s\n'; = 0 Thread-19116::INFO::2011-01-18 19:55:55,530::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19116::DEBUG::2011-01-18 19:55:55,530::task::577::irs::Task 39d4ac91-d0c9-45a9-b63f-124c411d3662: moving from state init -> state preparing Thread-19116::DEBUG::2011-01-18 19:55:55,530::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19116::DEBUG::2011-01-18 19:55:55,562::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000425 seconds, 4.8 MB/s\n'; = 0 Thread-19116::DEBUG::2011-01-18 19:55:55,563::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000425 seconds, 4.8 MB/s'], size: 2048 Thread-19116::DEBUG::2011-01-18 19:55:55,563::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19116::DEBUG::2011-01-18 19:55:55,563::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19116::DEBUG::2011-01-18 19:55:55,564::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19116::DEBUG::2011-01-18 19:55:55,564::task::577::irs::Task 39d4ac91-d0c9-45a9-b63f-124c411d3662: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19116::DEBUG::2011-01-18 19:55:55,565::task::577::irs::Task 39d4ac91-d0c9-45a9-b63f-124c411d3662: moving from state preparing -> state finished Thread-19116::DEBUG::2011-01-18 19:55:55,565::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19116::DEBUG::2011-01-18 19:55:55,565::task::577::irs::Task 39d4ac91-d0c9-45a9-b63f-124c411d3662: ref 0 aborting False Thread-19116::INFO::2011-01-18 19:55:55,566::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19117::INFO::2011-01-18 19:55:55,575::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19117::DEBUG::2011-01-18 19:55:55,575::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: moving from state init -> state preparing Thread-19117::DEBUG::2011-01-18 19:55:55,576::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9c01a97b-50d5-4130-a83c-3e82f9c558e1 acquire shared (120000) Thread-19117::DEBUG::2011-01-18 19:55:55,576::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19117::DEBUG::2011-01-18 19:55:55,576::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9c01a97b-50d5-4130-a83c-3e82f9c558e1' Thread-19117::DEBUG::2011-01-18 19:55:55,577::resource::524::irs::Owner 9c01a97b-50d5-4130-a83c-3e82f9c558e1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19117::DEBUG::2011-01-18 19:55:55,577::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19117::DEBUG::2011-01-18 19:55:55,577::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: ref 1 aborting False Thread-19117::INFO::2011-01-18 19:55:55,578::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19117::DEBUG::2011-01-18 19:55:55,578::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19117::DEBUG::2011-01-18 19:55:55,579::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: moving from state preparing -> state finished Thread-19117::DEBUG::2011-01-18 19:55:55,579::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19117::DEBUG::2011-01-18 19:55:55,579::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9c01a97b-50d5-4130-a83c-3e82f9c558e1 releasing Thread-19117::DEBUG::2011-01-18 19:55:55,580::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19117::DEBUG::2011-01-18 19:55:55,580::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19117::DEBUG::2011-01-18 19:55:55,580::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19117::DEBUG::2011-01-18 19:55:55,581::resource::503::irs::Owner 9c01a97b-50d5-4130-a83c-3e82f9c558e1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19117::DEBUG::2011-01-18 19:55:55,581::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19117::DEBUG::2011-01-18 19:55:55,581::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19117::DEBUG::2011-01-18 19:55:55,581::task::577::irs::Task 9c01a97b-50d5-4130-a83c-3e82f9c558e1: ref 0 aborting False Thread-19117::INFO::2011-01-18 19:55:55,582::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:55:57,355::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:55:57,897::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510542 seconds, 2.0 MB/s\n'; = 0 Thread-19119::INFO::2011-01-18 19:55:59,122::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19119::DEBUG::2011-01-18 19:55:59,123::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: moving from state init -> state preparing Thread-19119::DEBUG::2011-01-18 19:55:59,123::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8fb144c9-648a-48f1-8120-ee02e427a1d8 acquire shared (120000) Thread-19119::DEBUG::2011-01-18 19:55:59,123::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19119::DEBUG::2011-01-18 19:55:59,124::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8fb144c9-648a-48f1-8120-ee02e427a1d8' Thread-19119::DEBUG::2011-01-18 19:55:59,124::resource::524::irs::Owner 8fb144c9-648a-48f1-8120-ee02e427a1d8: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19119::DEBUG::2011-01-18 19:55:59,124::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19119::DEBUG::2011-01-18 19:55:59,124::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: ref 1 aborting False Thread-19119::DEBUG::2011-01-18 19:55:59,125::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0491170883179', 'lastCheck': 1295373351.095958, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0509610176086', 'lastCheck': 1295373351.137043, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049008846283', 'lastCheck': 1295373351.1308949, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0495929718018', 'lastCheck': 1295373351.159472, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0471820831299', 'lastCheck': 1295373351.1231511, 'valid': True, 'code': 0}} Thread-19119::DEBUG::2011-01-18 19:55:59,125::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: moving from state preparing -> state finished Thread-19119::DEBUG::2011-01-18 19:55:59,125::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19119::DEBUG::2011-01-18 19:55:59,126::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8fb144c9-648a-48f1-8120-ee02e427a1d8 releasing Thread-19119::DEBUG::2011-01-18 19:55:59,126::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19119::DEBUG::2011-01-18 19:55:59,126::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19119::DEBUG::2011-01-18 19:55:59,127::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19119::DEBUG::2011-01-18 19:55:59,127::resource::503::irs::Owner 8fb144c9-648a-48f1-8120-ee02e427a1d8: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19119::DEBUG::2011-01-18 19:55:59,127::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19119::DEBUG::2011-01-18 19:55:59,127::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19119::DEBUG::2011-01-18 19:55:59,128::task::577::irs::Task 8fb144c9-648a-48f1-8120-ee02e427a1d8: ref 0 aborting False Thread-19119::INFO::2011-01-18 19:55:59,128::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0491170883179', 'lastCheck': 1295373351.095958, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049008846283', 'lastCheck': 1295373351.1308949, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0471820831299', 'lastCheck': 1295373351.1231511, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0495929718018', 'lastCheck': 1295373351.159472, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0509610176086', 'lastCheck': 1295373351.137043, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:55:59,910::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:00,445::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502949 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:56:01,095::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:56:01,096::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:56:01,123::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:56:01,124::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:56:01,131::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:56:01,132::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:56:01,136::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:56:01,137::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:56:01,137::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:56:01,159::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:56:01,160::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:56:01,165::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:56:01,174::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:56:01,181::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:56:01,200::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:02,457::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:02,990::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501117 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:05,003::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:05,539::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504381 seconds, 2.0 MB/s\n'; = 0 Thread-19124::INFO::2011-01-18 19:56:05,635::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19124::DEBUG::2011-01-18 19:56:05,635::task::577::irs::Task 86da97ec-c686-4053-b45a-ffb8f179a66d: moving from state init -> state preparing Thread-19124::DEBUG::2011-01-18 19:56:05,636::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19124::DEBUG::2011-01-18 19:56:05,667::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000408 seconds, 5.0 MB/s\n'; = 0 Thread-19124::DEBUG::2011-01-18 19:56:05,668::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000408 seconds, 5.0 MB/s'], size: 2048 Thread-19124::DEBUG::2011-01-18 19:56:05,668::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19124::DEBUG::2011-01-18 19:56:05,669::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19124::DEBUG::2011-01-18 19:56:05,669::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19124::DEBUG::2011-01-18 19:56:05,669::task::577::irs::Task 86da97ec-c686-4053-b45a-ffb8f179a66d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19124::DEBUG::2011-01-18 19:56:05,670::task::577::irs::Task 86da97ec-c686-4053-b45a-ffb8f179a66d: moving from state preparing -> state finished Thread-19124::DEBUG::2011-01-18 19:56:05,670::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19124::DEBUG::2011-01-18 19:56:05,670::task::577::irs::Task 86da97ec-c686-4053-b45a-ffb8f179a66d: ref 0 aborting False Thread-19124::INFO::2011-01-18 19:56:05,671::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19125::INFO::2011-01-18 19:56:05,679::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19125::DEBUG::2011-01-18 19:56:05,679::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: moving from state init -> state preparing Thread-19125::DEBUG::2011-01-18 19:56:05,679::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 267dd6b8-1b10-4612-bfe7-caa092019592 acquire shared (120000) Thread-19125::DEBUG::2011-01-18 19:56:05,680::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19125::DEBUG::2011-01-18 19:56:05,680::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '267dd6b8-1b10-4612-bfe7-caa092019592' Thread-19125::DEBUG::2011-01-18 19:56:05,680::resource::524::irs::Owner 267dd6b8-1b10-4612-bfe7-caa092019592: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19125::DEBUG::2011-01-18 19:56:05,681::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19125::DEBUG::2011-01-18 19:56:05,681::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: ref 1 aborting False Thread-19125::INFO::2011-01-18 19:56:05,681::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19125::DEBUG::2011-01-18 19:56:05,682::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19125::DEBUG::2011-01-18 19:56:05,683::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: moving from state preparing -> state finished Thread-19125::DEBUG::2011-01-18 19:56:05,683::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19125::DEBUG::2011-01-18 19:56:05,683::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 267dd6b8-1b10-4612-bfe7-caa092019592 releasing Thread-19125::DEBUG::2011-01-18 19:56:05,683::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19125::DEBUG::2011-01-18 19:56:05,684::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19125::DEBUG::2011-01-18 19:56:05,684::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19125::DEBUG::2011-01-18 19:56:05,684::resource::503::irs::Owner 267dd6b8-1b10-4612-bfe7-caa092019592: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19125::DEBUG::2011-01-18 19:56:05,684::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19125::DEBUG::2011-01-18 19:56:05,685::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19125::DEBUG::2011-01-18 19:56:05,685::task::577::irs::Task 267dd6b8-1b10-4612-bfe7-caa092019592: ref 0 aborting False Thread-19125::INFO::2011-01-18 19:56:05,685::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:56:07,553::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:08,095::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510245 seconds, 2.0 MB/s\n'; = 0 Thread-19127::INFO::2011-01-18 19:56:09,300::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19127::DEBUG::2011-01-18 19:56:09,300::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: moving from state init -> state preparing Thread-19127::DEBUG::2011-01-18 19:56:09,300::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6fd0292a-1eeb-4981-93bb-931c98570555 acquire shared (120000) Thread-19127::DEBUG::2011-01-18 19:56:09,301::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19127::DEBUG::2011-01-18 19:56:09,301::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6fd0292a-1eeb-4981-93bb-931c98570555' Thread-19127::DEBUG::2011-01-18 19:56:09,301::resource::524::irs::Owner 6fd0292a-1eeb-4981-93bb-931c98570555: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19127::DEBUG::2011-01-18 19:56:09,301::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19127::DEBUG::2011-01-18 19:56:09,302::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: ref 1 aborting False Thread-19127::DEBUG::2011-01-18 19:56:09,302::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0484471321106', 'lastCheck': 1295373361.1442871, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0485460758209', 'lastCheck': 1295373361.185425, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0480010509491', 'lastCheck': 1295373361.1788731, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0458059310913', 'lastCheck': 1295373361.20469, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463840961456', 'lastCheck': 1295373361.1692441, 'valid': True, 'code': 0}} Thread-19127::DEBUG::2011-01-18 19:56:09,303::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: moving from state preparing -> state finished Thread-19127::DEBUG::2011-01-18 19:56:09,303::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19127::DEBUG::2011-01-18 19:56:09,303::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6fd0292a-1eeb-4981-93bb-931c98570555 releasing Thread-19127::DEBUG::2011-01-18 19:56:09,303::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19127::DEBUG::2011-01-18 19:56:09,304::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19127::DEBUG::2011-01-18 19:56:09,304::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19127::DEBUG::2011-01-18 19:56:09,304::resource::503::irs::Owner 6fd0292a-1eeb-4981-93bb-931c98570555: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19127::DEBUG::2011-01-18 19:56:09,304::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19127::DEBUG::2011-01-18 19:56:09,305::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19127::DEBUG::2011-01-18 19:56:09,305::task::577::irs::Task 6fd0292a-1eeb-4981-93bb-931c98570555: ref 0 aborting False Thread-19127::INFO::2011-01-18 19:56:09,305::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0484471321106', 'lastCheck': 1295373361.1442871, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0480010509491', 'lastCheck': 1295373361.1788731, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463840961456', 'lastCheck': 1295373361.1692441, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0458059310913', 'lastCheck': 1295373361.20469, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0485460758209', 'lastCheck': 1295373361.185425, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:56:10,108::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:10,641::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502012 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:56:11,143::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:56:11,144::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:56:11,169::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:56:11,170::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:56:11,179::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:56:11,180::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:56:11,184::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:56:11,185::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:56:11,186::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:56:11,187::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata count=1' (cwd None) Thread-18496::INFO::2011-01-18 19:56:11,204::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:56:11,206::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:56:11,214::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:56:11,224::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:56:11,225::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000505 seconds, 4.1 MB/s\n'; = 0 Thread-18493::DEBUG::2011-01-18 19:56:11,225::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000505 seconds, 4.1 MB/s'], size: 2048 Thread-18493::DEBUG::2011-01-18 19:56:11,226::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_3', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE18,uuid:Qgf46A-WY12-2WRV-PrRt-wlBf-dG5l-Y0CiR2,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE19,uuid:I9Af7U-Xs1p-25wD-eipC-Fidg-XxVv-g51Ql4,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE16,uuid:Nvl4M2-De3J-JsKJ-JkBe-GZ6s-AjKD-lcInZA,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE17,uuid:bLZC8w-2nd6-mSQL-l7bf-qTMV-V0zG-2AjV5E,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE23,uuid:6a4K6m-i3eH-fMq3-o87l-7Vrd-u85A-gukoFD,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE22,uuid:Bq8FkT-8D7Z-QeDV-eZzx-RGR3-UzBm-xdyAgL,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE21,uuid:Vnwbgp-85vv-DFdc-LxUu-kPBu-pkQ3-jsIHqv,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE20,uuid:WqzA8s-xBVm-fjUO-1mxU-s8GQ-BTji-sWHK8S,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=u7udFg-03KL-F8eg-BQhY-TAJA-bV0h-ylO1p8', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=8fd1c0112168759eac1d4afe75228b2ee79efc2f'] Thread-18493::DEBUG::2011-01-18 19:56:11,226::metadata::89::irs::metadata.__validate() __cksum(md) = 8fd1c0112168759eac1d4afe75228b2ee79efc2f Thread-18494::DEBUG::2011-01-18 19:56:11,227::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:56:11,248::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:12,654::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:13,186::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500596 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:15,199::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:15,733::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502207 seconds, 2.0 MB/s\n'; = 0 Thread-19131::INFO::2011-01-18 19:56:15,747::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19131::DEBUG::2011-01-18 19:56:15,748::task::577::irs::Task 87f9fd42-7166-4922-81c3-3db414c160e0: moving from state init -> state preparing Thread-19131::DEBUG::2011-01-18 19:56:15,748::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19131::DEBUG::2011-01-18 19:56:15,780::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0005 seconds, 4.1 MB/s\n'; = 0 Thread-19131::DEBUG::2011-01-18 19:56:15,780::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0005 seconds, 4.1 MB/s'], size: 2048 Thread-19131::DEBUG::2011-01-18 19:56:15,780::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19131::DEBUG::2011-01-18 19:56:15,781::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19131::DEBUG::2011-01-18 19:56:15,781::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19131::DEBUG::2011-01-18 19:56:15,782::task::577::irs::Task 87f9fd42-7166-4922-81c3-3db414c160e0: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19131::DEBUG::2011-01-18 19:56:15,782::task::577::irs::Task 87f9fd42-7166-4922-81c3-3db414c160e0: moving from state preparing -> state finished Thread-19131::DEBUG::2011-01-18 19:56:15,782::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19131::DEBUG::2011-01-18 19:56:15,783::task::577::irs::Task 87f9fd42-7166-4922-81c3-3db414c160e0: ref 0 aborting False Thread-19131::INFO::2011-01-18 19:56:15,783::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19132::INFO::2011-01-18 19:56:15,791::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19132::DEBUG::2011-01-18 19:56:15,791::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: moving from state init -> state preparing Thread-19132::DEBUG::2011-01-18 19:56:15,792::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ce8446df-0f8e-4ff8-b35c-87b8b3a77495 acquire shared (120000) Thread-19132::DEBUG::2011-01-18 19:56:15,792::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19132::DEBUG::2011-01-18 19:56:15,792::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ce8446df-0f8e-4ff8-b35c-87b8b3a77495' Thread-19132::DEBUG::2011-01-18 19:56:15,793::resource::524::irs::Owner ce8446df-0f8e-4ff8-b35c-87b8b3a77495: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19132::DEBUG::2011-01-18 19:56:15,793::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19132::DEBUG::2011-01-18 19:56:15,793::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: ref 1 aborting False Thread-19132::INFO::2011-01-18 19:56:15,794::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19132::DEBUG::2011-01-18 19:56:15,794::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19132::DEBUG::2011-01-18 19:56:15,795::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: moving from state preparing -> state finished Thread-19132::DEBUG::2011-01-18 19:56:15,795::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19132::DEBUG::2011-01-18 19:56:15,795::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ce8446df-0f8e-4ff8-b35c-87b8b3a77495 releasing Thread-19132::DEBUG::2011-01-18 19:56:15,796::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19132::DEBUG::2011-01-18 19:56:15,796::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19132::DEBUG::2011-01-18 19:56:15,796::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19132::DEBUG::2011-01-18 19:56:15,797::resource::503::irs::Owner ce8446df-0f8e-4ff8-b35c-87b8b3a77495: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19132::DEBUG::2011-01-18 19:56:15,797::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19132::DEBUG::2011-01-18 19:56:15,797::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19132::DEBUG::2011-01-18 19:56:15,797::task::577::irs::Task ce8446df-0f8e-4ff8-b35c-87b8b3a77495: ref 0 aborting False Thread-19132::INFO::2011-01-18 19:56:15,798::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:56:17,746::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:18,288::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510921 seconds, 2.0 MB/s\n'; = 0 Thread-19135::INFO::2011-01-18 19:56:20,162::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19135::DEBUG::2011-01-18 19:56:20,162::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: moving from state init -> state preparing Thread-19135::DEBUG::2011-01-18 19:56:20,163::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3 acquire shared (120000) Thread-19135::DEBUG::2011-01-18 19:56:20,163::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19135::DEBUG::2011-01-18 19:56:20,163::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1a22b8ad-c6ba-4dba-b246-fa91c3e049d3' Thread-19135::DEBUG::2011-01-18 19:56:20,163::resource::524::irs::Owner 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19135::DEBUG::2011-01-18 19:56:20,164::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19135::DEBUG::2011-01-18 19:56:20,164::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: ref 1 aborting False Thread-19135::DEBUG::2011-01-18 19:56:20,164::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.087249994278', 'lastCheck': 1295373371.231108, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0486400127411', 'lastCheck': 1295373371.2335761, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0528061389923', 'lastCheck': 1295373371.2316771, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0486788749695', 'lastCheck': 1295373371.25261, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0515620708466', 'lastCheck': 1295373371.220459, 'valid': True, 'code': 0}} Thread-19135::DEBUG::2011-01-18 19:56:20,165::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: moving from state preparing -> state finished Thread-19135::DEBUG::2011-01-18 19:56:20,165::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19135::DEBUG::2011-01-18 19:56:20,165::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3 releasing Thread-19135::DEBUG::2011-01-18 19:56:20,165::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19135::DEBUG::2011-01-18 19:56:20,166::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19135::DEBUG::2011-01-18 19:56:20,166::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19135::DEBUG::2011-01-18 19:56:20,166::resource::503::irs::Owner 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19135::DEBUG::2011-01-18 19:56:20,167::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19135::DEBUG::2011-01-18 19:56:20,167::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19135::DEBUG::2011-01-18 19:56:20,167::task::577::irs::Task 1a22b8ad-c6ba-4dba-b246-fa91c3e049d3: ref 0 aborting False Thread-19135::INFO::2011-01-18 19:56:20,167::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.087249994278', 'lastCheck': 1295373371.231108, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0528061389923', 'lastCheck': 1295373371.2316771, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0515620708466', 'lastCheck': 1295373371.220459, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0486788749695', 'lastCheck': 1295373371.25261, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0486400127411', 'lastCheck': 1295373371.2335761, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:56:20,300::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:20,836::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503996 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:56:21,219::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:56:21,220::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:56:21,231::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::INFO::2011-01-18 19:56:21,231::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::DEBUG::2011-01-18 19:56:21,232::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:56:21,233::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 19:56:21,233::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:56:21,234::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:56:21,252::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:56:21,253::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:56:21,260::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:56:21,277::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:56:21,278::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:56:21,279::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:56:21,294::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:22,849::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:23,382::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500275 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:25,394::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19139::INFO::2011-01-18 19:56:25,851::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19139::DEBUG::2011-01-18 19:56:25,851::task::577::irs::Task ecfef383-2a21-4d33-ab0c-b64d6ffb972a: moving from state init -> state preparing Thread-19139::DEBUG::2011-01-18 19:56:25,852::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19139::DEBUG::2011-01-18 19:56:25,885::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000469 seconds, 4.4 MB/s\n'; = 0 Thread-19139::DEBUG::2011-01-18 19:56:25,885::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000469 seconds, 4.4 MB/s'], size: 2048 Thread-19139::DEBUG::2011-01-18 19:56:25,886::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19139::DEBUG::2011-01-18 19:56:25,886::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19139::DEBUG::2011-01-18 19:56:25,887::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19139::DEBUG::2011-01-18 19:56:25,887::task::577::irs::Task ecfef383-2a21-4d33-ab0c-b64d6ffb972a: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19139::DEBUG::2011-01-18 19:56:25,888::task::577::irs::Task ecfef383-2a21-4d33-ab0c-b64d6ffb972a: moving from state preparing -> state finished Thread-19139::DEBUG::2011-01-18 19:56:25,888::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19139::DEBUG::2011-01-18 19:56:25,889::task::577::irs::Task ecfef383-2a21-4d33-ab0c-b64d6ffb972a: ref 0 aborting False Thread-19139::INFO::2011-01-18 19:56:25,889::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19140::INFO::2011-01-18 19:56:25,897::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19140::DEBUG::2011-01-18 19:56:25,898::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: moving from state init -> state preparing Thread-19140::DEBUG::2011-01-18 19:56:25,898::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c4dc427d-6a0d-48d5-af68-045be1b8a1e4 acquire shared (120000) Thread-19140::DEBUG::2011-01-18 19:56:25,898::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19140::DEBUG::2011-01-18 19:56:25,899::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c4dc427d-6a0d-48d5-af68-045be1b8a1e4' Thread-19140::DEBUG::2011-01-18 19:56:25,899::resource::524::irs::Owner c4dc427d-6a0d-48d5-af68-045be1b8a1e4: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19140::DEBUG::2011-01-18 19:56:25,899::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19140::DEBUG::2011-01-18 19:56:25,900::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: ref 1 aborting False Thread-19140::INFO::2011-01-18 19:56:25,900::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19140::DEBUG::2011-01-18 19:56:25,901::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19140::DEBUG::2011-01-18 19:56:25,902::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: moving from state preparing -> state finished Thread-19140::DEBUG::2011-01-18 19:56:25,902::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19140::DEBUG::2011-01-18 19:56:25,902::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c4dc427d-6a0d-48d5-af68-045be1b8a1e4 releasing Thread-19140::DEBUG::2011-01-18 19:56:25,903::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19140::DEBUG::2011-01-18 19:56:25,903::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19140::DEBUG::2011-01-18 19:56:25,903::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19140::DEBUG::2011-01-18 19:56:25,903::resource::503::irs::Owner c4dc427d-6a0d-48d5-af68-045be1b8a1e4: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19140::DEBUG::2011-01-18 19:56:25,904::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19140::DEBUG::2011-01-18 19:56:25,904::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19140::DEBUG::2011-01-18 19:56:25,904::task::577::irs::Task c4dc427d-6a0d-48d5-af68-045be1b8a1e4: ref 0 aborting False Thread-19140::INFO::2011-01-18 19:56:25,905::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:56:25,928::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502498 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:27,941::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:28,474::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50058 seconds, 2.0 MB/s\n'; = 0 Thread-19143::INFO::2011-01-18 19:56:30,326::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19143::DEBUG::2011-01-18 19:56:30,327::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: moving from state init -> state preparing Thread-19143::DEBUG::2011-01-18 19:56:30,327::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e2bf6e2c-469c-45b1-8463-cbf948c7a7fa acquire shared (120000) Thread-19143::DEBUG::2011-01-18 19:56:30,327::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19143::DEBUG::2011-01-18 19:56:30,328::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e2bf6e2c-469c-45b1-8463-cbf948c7a7fa' Thread-19143::DEBUG::2011-01-18 19:56:30,328::resource::524::irs::Owner e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19143::DEBUG::2011-01-18 19:56:30,328::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19143::DEBUG::2011-01-18 19:56:30,328::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: ref 1 aborting False Thread-19143::DEBUG::2011-01-18 19:56:30,329::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0517859458923', 'lastCheck': 1295373381.2826619, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.051234960556', 'lastCheck': 1295373381.2841389, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0519499778748', 'lastCheck': 1295373381.28353, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0470941066742', 'lastCheck': 1295373381.299, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0456838607788', 'lastCheck': 1295373381.2655439, 'valid': True, 'code': 0}} Thread-19143::DEBUG::2011-01-18 19:56:30,329::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: moving from state preparing -> state finished Thread-19143::DEBUG::2011-01-18 19:56:30,329::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19143::DEBUG::2011-01-18 19:56:30,330::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e2bf6e2c-469c-45b1-8463-cbf948c7a7fa releasing Thread-19143::DEBUG::2011-01-18 19:56:30,330::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19143::DEBUG::2011-01-18 19:56:30,330::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19143::DEBUG::2011-01-18 19:56:30,331::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19143::DEBUG::2011-01-18 19:56:30,331::resource::503::irs::Owner e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19143::DEBUG::2011-01-18 19:56:30,331::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19143::DEBUG::2011-01-18 19:56:30,331::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19143::DEBUG::2011-01-18 19:56:30,332::task::577::irs::Task e2bf6e2c-469c-45b1-8463-cbf948c7a7fa: ref 0 aborting False Thread-19143::INFO::2011-01-18 19:56:30,332::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0517859458923', 'lastCheck': 1295373381.2826619, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0519499778748', 'lastCheck': 1295373381.28353, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0456838607788', 'lastCheck': 1295373381.2655439, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0470941066742', 'lastCheck': 1295373381.299, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.051234960556', 'lastCheck': 1295373381.2841389, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:56:30,486::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:31,033::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51415 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:56:31,264::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:56:31,265::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:56:31,282::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:56:31,283::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:56:31,283::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 19:56:31,283::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 19:56:31,284::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:56:31,285::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:56:31,299::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:56:31,301::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:56:31,306::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:56:31,328::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:56:31,329::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:56:31,329::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:56:31,344::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:33,047::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:33,579::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500536 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:35,593::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19147::INFO::2011-01-18 19:56:35,957::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19147::DEBUG::2011-01-18 19:56:35,958::task::577::irs::Task 31f280b8-6bcb-46bf-8aa4-d79cf33c5b33: moving from state init -> state preparing Thread-19147::DEBUG::2011-01-18 19:56:35,959::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19147::DEBUG::2011-01-18 19:56:35,994::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000477 seconds, 4.3 MB/s\n'; = 0 Thread-19147::DEBUG::2011-01-18 19:56:35,994::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000477 seconds, 4.3 MB/s'], size: 2048 Thread-19147::DEBUG::2011-01-18 19:56:35,995::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19147::DEBUG::2011-01-18 19:56:35,995::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19147::DEBUG::2011-01-18 19:56:35,996::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19147::DEBUG::2011-01-18 19:56:35,996::task::577::irs::Task 31f280b8-6bcb-46bf-8aa4-d79cf33c5b33: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19147::DEBUG::2011-01-18 19:56:35,997::task::577::irs::Task 31f280b8-6bcb-46bf-8aa4-d79cf33c5b33: moving from state preparing -> state finished Thread-19147::DEBUG::2011-01-18 19:56:35,997::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19147::DEBUG::2011-01-18 19:56:35,997::task::577::irs::Task 31f280b8-6bcb-46bf-8aa4-d79cf33c5b33: ref 0 aborting False Thread-19147::INFO::2011-01-18 19:56:35,998::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19148::INFO::2011-01-18 19:56:36,006::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19148::DEBUG::2011-01-18 19:56:36,006::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: moving from state init -> state preparing Thread-19148::DEBUG::2011-01-18 19:56:36,007::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2ac70a8b-e81f-42b4-aff6-93379e1a4004 acquire shared (120000) Thread-19148::DEBUG::2011-01-18 19:56:36,007::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19148::DEBUG::2011-01-18 19:56:36,007::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2ac70a8b-e81f-42b4-aff6-93379e1a4004' Thread-19148::DEBUG::2011-01-18 19:56:36,008::resource::524::irs::Owner 2ac70a8b-e81f-42b4-aff6-93379e1a4004: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19148::DEBUG::2011-01-18 19:56:36,008::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19148::DEBUG::2011-01-18 19:56:36,008::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: ref 1 aborting False Thread-19148::INFO::2011-01-18 19:56:36,009::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19148::DEBUG::2011-01-18 19:56:36,010::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19148::DEBUG::2011-01-18 19:56:36,010::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: moving from state preparing -> state finished Thread-19148::DEBUG::2011-01-18 19:56:36,010::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19148::DEBUG::2011-01-18 19:56:36,011::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2ac70a8b-e81f-42b4-aff6-93379e1a4004 releasing Thread-19148::DEBUG::2011-01-18 19:56:36,011::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19148::DEBUG::2011-01-18 19:56:36,011::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19148::DEBUG::2011-01-18 19:56:36,012::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19148::DEBUG::2011-01-18 19:56:36,012::resource::503::irs::Owner 2ac70a8b-e81f-42b4-aff6-93379e1a4004: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19148::DEBUG::2011-01-18 19:56:36,012::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19148::DEBUG::2011-01-18 19:56:36,012::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19148::DEBUG::2011-01-18 19:56:36,013::task::577::irs::Task 2ac70a8b-e81f-42b4-aff6-93379e1a4004: ref 0 aborting False Thread-19148::INFO::2011-01-18 19:56:36,013::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:56:36,130::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505333 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:38,143::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:38,675::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500399 seconds, 2.0 MB/s\n'; = 0 Thread-19151::INFO::2011-01-18 19:56:40,489::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19151::DEBUG::2011-01-18 19:56:40,490::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: moving from state init -> state preparing Thread-19151::DEBUG::2011-01-18 19:56:40,490::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: af4d1eab-31ee-48b8-b10d-f518f9bcbb00 acquire shared (120000) Thread-19151::DEBUG::2011-01-18 19:56:40,490::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19151::DEBUG::2011-01-18 19:56:40,491::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'af4d1eab-31ee-48b8-b10d-f518f9bcbb00' Thread-19151::DEBUG::2011-01-18 19:56:40,491::resource::524::irs::Owner af4d1eab-31ee-48b8-b10d-f518f9bcbb00: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19151::DEBUG::2011-01-18 19:56:40,492::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19151::DEBUG::2011-01-18 19:56:40,492::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: ref 1 aborting False Thread-19151::DEBUG::2011-01-18 19:56:40,493::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0530149936676', 'lastCheck': 1295373391.334918, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0519139766693', 'lastCheck': 1295373391.3357689, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0513818264008', 'lastCheck': 1295373391.3347299, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0503859519958', 'lastCheck': 1295373391.349349, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0470380783081', 'lastCheck': 1295373391.311913, 'valid': True, 'code': 0}} Thread-19151::DEBUG::2011-01-18 19:56:40,493::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: moving from state preparing -> state finished Thread-19151::DEBUG::2011-01-18 19:56:40,493::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19151::DEBUG::2011-01-18 19:56:40,494::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: af4d1eab-31ee-48b8-b10d-f518f9bcbb00 releasing Thread-19151::DEBUG::2011-01-18 19:56:40,494::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19151::DEBUG::2011-01-18 19:56:40,494::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19151::DEBUG::2011-01-18 19:56:40,495::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19151::DEBUG::2011-01-18 19:56:40,495::resource::503::irs::Owner af4d1eab-31ee-48b8-b10d-f518f9bcbb00: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19151::DEBUG::2011-01-18 19:56:40,495::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19151::DEBUG::2011-01-18 19:56:40,495::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19151::DEBUG::2011-01-18 19:56:40,496::task::577::irs::Task af4d1eab-31ee-48b8-b10d-f518f9bcbb00: ref 0 aborting False Thread-19151::INFO::2011-01-18 19:56:40,496::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0530149936676', 'lastCheck': 1295373391.334918, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0513818264008', 'lastCheck': 1295373391.3347299, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0470380783081', 'lastCheck': 1295373391.311913, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0503859519958', 'lastCheck': 1295373391.349349, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0519139766693', 'lastCheck': 1295373391.3357689, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:56:40,687::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:41,232::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512334 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:56:41,311::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:56:41,312::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:56:41,334::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::INFO::2011-01-18 19:56:41,334::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::DEBUG::2011-01-18 19:56:41,335::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:56:41,335::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::DEBUG::2011-01-18 19:56:41,336::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:56:41,337::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:56:41,349::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:56:41,350::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:56:41,353::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:56:41,379::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:56:41,379::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:56:41,380::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:56:41,391::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:43,244::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:43,776::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500769 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:45,790::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19155::INFO::2011-01-18 19:56:46,068::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19155::DEBUG::2011-01-18 19:56:46,069::task::577::irs::Task b27e657d-d971-483a-bd39-20db5284268c: moving from state init -> state preparing Thread-19155::DEBUG::2011-01-18 19:56:46,069::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19155::DEBUG::2011-01-18 19:56:46,103::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000831 seconds, 2.5 MB/s\n'; = 0 Thread-19155::DEBUG::2011-01-18 19:56:46,103::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000831 seconds, 2.5 MB/s'], size: 2048 Thread-19155::DEBUG::2011-01-18 19:56:46,104::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19155::DEBUG::2011-01-18 19:56:46,104::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19155::DEBUG::2011-01-18 19:56:46,105::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19155::DEBUG::2011-01-18 19:56:46,105::task::577::irs::Task b27e657d-d971-483a-bd39-20db5284268c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19155::DEBUG::2011-01-18 19:56:46,106::task::577::irs::Task b27e657d-d971-483a-bd39-20db5284268c: moving from state preparing -> state finished Thread-19155::DEBUG::2011-01-18 19:56:46,106::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19155::DEBUG::2011-01-18 19:56:46,107::task::577::irs::Task b27e657d-d971-483a-bd39-20db5284268c: ref 0 aborting False Thread-19155::INFO::2011-01-18 19:56:46,107::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19156::INFO::2011-01-18 19:56:46,115::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19156::DEBUG::2011-01-18 19:56:46,116::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: moving from state init -> state preparing Thread-19156::DEBUG::2011-01-18 19:56:46,116::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d acquire shared (120000) Thread-19156::DEBUG::2011-01-18 19:56:46,116::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19156::DEBUG::2011-01-18 19:56:46,117::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1c3674c9-3cc8-402a-b29f-6a1a6f4f479d' Thread-19156::DEBUG::2011-01-18 19:56:46,117::resource::524::irs::Owner 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19156::DEBUG::2011-01-18 19:56:46,117::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19156::DEBUG::2011-01-18 19:56:46,118::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: ref 1 aborting False Thread-19156::INFO::2011-01-18 19:56:46,118::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19156::DEBUG::2011-01-18 19:56:46,119::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19156::DEBUG::2011-01-18 19:56:46,120::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: moving from state preparing -> state finished Thread-19156::DEBUG::2011-01-18 19:56:46,120::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19156::DEBUG::2011-01-18 19:56:46,120::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d releasing Thread-19156::DEBUG::2011-01-18 19:56:46,121::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19156::DEBUG::2011-01-18 19:56:46,121::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19156::DEBUG::2011-01-18 19:56:46,121::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19156::DEBUG::2011-01-18 19:56:46,121::resource::503::irs::Owner 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19156::DEBUG::2011-01-18 19:56:46,122::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19156::DEBUG::2011-01-18 19:56:46,122::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19156::DEBUG::2011-01-18 19:56:46,122::task::577::irs::Task 1c3674c9-3cc8-402a-b29f-6a1a6f4f479d: ref 0 aborting False Thread-19156::INFO::2011-01-18 19:56:46,123::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:56:46,332::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510301 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:48,344::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:48,878::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500873 seconds, 2.0 MB/s\n'; = 0 Thread-19159::INFO::2011-01-18 19:56:50,651::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19159::DEBUG::2011-01-18 19:56:50,651::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: moving from state init -> state preparing Thread-19159::DEBUG::2011-01-18 19:56:50,652::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 067ec170-8844-4d0a-8519-8fe7cf1737f8 acquire shared (120000) Thread-19159::DEBUG::2011-01-18 19:56:50,652::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19159::DEBUG::2011-01-18 19:56:50,652::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '067ec170-8844-4d0a-8519-8fe7cf1737f8' Thread-19159::DEBUG::2011-01-18 19:56:50,653::resource::524::irs::Owner 067ec170-8844-4d0a-8519-8fe7cf1737f8: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19159::DEBUG::2011-01-18 19:56:50,653::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19159::DEBUG::2011-01-18 19:56:50,653::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: ref 1 aborting False Thread-19159::DEBUG::2011-01-18 19:56:50,654::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0509128570557', 'lastCheck': 1295373401.3857789, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0495879650116', 'lastCheck': 1295373401.3852999, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0539479255676', 'lastCheck': 1295373401.3878119, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466618537903', 'lastCheck': 1295373401.3955419, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463929176331', 'lastCheck': 1295373401.358243, 'valid': True, 'code': 0}} Thread-19159::DEBUG::2011-01-18 19:56:50,654::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: moving from state preparing -> state finished Thread-19159::DEBUG::2011-01-18 19:56:50,654::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19159::DEBUG::2011-01-18 19:56:50,655::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 067ec170-8844-4d0a-8519-8fe7cf1737f8 releasing Thread-19159::DEBUG::2011-01-18 19:56:50,655::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19159::DEBUG::2011-01-18 19:56:50,655::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19159::DEBUG::2011-01-18 19:56:50,655::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19159::DEBUG::2011-01-18 19:56:50,656::resource::503::irs::Owner 067ec170-8844-4d0a-8519-8fe7cf1737f8: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19159::DEBUG::2011-01-18 19:56:50,656::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19159::DEBUG::2011-01-18 19:56:50,656::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19159::DEBUG::2011-01-18 19:56:50,657::task::577::irs::Task 067ec170-8844-4d0a-8519-8fe7cf1737f8: ref 0 aborting False Thread-19159::INFO::2011-01-18 19:56:50,657::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0509128570557', 'lastCheck': 1295373401.3857789, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0539479255676', 'lastCheck': 1295373401.3878119, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0463929176331', 'lastCheck': 1295373401.358243, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466618537903', 'lastCheck': 1295373401.3955419, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0495879650116', 'lastCheck': 1295373401.3852999, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:56:50,889::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 19:56:51,358::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:56:51,359::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:56:51,385::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18494::INFO::2011-01-18 19:56:51,385::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::DEBUG::2011-01-18 19:56:51,386::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:56:51,387::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:56:51,388::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:56:51,389::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:56:51,397::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:56:51,400::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:56:51,404::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:56:51,437::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:56:51,437::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:56:51,438::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:56:51,444::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:51,455::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.532988 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:53,468::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:54,000::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500333 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:56,012::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19163::INFO::2011-01-18 19:56:56,214::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19163::DEBUG::2011-01-18 19:56:56,214::task::577::irs::Task ad82f08f-53df-4221-89a9-b7e2c9875f65: moving from state init -> state preparing Thread-19163::DEBUG::2011-01-18 19:56:56,215::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19163::DEBUG::2011-01-18 19:56:56,249::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000961 seconds, 2.1 MB/s\n'; = 0 Thread-19163::DEBUG::2011-01-18 19:56:56,250::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000961 seconds, 2.1 MB/s'], size: 2048 Thread-19163::DEBUG::2011-01-18 19:56:56,250::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19163::DEBUG::2011-01-18 19:56:56,251::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19163::DEBUG::2011-01-18 19:56:56,251::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19163::DEBUG::2011-01-18 19:56:56,252::task::577::irs::Task ad82f08f-53df-4221-89a9-b7e2c9875f65: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19163::DEBUG::2011-01-18 19:56:56,252::task::577::irs::Task ad82f08f-53df-4221-89a9-b7e2c9875f65: moving from state preparing -> state finished Thread-19163::DEBUG::2011-01-18 19:56:56,252::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19163::DEBUG::2011-01-18 19:56:56,253::task::577::irs::Task ad82f08f-53df-4221-89a9-b7e2c9875f65: ref 0 aborting False Thread-19163::INFO::2011-01-18 19:56:56,253::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19164::INFO::2011-01-18 19:56:56,262::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19164::DEBUG::2011-01-18 19:56:56,262::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: moving from state init -> state preparing Thread-19164::DEBUG::2011-01-18 19:56:56,263::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ec84a7c4-fb90-4d67-a7c6-718fe8c24899 acquire shared (120000) Thread-19164::DEBUG::2011-01-18 19:56:56,263::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19164::DEBUG::2011-01-18 19:56:56,263::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ec84a7c4-fb90-4d67-a7c6-718fe8c24899' Thread-19164::DEBUG::2011-01-18 19:56:56,264::resource::524::irs::Owner ec84a7c4-fb90-4d67-a7c6-718fe8c24899: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19164::DEBUG::2011-01-18 19:56:56,264::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19164::DEBUG::2011-01-18 19:56:56,264::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: ref 1 aborting False Thread-19164::INFO::2011-01-18 19:56:56,265::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19164::DEBUG::2011-01-18 19:56:56,266::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19164::DEBUG::2011-01-18 19:56:56,266::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: moving from state preparing -> state finished Thread-19164::DEBUG::2011-01-18 19:56:56,267::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19164::DEBUG::2011-01-18 19:56:56,267::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ec84a7c4-fb90-4d67-a7c6-718fe8c24899 releasing Thread-19164::DEBUG::2011-01-18 19:56:56,267::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19164::DEBUG::2011-01-18 19:56:56,267::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19164::DEBUG::2011-01-18 19:56:56,268::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19164::DEBUG::2011-01-18 19:56:56,268::resource::503::irs::Owner ec84a7c4-fb90-4d67-a7c6-718fe8c24899: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19164::DEBUG::2011-01-18 19:56:56,268::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19164::DEBUG::2011-01-18 19:56:56,269::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19164::DEBUG::2011-01-18 19:56:56,269::task::577::irs::Task ec84a7c4-fb90-4d67-a7c6-718fe8c24899: ref 0 aborting False Thread-19164::INFO::2011-01-18 19:56:56,269::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:56:56,548::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504518 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:56:58,561::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:56:59,098::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505264 seconds, 2.0 MB/s\n'; = 0 Thread-19167::INFO::2011-01-18 19:57:00,814::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19167::DEBUG::2011-01-18 19:57:00,814::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: moving from state init -> state preparing Thread-19167::DEBUG::2011-01-18 19:57:00,814::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 68f3f066-9c2e-4395-b86a-0997bf30dc3d acquire shared (120000) Thread-19167::DEBUG::2011-01-18 19:57:00,815::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19167::DEBUG::2011-01-18 19:57:00,815::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '68f3f066-9c2e-4395-b86a-0997bf30dc3d' Thread-19167::DEBUG::2011-01-18 19:57:00,815::resource::524::irs::Owner 68f3f066-9c2e-4395-b86a-0997bf30dc3d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19167::DEBUG::2011-01-18 19:57:00,816::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19167::DEBUG::2011-01-18 19:57:00,816::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: ref 1 aborting False Thread-19167::DEBUG::2011-01-18 19:57:00,816::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0592830181122', 'lastCheck': 1295373411.444159, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0578179359436', 'lastCheck': 1295373411.4434869, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0564007759094', 'lastCheck': 1295373411.4444399, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0523819923401', 'lastCheck': 1295373411.449764, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0526268482208', 'lastCheck': 1295373411.410533, 'valid': True, 'code': 0}} Thread-19167::DEBUG::2011-01-18 19:57:00,817::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: moving from state preparing -> state finished Thread-19167::DEBUG::2011-01-18 19:57:00,817::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19167::DEBUG::2011-01-18 19:57:00,817::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 68f3f066-9c2e-4395-b86a-0997bf30dc3d releasing Thread-19167::DEBUG::2011-01-18 19:57:00,817::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19167::DEBUG::2011-01-18 19:57:00,818::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19167::DEBUG::2011-01-18 19:57:00,818::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19167::DEBUG::2011-01-18 19:57:00,818::resource::503::irs::Owner 68f3f066-9c2e-4395-b86a-0997bf30dc3d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19167::DEBUG::2011-01-18 19:57:00,819::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19167::DEBUG::2011-01-18 19:57:00,819::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19167::DEBUG::2011-01-18 19:57:00,819::task::577::irs::Task 68f3f066-9c2e-4395-b86a-0997bf30dc3d: ref 0 aborting False Thread-19167::INFO::2011-01-18 19:57:00,819::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0592830181122', 'lastCheck': 1295373411.444159, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0564007759094', 'lastCheck': 1295373411.4444399, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0526268482208', 'lastCheck': 1295373411.410533, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0523819923401', 'lastCheck': 1295373411.449764, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0578179359436', 'lastCheck': 1295373411.4434869, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:57:01,111::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 19:57:01,410::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:57:01,410::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:57:01,443::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:57:01,443::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:57:01,444::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::INFO::2011-01-18 19:57:01,444::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::DEBUG::2011-01-18 19:57:01,445::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:57:01,446::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:57:01,449::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 19:57:01,454::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:01,456::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:57:01,491::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:01,496::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:57:01,498::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:01,502::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:01,679::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.53614 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:03,692::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:04,225::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501844 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:06,236::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19171::INFO::2011-01-18 19:57:06,323::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19171::DEBUG::2011-01-18 19:57:06,323::task::577::irs::Task f7bb1f5b-43f3-4046-bf03-c473b0d7e63e: moving from state init -> state preparing Thread-19171::DEBUG::2011-01-18 19:57:06,324::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19171::DEBUG::2011-01-18 19:57:06,358::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000373 seconds, 5.5 MB/s\n'; = 0 Thread-19171::DEBUG::2011-01-18 19:57:06,358::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000373 seconds, 5.5 MB/s'], size: 2048 Thread-19171::DEBUG::2011-01-18 19:57:06,358::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19171::DEBUG::2011-01-18 19:57:06,359::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19171::DEBUG::2011-01-18 19:57:06,360::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19171::DEBUG::2011-01-18 19:57:06,360::task::577::irs::Task f7bb1f5b-43f3-4046-bf03-c473b0d7e63e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19171::DEBUG::2011-01-18 19:57:06,360::task::577::irs::Task f7bb1f5b-43f3-4046-bf03-c473b0d7e63e: moving from state preparing -> state finished Thread-19171::DEBUG::2011-01-18 19:57:06,361::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19171::DEBUG::2011-01-18 19:57:06,361::task::577::irs::Task f7bb1f5b-43f3-4046-bf03-c473b0d7e63e: ref 0 aborting False Thread-19171::INFO::2011-01-18 19:57:06,361::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19172::INFO::2011-01-18 19:57:06,370::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19172::DEBUG::2011-01-18 19:57:06,371::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: moving from state init -> state preparing Thread-19172::DEBUG::2011-01-18 19:57:06,371::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 21f0a75e-3665-4014-99e5-57c1738f05f0 acquire shared (120000) Thread-19172::DEBUG::2011-01-18 19:57:06,371::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19172::DEBUG::2011-01-18 19:57:06,372::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '21f0a75e-3665-4014-99e5-57c1738f05f0' Thread-19172::DEBUG::2011-01-18 19:57:06,372::resource::524::irs::Owner 21f0a75e-3665-4014-99e5-57c1738f05f0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19172::DEBUG::2011-01-18 19:57:06,373::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19172::DEBUG::2011-01-18 19:57:06,373::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: ref 1 aborting False Thread-19172::INFO::2011-01-18 19:57:06,373::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19172::DEBUG::2011-01-18 19:57:06,374::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19172::DEBUG::2011-01-18 19:57:06,375::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: moving from state preparing -> state finished Thread-19172::DEBUG::2011-01-18 19:57:06,375::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19172::DEBUG::2011-01-18 19:57:06,376::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 21f0a75e-3665-4014-99e5-57c1738f05f0 releasing Thread-19172::DEBUG::2011-01-18 19:57:06,376::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19172::DEBUG::2011-01-18 19:57:06,376::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19172::DEBUG::2011-01-18 19:57:06,377::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19172::DEBUG::2011-01-18 19:57:06,377::resource::503::irs::Owner 21f0a75e-3665-4014-99e5-57c1738f05f0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19172::DEBUG::2011-01-18 19:57:06,377::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19172::DEBUG::2011-01-18 19:57:06,378::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19172::DEBUG::2011-01-18 19:57:06,378::task::577::irs::Task 21f0a75e-3665-4014-99e5-57c1738f05f0: ref 0 aborting False Thread-19172::INFO::2011-01-18 19:57:06,379::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:57:06,777::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507887 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:08,787::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:09,324::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504065 seconds, 2.0 MB/s\n'; = 0 Thread-19175::INFO::2011-01-18 19:57:10,987::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19175::DEBUG::2011-01-18 19:57:10,988::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: moving from state init -> state preparing Thread-19175::DEBUG::2011-01-18 19:57:10,988::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: def8b934-859e-460b-bb4f-c1b6945b3d1f acquire shared (120000) Thread-19175::DEBUG::2011-01-18 19:57:10,988::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19175::DEBUG::2011-01-18 19:57:10,989::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'def8b934-859e-460b-bb4f-c1b6945b3d1f' Thread-19175::DEBUG::2011-01-18 19:57:10,989::resource::524::irs::Owner def8b934-859e-460b-bb4f-c1b6945b3d1f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19175::DEBUG::2011-01-18 19:57:10,989::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19175::DEBUG::2011-01-18 19:57:10,989::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: ref 1 aborting False Thread-19175::DEBUG::2011-01-18 19:57:10,990::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0581610202789', 'lastCheck': 1295373421.5023689, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0517680644989', 'lastCheck': 1295373421.4946251, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0561740398407', 'lastCheck': 1295373421.500973, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0580129623413', 'lastCheck': 1295373421.5072479, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0547151565552', 'lastCheck': 1295373421.4645851, 'valid': True, 'code': 0}} Thread-19175::DEBUG::2011-01-18 19:57:10,990::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: moving from state preparing -> state finished Thread-19175::DEBUG::2011-01-18 19:57:10,990::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19175::DEBUG::2011-01-18 19:57:10,991::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: def8b934-859e-460b-bb4f-c1b6945b3d1f releasing Thread-19175::DEBUG::2011-01-18 19:57:10,991::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19175::DEBUG::2011-01-18 19:57:10,991::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19175::DEBUG::2011-01-18 19:57:10,992::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19175::DEBUG::2011-01-18 19:57:10,992::resource::503::irs::Owner def8b934-859e-460b-bb4f-c1b6945b3d1f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19175::DEBUG::2011-01-18 19:57:10,992::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19175::DEBUG::2011-01-18 19:57:10,992::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19175::DEBUG::2011-01-18 19:57:10,993::task::577::irs::Task def8b934-859e-460b-bb4f-c1b6945b3d1f: ref 0 aborting False Thread-19175::INFO::2011-01-18 19:57:10,993::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0581610202789', 'lastCheck': 1295373421.5023689, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0561740398407', 'lastCheck': 1295373421.500973, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0547151565552', 'lastCheck': 1295373421.4645851, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0580129623413', 'lastCheck': 1295373421.5072479, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0517680644989', 'lastCheck': 1295373421.4946251, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:57:11,337::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 19:57:11,464::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:57:11,465::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:57:11,494::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:57:11,495::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:57:11,501::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::INFO::2011-01-18 19:57:11,502::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::DEBUG::2011-01-18 19:57:11,503::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:57:11,504::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:57:11,507::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:57:11,511::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:57:11,512::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:57:11,543::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:11,550::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:57:11,551::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:11,561::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:11,902::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.533194 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:13,916::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:14,450::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502366 seconds, 2.0 MB/s\n'; = 0 Thread-19179::INFO::2011-01-18 19:57:16,432::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19179::DEBUG::2011-01-18 19:57:16,432::task::577::irs::Task f663fed4-e999-49aa-a99d-98f2bd6b957a: moving from state init -> state preparing Thread-19179::DEBUG::2011-01-18 19:57:16,433::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:16,462::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19179::DEBUG::2011-01-18 19:57:16,466::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000459 seconds, 4.5 MB/s\n'; = 0 Thread-19179::DEBUG::2011-01-18 19:57:16,467::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000459 seconds, 4.5 MB/s'], size: 2048 Thread-19179::DEBUG::2011-01-18 19:57:16,467::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19179::DEBUG::2011-01-18 19:57:16,468::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19179::DEBUG::2011-01-18 19:57:16,468::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19179::DEBUG::2011-01-18 19:57:16,469::task::577::irs::Task f663fed4-e999-49aa-a99d-98f2bd6b957a: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19179::DEBUG::2011-01-18 19:57:16,469::task::577::irs::Task f663fed4-e999-49aa-a99d-98f2bd6b957a: moving from state preparing -> state finished Thread-19179::DEBUG::2011-01-18 19:57:16,469::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19179::DEBUG::2011-01-18 19:57:16,470::task::577::irs::Task f663fed4-e999-49aa-a99d-98f2bd6b957a: ref 0 aborting False Thread-19179::INFO::2011-01-18 19:57:16,470::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19180::INFO::2011-01-18 19:57:16,479::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19180::DEBUG::2011-01-18 19:57:16,479::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: moving from state init -> state preparing Thread-19180::DEBUG::2011-01-18 19:57:16,480::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c64b02cb-f17e-48f5-ab30-87e86ecad15e acquire shared (120000) Thread-19180::DEBUG::2011-01-18 19:57:16,480::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19180::DEBUG::2011-01-18 19:57:16,480::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c64b02cb-f17e-48f5-ab30-87e86ecad15e' Thread-19180::DEBUG::2011-01-18 19:57:16,481::resource::524::irs::Owner c64b02cb-f17e-48f5-ab30-87e86ecad15e: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19180::DEBUG::2011-01-18 19:57:16,481::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19180::DEBUG::2011-01-18 19:57:16,481::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: ref 1 aborting False Thread-19180::INFO::2011-01-18 19:57:16,482::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19180::DEBUG::2011-01-18 19:57:16,483::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19180::DEBUG::2011-01-18 19:57:16,483::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: moving from state preparing -> state finished Thread-19180::DEBUG::2011-01-18 19:57:16,483::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19180::DEBUG::2011-01-18 19:57:16,484::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c64b02cb-f17e-48f5-ab30-87e86ecad15e releasing Thread-19180::DEBUG::2011-01-18 19:57:16,484::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19180::DEBUG::2011-01-18 19:57:16,484::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19180::DEBUG::2011-01-18 19:57:16,484::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19180::DEBUG::2011-01-18 19:57:16,485::resource::503::irs::Owner c64b02cb-f17e-48f5-ab30-87e86ecad15e: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19180::DEBUG::2011-01-18 19:57:16,485::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19180::DEBUG::2011-01-18 19:57:16,485::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19180::DEBUG::2011-01-18 19:57:16,486::task::577::irs::Task c64b02cb-f17e-48f5-ab30-87e86ecad15e: ref 0 aborting False Thread-19180::INFO::2011-01-18 19:57:16,486::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:57:17,000::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503417 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:19,013::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:19,545::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500697 seconds, 2.0 MB/s\n'; = 0 Thread-19183::INFO::2011-01-18 19:57:21,189::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19183::DEBUG::2011-01-18 19:57:21,190::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: moving from state init -> state preparing Thread-19183::DEBUG::2011-01-18 19:57:21,190::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a acquire shared (120000) Thread-19183::DEBUG::2011-01-18 19:57:21,190::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19183::DEBUG::2011-01-18 19:57:21,190::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a' Thread-19183::DEBUG::2011-01-18 19:57:21,191::resource::524::irs::Owner ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19183::DEBUG::2011-01-18 19:57:21,191::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19183::DEBUG::2011-01-18 19:57:21,191::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: ref 1 aborting False Thread-19183::DEBUG::2011-01-18 19:57:21,192::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0583708286285', 'lastCheck': 1295373431.5603349, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0551118850708', 'lastCheck': 1295373431.5489719, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0584008693695', 'lastCheck': 1295373431.5592849, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0581889152527', 'lastCheck': 1295373431.565259, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.056941986084', 'lastCheck': 1295373431.5208571, 'valid': True, 'code': 0}} Thread-19183::DEBUG::2011-01-18 19:57:21,192::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: moving from state preparing -> state finished Thread-19183::DEBUG::2011-01-18 19:57:21,192::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19183::DEBUG::2011-01-18 19:57:21,193::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a releasing Thread-19183::DEBUG::2011-01-18 19:57:21,193::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19183::DEBUG::2011-01-18 19:57:21,193::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19183::DEBUG::2011-01-18 19:57:21,193::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19183::DEBUG::2011-01-18 19:57:21,194::resource::503::irs::Owner ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19183::DEBUG::2011-01-18 19:57:21,194::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19183::DEBUG::2011-01-18 19:57:21,194::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19183::DEBUG::2011-01-18 19:57:21,195::task::577::irs::Task ee24cb30-a7ba-4ccb-a5fb-f4acf2b00b1a: ref 0 aborting False Thread-19183::INFO::2011-01-18 19:57:21,195::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0583708286285', 'lastCheck': 1295373431.5603349, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0584008693695', 'lastCheck': 1295373431.5592849, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.056941986084', 'lastCheck': 1295373431.5208571, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0581889152527', 'lastCheck': 1295373431.565259, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0551118850708', 'lastCheck': 1295373431.5489719, 'valid': True, 'code': 0}} Thread-18497::INFO::2011-01-18 19:57:21,520::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:57:21,521::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:57:21,560::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18494::INFO::2011-01-18 19:57:21,560::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::INFO::2011-01-18 19:57:21,560::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Dummy-18546::DEBUG::2011-01-18 19:57:21,561::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::DEBUG::2011-01-18 19:57:21,561::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:57:21,562::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:57:21,562::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:21,563::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:57:21,565::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:57:21,576::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:57:21,610::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:57:21,613::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:21,616::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:21,625::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:22,123::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.527725 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:24,137::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:24,676::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507132 seconds, 2.0 MB/s\n'; = 0 Thread-19187::INFO::2011-01-18 19:57:26,540::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19187::DEBUG::2011-01-18 19:57:26,541::task::577::irs::Task cf306911-fd07-4df1-b05a-02060e7483a2: moving from state init -> state preparing Thread-19187::DEBUG::2011-01-18 19:57:26,541::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19187::DEBUG::2011-01-18 19:57:26,573::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000461 seconds, 4.4 MB/s\n'; = 0 Thread-19187::DEBUG::2011-01-18 19:57:26,574::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000461 seconds, 4.4 MB/s'], size: 2048 Thread-19187::DEBUG::2011-01-18 19:57:26,574::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19187::DEBUG::2011-01-18 19:57:26,574::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19187::DEBUG::2011-01-18 19:57:26,575::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19187::DEBUG::2011-01-18 19:57:26,575::task::577::irs::Task cf306911-fd07-4df1-b05a-02060e7483a2: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19187::DEBUG::2011-01-18 19:57:26,576::task::577::irs::Task cf306911-fd07-4df1-b05a-02060e7483a2: moving from state preparing -> state finished Thread-19187::DEBUG::2011-01-18 19:57:26,576::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19187::DEBUG::2011-01-18 19:57:26,576::task::577::irs::Task cf306911-fd07-4df1-b05a-02060e7483a2: ref 0 aborting False Thread-19187::INFO::2011-01-18 19:57:26,577::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19188::INFO::2011-01-18 19:57:26,585::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19188::DEBUG::2011-01-18 19:57:26,585::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: moving from state init -> state preparing Thread-19188::DEBUG::2011-01-18 19:57:26,585::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6a5dded8-f7e9-4b68-a608-ceda7a84318f acquire shared (120000) Thread-19188::DEBUG::2011-01-18 19:57:26,586::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19188::DEBUG::2011-01-18 19:57:26,586::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6a5dded8-f7e9-4b68-a608-ceda7a84318f' Thread-19188::DEBUG::2011-01-18 19:57:26,586::resource::524::irs::Owner 6a5dded8-f7e9-4b68-a608-ceda7a84318f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19188::DEBUG::2011-01-18 19:57:26,586::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19188::DEBUG::2011-01-18 19:57:26,587::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: ref 1 aborting False Thread-19188::INFO::2011-01-18 19:57:26,587::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19188::DEBUG::2011-01-18 19:57:26,588::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19188::DEBUG::2011-01-18 19:57:26,588::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: moving from state preparing -> state finished Thread-19188::DEBUG::2011-01-18 19:57:26,588::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19188::DEBUG::2011-01-18 19:57:26,589::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6a5dded8-f7e9-4b68-a608-ceda7a84318f releasing Thread-19188::DEBUG::2011-01-18 19:57:26,589::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19188::DEBUG::2011-01-18 19:57:26,589::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19188::DEBUG::2011-01-18 19:57:26,589::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19188::DEBUG::2011-01-18 19:57:26,590::resource::503::irs::Owner 6a5dded8-f7e9-4b68-a608-ceda7a84318f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19188::DEBUG::2011-01-18 19:57:26,590::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19188::DEBUG::2011-01-18 19:57:26,590::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19188::DEBUG::2011-01-18 19:57:26,591::task::577::irs::Task 6a5dded8-f7e9-4b68-a608-ceda7a84318f: ref 0 aborting False Thread-19188::INFO::2011-01-18 19:57:26,591::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:57:26,691::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:27,243::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502664 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:29,257::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:29,790::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500637 seconds, 2.0 MB/s\n'; = 0 Thread-19191::INFO::2011-01-18 19:57:31,353::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19191::DEBUG::2011-01-18 19:57:31,354::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: moving from state init -> state preparing Thread-19191::DEBUG::2011-01-18 19:57:31,354::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8d5d0ed3-6a34-423c-8648-ec4224ac0c67 acquire shared (120000) Thread-19191::DEBUG::2011-01-18 19:57:31,354::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19191::DEBUG::2011-01-18 19:57:31,355::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8d5d0ed3-6a34-423c-8648-ec4224ac0c67' Thread-19191::DEBUG::2011-01-18 19:57:31,355::resource::524::irs::Owner 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19191::DEBUG::2011-01-18 19:57:31,355::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19191::DEBUG::2011-01-18 19:57:31,355::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: ref 1 aborting False Thread-19191::DEBUG::2011-01-18 19:57:31,356::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0577130317688', 'lastCheck': 1295373441.6175799, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0553228855133', 'lastCheck': 1295373441.6155939, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0598168373108', 'lastCheck': 1295373441.6202819, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0656261444092', 'lastCheck': 1295373441.6305621, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0596492290497', 'lastCheck': 1295373441.5804901, 'valid': True, 'code': 0}} Thread-19191::DEBUG::2011-01-18 19:57:31,356::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: moving from state preparing -> state finished Thread-19191::DEBUG::2011-01-18 19:57:31,356::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19191::DEBUG::2011-01-18 19:57:31,357::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8d5d0ed3-6a34-423c-8648-ec4224ac0c67 releasing Thread-19191::DEBUG::2011-01-18 19:57:31,357::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19191::DEBUG::2011-01-18 19:57:31,357::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19191::DEBUG::2011-01-18 19:57:31,357::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19191::DEBUG::2011-01-18 19:57:31,358::resource::503::irs::Owner 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19191::DEBUG::2011-01-18 19:57:31,358::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19191::DEBUG::2011-01-18 19:57:31,358::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19191::DEBUG::2011-01-18 19:57:31,359::task::577::irs::Task 8d5d0ed3-6a34-423c-8648-ec4224ac0c67: ref 0 aborting False Thread-19191::INFO::2011-01-18 19:57:31,359::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0577130317688', 'lastCheck': 1295373441.6175799, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0598168373108', 'lastCheck': 1295373441.6202819, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0596492290497', 'lastCheck': 1295373441.5804901, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0656261444092', 'lastCheck': 1295373441.6305621, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0553228855133', 'lastCheck': 1295373441.6155939, 'valid': True, 'code': 0}} Thread-18497::INFO::2011-01-18 19:57:31,579::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:57:31,580::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:57:31,614::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:57:31,615::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:57:31,618::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:57:31,619::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:57:31,620::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::DEBUG::2011-01-18 19:57:31,620::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:31,621::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:57:31,630::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:57:31,631::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:57:31,656::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:57:31,662::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:31,669::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:31,671::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:31,804::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:32,347::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511796 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:34,361::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:34,893::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500626 seconds, 2.0 MB/s\n'; = 0 Thread-19195::INFO::2011-01-18 19:57:36,644::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19195::DEBUG::2011-01-18 19:57:36,645::task::577::irs::Task 2db0fc86-df42-44e9-9c28-634d64527cf8: moving from state init -> state preparing Thread-19195::DEBUG::2011-01-18 19:57:36,645::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19195::DEBUG::2011-01-18 19:57:36,677::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0005 seconds, 4.1 MB/s\n'; = 0 Thread-19195::DEBUG::2011-01-18 19:57:36,677::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0005 seconds, 4.1 MB/s'], size: 2048 Thread-19195::DEBUG::2011-01-18 19:57:36,678::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19195::DEBUG::2011-01-18 19:57:36,678::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19195::DEBUG::2011-01-18 19:57:36,679::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19195::DEBUG::2011-01-18 19:57:36,679::task::577::irs::Task 2db0fc86-df42-44e9-9c28-634d64527cf8: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19195::DEBUG::2011-01-18 19:57:36,679::task::577::irs::Task 2db0fc86-df42-44e9-9c28-634d64527cf8: moving from state preparing -> state finished Thread-19195::DEBUG::2011-01-18 19:57:36,680::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19195::DEBUG::2011-01-18 19:57:36,680::task::577::irs::Task 2db0fc86-df42-44e9-9c28-634d64527cf8: ref 0 aborting False Thread-19195::INFO::2011-01-18 19:57:36,680::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19196::INFO::2011-01-18 19:57:36,689::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19196::DEBUG::2011-01-18 19:57:36,689::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: moving from state init -> state preparing Thread-19196::DEBUG::2011-01-18 19:57:36,689::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d0d397c7-dbe0-4c2e-91b5-6459be8583b9 acquire shared (120000) Thread-19196::DEBUG::2011-01-18 19:57:36,690::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19196::DEBUG::2011-01-18 19:57:36,690::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd0d397c7-dbe0-4c2e-91b5-6459be8583b9' Thread-19196::DEBUG::2011-01-18 19:57:36,690::resource::524::irs::Owner d0d397c7-dbe0-4c2e-91b5-6459be8583b9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19196::DEBUG::2011-01-18 19:57:36,690::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19196::DEBUG::2011-01-18 19:57:36,691::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: ref 1 aborting False Thread-19196::INFO::2011-01-18 19:57:36,691::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19196::DEBUG::2011-01-18 19:57:36,692::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19196::DEBUG::2011-01-18 19:57:36,692::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: moving from state preparing -> state finished Thread-19196::DEBUG::2011-01-18 19:57:36,692::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19196::DEBUG::2011-01-18 19:57:36,693::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d0d397c7-dbe0-4c2e-91b5-6459be8583b9 releasing Thread-19196::DEBUG::2011-01-18 19:57:36,693::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19196::DEBUG::2011-01-18 19:57:36,693::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19196::DEBUG::2011-01-18 19:57:36,694::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19196::DEBUG::2011-01-18 19:57:36,694::resource::503::irs::Owner d0d397c7-dbe0-4c2e-91b5-6459be8583b9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19196::DEBUG::2011-01-18 19:57:36,694::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19196::DEBUG::2011-01-18 19:57:36,694::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19196::DEBUG::2011-01-18 19:57:36,695::task::577::irs::Task d0d397c7-dbe0-4c2e-91b5-6459be8583b9: ref 0 aborting False Thread-19196::INFO::2011-01-18 19:57:36,695::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:57:36,907::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:37,442::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503867 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:39,457::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:39,993::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503216 seconds, 2.0 MB/s\n'; = 0 Thread-19199::INFO::2011-01-18 19:57:41,514::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19199::DEBUG::2011-01-18 19:57:41,514::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: moving from state init -> state preparing Thread-19199::DEBUG::2011-01-18 19:57:41,514::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0ceca2a-fecc-4e27-8922-21c8a25e63ba acquire shared (120000) Thread-19199::DEBUG::2011-01-18 19:57:41,515::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19199::DEBUG::2011-01-18 19:57:41,515::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c0ceca2a-fecc-4e27-8922-21c8a25e63ba' Thread-19199::DEBUG::2011-01-18 19:57:41,515::resource::524::irs::Owner c0ceca2a-fecc-4e27-8922-21c8a25e63ba: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19199::DEBUG::2011-01-18 19:57:41,515::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19199::DEBUG::2011-01-18 19:57:41,516::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: ref 1 aborting False Thread-19199::DEBUG::2011-01-18 19:57:41,516::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0480279922485', 'lastCheck': 1295373451.6659701, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0474400520325', 'lastCheck': 1295373451.662288, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0536561012268', 'lastCheck': 1295373451.673635, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.04678606987', 'lastCheck': 1295373451.676692, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0548341274261', 'lastCheck': 1295373451.63467, 'valid': True, 'code': 0}} Thread-19199::DEBUG::2011-01-18 19:57:41,517::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: moving from state preparing -> state finished Thread-19199::DEBUG::2011-01-18 19:57:41,517::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19199::DEBUG::2011-01-18 19:57:41,517::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0ceca2a-fecc-4e27-8922-21c8a25e63ba releasing Thread-19199::DEBUG::2011-01-18 19:57:41,517::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19199::DEBUG::2011-01-18 19:57:41,518::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19199::DEBUG::2011-01-18 19:57:41,518::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19199::DEBUG::2011-01-18 19:57:41,518::resource::503::irs::Owner c0ceca2a-fecc-4e27-8922-21c8a25e63ba: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19199::DEBUG::2011-01-18 19:57:41,518::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19199::DEBUG::2011-01-18 19:57:41,519::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19199::DEBUG::2011-01-18 19:57:41,519::task::577::irs::Task c0ceca2a-fecc-4e27-8922-21c8a25e63ba: ref 0 aborting False Thread-19199::INFO::2011-01-18 19:57:41,519::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0480279922485', 'lastCheck': 1295373451.6659701, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0536561012268', 'lastCheck': 1295373451.673635, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0548341274261', 'lastCheck': 1295373451.63467, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.04678606987', 'lastCheck': 1295373451.676692, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0474400520325', 'lastCheck': 1295373451.662288, 'valid': True, 'code': 0}} Thread-18497::INFO::2011-01-18 19:57:41,633::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:57:41,634::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:57:41,662::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:57:41,663::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:57:41,666::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:57:41,667::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:57:41,673::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:57:41,675::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:57:41,676::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:57:41,678::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:57:41,680::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:57:41,705::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:57:41,707::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:41,716::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:41,722::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:42,008::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:42,552::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512238 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:44,566::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:45,101::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503642 seconds, 2.0 MB/s\n'; = 0 Thread-19203::INFO::2011-01-18 19:57:46,747::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19203::DEBUG::2011-01-18 19:57:46,748::task::577::irs::Task aa90ea67-4525-4f71-83d4-5587e6906f3d: moving from state init -> state preparing Thread-19203::DEBUG::2011-01-18 19:57:46,748::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19203::DEBUG::2011-01-18 19:57:46,780::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000427 seconds, 4.8 MB/s\n'; = 0 Thread-19203::DEBUG::2011-01-18 19:57:46,780::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000427 seconds, 4.8 MB/s'], size: 2048 Thread-19203::DEBUG::2011-01-18 19:57:46,780::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19203::DEBUG::2011-01-18 19:57:46,781::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19203::DEBUG::2011-01-18 19:57:46,781::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19203::DEBUG::2011-01-18 19:57:46,782::task::577::irs::Task aa90ea67-4525-4f71-83d4-5587e6906f3d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19203::DEBUG::2011-01-18 19:57:46,782::task::577::irs::Task aa90ea67-4525-4f71-83d4-5587e6906f3d: moving from state preparing -> state finished Thread-19203::DEBUG::2011-01-18 19:57:46,782::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19203::DEBUG::2011-01-18 19:57:46,783::task::577::irs::Task aa90ea67-4525-4f71-83d4-5587e6906f3d: ref 0 aborting False Thread-19203::INFO::2011-01-18 19:57:46,783::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19204::INFO::2011-01-18 19:57:46,793::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19204::DEBUG::2011-01-18 19:57:46,793::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: moving from state init -> state preparing Thread-19204::DEBUG::2011-01-18 19:57:46,793::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6c3b5b69-789d-4ddc-85a2-4a1b750e91af acquire shared (120000) Thread-19204::DEBUG::2011-01-18 19:57:46,794::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19204::DEBUG::2011-01-18 19:57:46,794::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6c3b5b69-789d-4ddc-85a2-4a1b750e91af' Thread-19204::DEBUG::2011-01-18 19:57:46,794::resource::524::irs::Owner 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19204::DEBUG::2011-01-18 19:57:46,794::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19204::DEBUG::2011-01-18 19:57:46,795::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: ref 1 aborting False Thread-19204::INFO::2011-01-18 19:57:46,795::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19204::DEBUG::2011-01-18 19:57:46,796::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19204::DEBUG::2011-01-18 19:57:46,796::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: moving from state preparing -> state finished Thread-19204::DEBUG::2011-01-18 19:57:46,796::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19204::DEBUG::2011-01-18 19:57:46,797::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6c3b5b69-789d-4ddc-85a2-4a1b750e91af releasing Thread-19204::DEBUG::2011-01-18 19:57:46,797::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19204::DEBUG::2011-01-18 19:57:46,797::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19204::DEBUG::2011-01-18 19:57:46,798::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19204::DEBUG::2011-01-18 19:57:46,798::resource::503::irs::Owner 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19204::DEBUG::2011-01-18 19:57:46,798::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19204::DEBUG::2011-01-18 19:57:46,798::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19204::DEBUG::2011-01-18 19:57:46,799::task::577::irs::Task 6c3b5b69-789d-4ddc-85a2-4a1b750e91af: ref 0 aborting False Thread-19204::INFO::2011-01-18 19:57:46,799::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:57:47,113::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:47,647::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502188 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:49,661::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:50,193::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500712 seconds, 2.0 MB/s\n'; = 0 Thread-19207::INFO::2011-01-18 19:57:51,677::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19207::DEBUG::2011-01-18 19:57:51,678::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: moving from state init -> state preparing Thread-19207::DEBUG::2011-01-18 19:57:51,678::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2a5d2a77-c3e8-407f-b775-55ff81544c7d acquire shared (120000) Thread-19207::DEBUG::2011-01-18 19:57:51,678::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19207::DEBUG::2011-01-18 19:57:51,679::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2a5d2a77-c3e8-407f-b775-55ff81544c7d' Thread-19207::DEBUG::2011-01-18 19:57:51,679::resource::524::irs::Owner 2a5d2a77-c3e8-407f-b775-55ff81544c7d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19207::DEBUG::2011-01-18 19:57:51,679::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19207::DEBUG::2011-01-18 19:57:51,680::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: ref 1 aborting False Thread-19207::DEBUG::2011-01-18 19:57:51,680::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451028347015', 'lastCheck': 1295373461.7112999, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048397064209', 'lastCheck': 1295373461.7102611, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476670265198', 'lastCheck': 1295373461.7206841, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0488519668579', 'lastCheck': 1295373461.7270191, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0531032085419', 'lastCheck': 1295373461.6869371, 'valid': True, 'code': 0}} Thread-19207::DEBUG::2011-01-18 19:57:51,680::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: moving from state preparing -> state finished Thread-19207::DEBUG::2011-01-18 19:57:51,681::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19207::DEBUG::2011-01-18 19:57:51,681::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2a5d2a77-c3e8-407f-b775-55ff81544c7d releasing Thread-19207::DEBUG::2011-01-18 19:57:51,681::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19207::DEBUG::2011-01-18 19:57:51,681::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19207::DEBUG::2011-01-18 19:57:51,682::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19207::DEBUG::2011-01-18 19:57:51,682::resource::503::irs::Owner 2a5d2a77-c3e8-407f-b775-55ff81544c7d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19207::DEBUG::2011-01-18 19:57:51,682::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19207::DEBUG::2011-01-18 19:57:51,683::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19207::DEBUG::2011-01-18 19:57:51,683::task::577::irs::Task 2a5d2a77-c3e8-407f-b775-55ff81544c7d: ref 0 aborting False Thread-19207::INFO::2011-01-18 19:57:51,683::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0451028347015', 'lastCheck': 1295373461.7112999, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476670265198', 'lastCheck': 1295373461.7206841, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0531032085419', 'lastCheck': 1295373461.6869371, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0488519668579', 'lastCheck': 1295373461.7270191, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048397064209', 'lastCheck': 1295373461.7102611, 'valid': True, 'code': 0}} Thread-18497::INFO::2011-01-18 19:57:51,686::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:57:51,687::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:57:51,710::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:57:51,710::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:57:51,710::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:57:51,711::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:57:51,720::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:57:51,721::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:57:51,727::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 19:57:51,728::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:51,729::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:57:51,754::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:57:51,755::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:57:51,763::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:57:51,772::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:52,207::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:52,750::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511598 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:54,764::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:55,297::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501373 seconds, 2.0 MB/s\n'; = 0 Thread-19211::INFO::2011-01-18 19:57:56,852::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19211::DEBUG::2011-01-18 19:57:56,853::task::577::irs::Task a8d3338e-8618-4737-9536-5d10fad3b778: moving from state init -> state preparing Thread-19211::DEBUG::2011-01-18 19:57:56,853::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19211::DEBUG::2011-01-18 19:57:56,886::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00048 seconds, 4.3 MB/s\n'; = 0 Thread-19211::DEBUG::2011-01-18 19:57:56,886::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00048 seconds, 4.3 MB/s'], size: 2048 Thread-19211::DEBUG::2011-01-18 19:57:56,887::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19211::DEBUG::2011-01-18 19:57:56,887::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19211::DEBUG::2011-01-18 19:57:56,888::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19211::DEBUG::2011-01-18 19:57:56,888::task::577::irs::Task a8d3338e-8618-4737-9536-5d10fad3b778: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19211::DEBUG::2011-01-18 19:57:56,888::task::577::irs::Task a8d3338e-8618-4737-9536-5d10fad3b778: moving from state preparing -> state finished Thread-19211::DEBUG::2011-01-18 19:57:56,889::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19211::DEBUG::2011-01-18 19:57:56,889::task::577::irs::Task a8d3338e-8618-4737-9536-5d10fad3b778: ref 0 aborting False Thread-19211::INFO::2011-01-18 19:57:56,889::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19212::INFO::2011-01-18 19:57:56,897::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19212::DEBUG::2011-01-18 19:57:56,898::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: moving from state init -> state preparing Thread-19212::DEBUG::2011-01-18 19:57:56,898::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6991300c-1130-4d2f-a719-336f05134ac7 acquire shared (120000) Thread-19212::DEBUG::2011-01-18 19:57:56,898::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19212::DEBUG::2011-01-18 19:57:56,899::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6991300c-1130-4d2f-a719-336f05134ac7' Thread-19212::DEBUG::2011-01-18 19:57:56,899::resource::524::irs::Owner 6991300c-1130-4d2f-a719-336f05134ac7: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19212::DEBUG::2011-01-18 19:57:56,899::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19212::DEBUG::2011-01-18 19:57:56,900::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: ref 1 aborting False Thread-19212::INFO::2011-01-18 19:57:56,900::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19212::DEBUG::2011-01-18 19:57:56,901::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19212::DEBUG::2011-01-18 19:57:56,901::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: moving from state preparing -> state finished Thread-19212::DEBUG::2011-01-18 19:57:56,901::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19212::DEBUG::2011-01-18 19:57:56,902::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6991300c-1130-4d2f-a719-336f05134ac7 releasing Thread-19212::DEBUG::2011-01-18 19:57:56,902::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19212::DEBUG::2011-01-18 19:57:56,902::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19212::DEBUG::2011-01-18 19:57:56,902::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19212::DEBUG::2011-01-18 19:57:56,903::resource::503::irs::Owner 6991300c-1130-4d2f-a719-336f05134ac7: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19212::DEBUG::2011-01-18 19:57:56,903::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19212::DEBUG::2011-01-18 19:57:56,903::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19212::DEBUG::2011-01-18 19:57:56,904::task::577::irs::Task 6991300c-1130-4d2f-a719-336f05134ac7: ref 0 aborting False Thread-19212::INFO::2011-01-18 19:57:56,904::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:57:57,311::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:57:57,843::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50007 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:57:59,856::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:00,391::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503212 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:58:01,736::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:58:01,737::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:58:01,764::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::INFO::2011-01-18 19:58:01,764::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18494::DEBUG::2011-01-18 19:58:01,765::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:58:01,766::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:58:01,769::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:58:01,773::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:58:01,777::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 19:58:01,778::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:01,779::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:58:01,809::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:58:01,811::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:01,815::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:01,822::misc::122::irs::SUCCESS: = ''; = 0 Thread-19215::INFO::2011-01-18 19:58:01,841::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19215::DEBUG::2011-01-18 19:58:01,842::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: moving from state init -> state preparing Thread-19215::DEBUG::2011-01-18 19:58:01,842::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 646b3ba5-6a36-49d0-97f2-3c92db07b8ce acquire shared (120000) Thread-19215::DEBUG::2011-01-18 19:58:01,842::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19215::DEBUG::2011-01-18 19:58:01,843::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '646b3ba5-6a36-49d0-97f2-3c92db07b8ce' Thread-19215::DEBUG::2011-01-18 19:58:01,843::resource::524::irs::Owner 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19215::DEBUG::2011-01-18 19:58:01,843::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19215::DEBUG::2011-01-18 19:58:01,844::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: ref 1 aborting False Thread-19215::DEBUG::2011-01-18 19:58:01,844::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0515630245209', 'lastCheck': 1295373481.8161421, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0485849380493', 'lastCheck': 1295373481.8124509, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0510461330414', 'lastCheck': 1295373481.820003, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0507111549377', 'lastCheck': 1295373481.827635, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0496139526367', 'lastCheck': 1295373481.7864649, 'valid': True, 'code': 0}} Thread-19215::DEBUG::2011-01-18 19:58:01,844::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: moving from state preparing -> state finished Thread-19215::DEBUG::2011-01-18 19:58:01,845::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19215::DEBUG::2011-01-18 19:58:01,845::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 646b3ba5-6a36-49d0-97f2-3c92db07b8ce releasing Thread-19215::DEBUG::2011-01-18 19:58:01,845::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19215::DEBUG::2011-01-18 19:58:01,845::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19215::DEBUG::2011-01-18 19:58:01,846::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19215::DEBUG::2011-01-18 19:58:01,846::resource::503::irs::Owner 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19215::DEBUG::2011-01-18 19:58:01,846::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19215::DEBUG::2011-01-18 19:58:01,846::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19215::DEBUG::2011-01-18 19:58:01,847::task::577::irs::Task 646b3ba5-6a36-49d0-97f2-3c92db07b8ce: ref 0 aborting False Thread-19215::INFO::2011-01-18 19:58:01,847::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0515630245209', 'lastCheck': 1295373481.8161421, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0510461330414', 'lastCheck': 1295373481.820003, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0496139526367', 'lastCheck': 1295373481.7864649, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0507111549377', 'lastCheck': 1295373481.827635, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0485849380493', 'lastCheck': 1295373481.8124509, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:58:02,406::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:02,948::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50995 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:04,962::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:05,521::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.527363 seconds, 1.9 MB/s\n'; = 0 Thread-19219::INFO::2011-01-18 19:58:06,960::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19219::DEBUG::2011-01-18 19:58:06,960::task::577::irs::Task 232c7354-bf9b-4c96-b52c-6f78ea59debd: moving from state init -> state preparing Thread-19219::DEBUG::2011-01-18 19:58:06,961::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19219::DEBUG::2011-01-18 19:58:06,993::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000588 seconds, 3.5 MB/s\n'; = 0 Thread-19219::DEBUG::2011-01-18 19:58:06,993::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000588 seconds, 3.5 MB/s'], size: 2048 Thread-19219::DEBUG::2011-01-18 19:58:06,994::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19219::DEBUG::2011-01-18 19:58:06,994::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19219::DEBUG::2011-01-18 19:58:06,995::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19219::DEBUG::2011-01-18 19:58:06,995::task::577::irs::Task 232c7354-bf9b-4c96-b52c-6f78ea59debd: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19219::DEBUG::2011-01-18 19:58:06,995::task::577::irs::Task 232c7354-bf9b-4c96-b52c-6f78ea59debd: moving from state preparing -> state finished Thread-19219::DEBUG::2011-01-18 19:58:06,996::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19219::DEBUG::2011-01-18 19:58:06,996::task::577::irs::Task 232c7354-bf9b-4c96-b52c-6f78ea59debd: ref 0 aborting False Thread-19219::INFO::2011-01-18 19:58:06,996::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19220::INFO::2011-01-18 19:58:07,004::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19220::DEBUG::2011-01-18 19:58:07,005::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: moving from state init -> state preparing Thread-19220::DEBUG::2011-01-18 19:58:07,005::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 19904488-21d5-4471-8bd7-91fc7a990f60 acquire shared (120000) Thread-19220::DEBUG::2011-01-18 19:58:07,005::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19220::DEBUG::2011-01-18 19:58:07,006::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '19904488-21d5-4471-8bd7-91fc7a990f60' Thread-19220::DEBUG::2011-01-18 19:58:07,006::resource::524::irs::Owner 19904488-21d5-4471-8bd7-91fc7a990f60: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19220::DEBUG::2011-01-18 19:58:07,006::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19220::DEBUG::2011-01-18 19:58:07,007::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: ref 1 aborting False Thread-19220::INFO::2011-01-18 19:58:07,007::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19220::DEBUG::2011-01-18 19:58:07,008::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19220::DEBUG::2011-01-18 19:58:07,008::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: moving from state preparing -> state finished Thread-19220::DEBUG::2011-01-18 19:58:07,008::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19220::DEBUG::2011-01-18 19:58:07,009::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 19904488-21d5-4471-8bd7-91fc7a990f60 releasing Thread-19220::DEBUG::2011-01-18 19:58:07,009::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19220::DEBUG::2011-01-18 19:58:07,009::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19220::DEBUG::2011-01-18 19:58:07,009::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19220::DEBUG::2011-01-18 19:58:07,010::resource::503::irs::Owner 19904488-21d5-4471-8bd7-91fc7a990f60: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19220::DEBUG::2011-01-18 19:58:07,010::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19220::DEBUG::2011-01-18 19:58:07,010::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19220::DEBUG::2011-01-18 19:58:07,011::task::577::irs::Task 19904488-21d5-4471-8bd7-91fc7a990f60: ref 0 aborting False Thread-19220::INFO::2011-01-18 19:58:07,011::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:58:07,534::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:08,067::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501118 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:10,080::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:10,614::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502519 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:58:11,785::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:58:11,786::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:58:11,812::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:58:11,813::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:58:11,816::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:58:11,817::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:58:11,820::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:58:11,821::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:58:11,825::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:58:11,827::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:58:11,828::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:58:11,853::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:58:11,859::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:11,868::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:11,874::misc::122::irs::SUCCESS: = ''; = 0 Thread-19223::INFO::2011-01-18 19:58:12,044::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19223::DEBUG::2011-01-18 19:58:12,044::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: moving from state init -> state preparing Thread-19223::DEBUG::2011-01-18 19:58:12,045::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d007b75e-7bef-4be2-b892-ee2ed57b4710 acquire shared (120000) Thread-19223::DEBUG::2011-01-18 19:58:12,045::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19223::DEBUG::2011-01-18 19:58:12,045::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd007b75e-7bef-4be2-b892-ee2ed57b4710' Thread-19223::DEBUG::2011-01-18 19:58:12,046::resource::524::irs::Owner d007b75e-7bef-4be2-b892-ee2ed57b4710: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19223::DEBUG::2011-01-18 19:58:12,046::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19223::DEBUG::2011-01-18 19:58:12,046::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: ref 1 aborting False Thread-19223::DEBUG::2011-01-18 19:58:12,047::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0485060214996', 'lastCheck': 1295373491.8644509, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0445818901062', 'lastCheck': 1295373491.856447, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0527188777924', 'lastCheck': 1295373491.8725929, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0524079799652', 'lastCheck': 1295373491.879355, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0464601516724', 'lastCheck': 1295373491.8322971, 'valid': True, 'code': 0}} Thread-19223::DEBUG::2011-01-18 19:58:12,047::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: moving from state preparing -> state finished Thread-19223::DEBUG::2011-01-18 19:58:12,047::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19223::DEBUG::2011-01-18 19:58:12,048::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d007b75e-7bef-4be2-b892-ee2ed57b4710 releasing Thread-19223::DEBUG::2011-01-18 19:58:12,048::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19223::DEBUG::2011-01-18 19:58:12,048::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19223::DEBUG::2011-01-18 19:58:12,048::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19223::DEBUG::2011-01-18 19:58:12,049::resource::503::irs::Owner d007b75e-7bef-4be2-b892-ee2ed57b4710: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19223::DEBUG::2011-01-18 19:58:12,049::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19223::DEBUG::2011-01-18 19:58:12,049::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19223::DEBUG::2011-01-18 19:58:12,050::task::577::irs::Task d007b75e-7bef-4be2-b892-ee2ed57b4710: ref 0 aborting False Thread-19223::INFO::2011-01-18 19:58:12,050::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0485060214996', 'lastCheck': 1295373491.8644509, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0527188777924', 'lastCheck': 1295373491.8725929, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0464601516724', 'lastCheck': 1295373491.8322971, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0524079799652', 'lastCheck': 1295373491.879355, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0445818901062', 'lastCheck': 1295373491.856447, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:58:12,626::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:13,169::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510639 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:15,179::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:15,713::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501811 seconds, 2.0 MB/s\n'; = 0 Thread-19227::INFO::2011-01-18 19:58:17,064::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19227::DEBUG::2011-01-18 19:58:17,064::task::577::irs::Task 1c6e5a51-78c2-4dc7-bdf4-1568696bd816: moving from state init -> state preparing Thread-19227::DEBUG::2011-01-18 19:58:17,065::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19227::DEBUG::2011-01-18 19:58:17,096::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000409 seconds, 5.0 MB/s\n'; = 0 Thread-19227::DEBUG::2011-01-18 19:58:17,097::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000409 seconds, 5.0 MB/s'], size: 2048 Thread-19227::DEBUG::2011-01-18 19:58:17,097::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19227::DEBUG::2011-01-18 19:58:17,097::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19227::DEBUG::2011-01-18 19:58:17,098::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19227::DEBUG::2011-01-18 19:58:17,098::task::577::irs::Task 1c6e5a51-78c2-4dc7-bdf4-1568696bd816: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19227::DEBUG::2011-01-18 19:58:17,099::task::577::irs::Task 1c6e5a51-78c2-4dc7-bdf4-1568696bd816: moving from state preparing -> state finished Thread-19227::DEBUG::2011-01-18 19:58:17,099::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19227::DEBUG::2011-01-18 19:58:17,099::task::577::irs::Task 1c6e5a51-78c2-4dc7-bdf4-1568696bd816: ref 0 aborting False Thread-19227::INFO::2011-01-18 19:58:17,100::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19228::INFO::2011-01-18 19:58:17,108::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19228::DEBUG::2011-01-18 19:58:17,108::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: moving from state init -> state preparing Thread-19228::DEBUG::2011-01-18 19:58:17,109::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 583bef49-0e32-46c2-a4d3-b7ef71ed5f73 acquire shared (120000) Thread-19228::DEBUG::2011-01-18 19:58:17,109::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19228::DEBUG::2011-01-18 19:58:17,109::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '583bef49-0e32-46c2-a4d3-b7ef71ed5f73' Thread-19228::DEBUG::2011-01-18 19:58:17,109::resource::524::irs::Owner 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19228::DEBUG::2011-01-18 19:58:17,110::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19228::DEBUG::2011-01-18 19:58:17,110::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: ref 1 aborting False Thread-19228::INFO::2011-01-18 19:58:17,111::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19228::DEBUG::2011-01-18 19:58:17,111::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19228::DEBUG::2011-01-18 19:58:17,112::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: moving from state preparing -> state finished Thread-19228::DEBUG::2011-01-18 19:58:17,112::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19228::DEBUG::2011-01-18 19:58:17,112::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 583bef49-0e32-46c2-a4d3-b7ef71ed5f73 releasing Thread-19228::DEBUG::2011-01-18 19:58:17,112::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19228::DEBUG::2011-01-18 19:58:17,113::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19228::DEBUG::2011-01-18 19:58:17,113::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19228::DEBUG::2011-01-18 19:58:17,113::resource::503::irs::Owner 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19228::DEBUG::2011-01-18 19:58:17,114::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19228::DEBUG::2011-01-18 19:58:17,114::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19228::DEBUG::2011-01-18 19:58:17,114::task::577::irs::Task 583bef49-0e32-46c2-a4d3-b7ef71ed5f73: ref 0 aborting False Thread-19228::INFO::2011-01-18 19:58:17,114::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:58:17,726::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:18,260::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50111 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:20,274::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:20,809::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502035 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:58:21,831::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:58:21,832::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:58:21,856::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:58:21,857::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:58:21,864::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:58:21,865::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:58:21,872::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::DEBUG::2011-01-18 19:58:21,872::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:21,873::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:58:21,879::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:58:21,880::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:58:21,896::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:58:21,904::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:21,914::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:21,922::misc::122::irs::SUCCESS: = ''; = 0 Thread-19231::INFO::2011-01-18 19:58:22,209::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19231::DEBUG::2011-01-18 19:58:22,209::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: moving from state init -> state preparing Thread-19231::DEBUG::2011-01-18 19:58:22,210::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c5a54596-f7f6-4876-9a4c-c81112c10cf0 acquire shared (120000) Thread-19231::DEBUG::2011-01-18 19:58:22,210::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19231::DEBUG::2011-01-18 19:58:22,210::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c5a54596-f7f6-4876-9a4c-c81112c10cf0' Thread-19231::DEBUG::2011-01-18 19:58:22,211::resource::524::irs::Owner c5a54596-f7f6-4876-9a4c-c81112c10cf0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19231::DEBUG::2011-01-18 19:58:22,211::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19231::DEBUG::2011-01-18 19:58:22,211::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: ref 1 aborting False Thread-19231::DEBUG::2011-01-18 19:58:22,211::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452721118927', 'lastCheck': 1295373501.909126, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0441098213196', 'lastCheck': 1295373501.8999679, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0468049049377', 'lastCheck': 1295373501.9187429, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0483040809631', 'lastCheck': 1295373501.927181, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0490880012512', 'lastCheck': 1295373501.880928, 'valid': True, 'code': 0}} Thread-19231::DEBUG::2011-01-18 19:58:22,212::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: moving from state preparing -> state finished Thread-19231::DEBUG::2011-01-18 19:58:22,212::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19231::DEBUG::2011-01-18 19:58:22,212::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c5a54596-f7f6-4876-9a4c-c81112c10cf0 releasing Thread-19231::DEBUG::2011-01-18 19:58:22,213::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19231::DEBUG::2011-01-18 19:58:22,213::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19231::DEBUG::2011-01-18 19:58:22,213::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19231::DEBUG::2011-01-18 19:58:22,213::resource::503::irs::Owner c5a54596-f7f6-4876-9a4c-c81112c10cf0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19231::DEBUG::2011-01-18 19:58:22,214::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19231::DEBUG::2011-01-18 19:58:22,214::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19231::DEBUG::2011-01-18 19:58:22,214::task::577::irs::Task c5a54596-f7f6-4876-9a4c-c81112c10cf0: ref 0 aborting False Thread-19231::INFO::2011-01-18 19:58:22,215::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452721118927', 'lastCheck': 1295373501.909126, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0468049049377', 'lastCheck': 1295373501.9187429, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0490880012512', 'lastCheck': 1295373501.880928, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0483040809631', 'lastCheck': 1295373501.927181, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0441098213196', 'lastCheck': 1295373501.8999679, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:58:22,823::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:23,365::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510106 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:25,376::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:25,911::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502237 seconds, 2.0 MB/s\n'; = 0 Thread-19235::INFO::2011-01-18 19:58:27,168::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19235::DEBUG::2011-01-18 19:58:27,168::task::577::irs::Task 692e2e94-a55d-446d-b68b-6390e5b42b83: moving from state init -> state preparing Thread-19235::DEBUG::2011-01-18 19:58:27,169::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19235::DEBUG::2011-01-18 19:58:27,200::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00046 seconds, 4.5 MB/s\n'; = 0 Thread-19235::DEBUG::2011-01-18 19:58:27,201::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00046 seconds, 4.5 MB/s'], size: 2048 Thread-19235::DEBUG::2011-01-18 19:58:27,201::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19235::DEBUG::2011-01-18 19:58:27,202::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19235::DEBUG::2011-01-18 19:58:27,202::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19235::DEBUG::2011-01-18 19:58:27,203::task::577::irs::Task 692e2e94-a55d-446d-b68b-6390e5b42b83: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19235::DEBUG::2011-01-18 19:58:27,203::task::577::irs::Task 692e2e94-a55d-446d-b68b-6390e5b42b83: moving from state preparing -> state finished Thread-19235::DEBUG::2011-01-18 19:58:27,203::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19235::DEBUG::2011-01-18 19:58:27,204::task::577::irs::Task 692e2e94-a55d-446d-b68b-6390e5b42b83: ref 0 aborting False Thread-19235::INFO::2011-01-18 19:58:27,204::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19236::INFO::2011-01-18 19:58:27,213::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19236::DEBUG::2011-01-18 19:58:27,213::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: moving from state init -> state preparing Thread-19236::DEBUG::2011-01-18 19:58:27,213::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 666fb74f-f875-4a7d-87cb-ae6d381d85ae acquire shared (120000) Thread-19236::DEBUG::2011-01-18 19:58:27,214::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19236::DEBUG::2011-01-18 19:58:27,214::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '666fb74f-f875-4a7d-87cb-ae6d381d85ae' Thread-19236::DEBUG::2011-01-18 19:58:27,214::resource::524::irs::Owner 666fb74f-f875-4a7d-87cb-ae6d381d85ae: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19236::DEBUG::2011-01-18 19:58:27,214::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19236::DEBUG::2011-01-18 19:58:27,215::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: ref 1 aborting False Thread-19236::INFO::2011-01-18 19:58:27,215::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19236::DEBUG::2011-01-18 19:58:27,216::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19236::DEBUG::2011-01-18 19:58:27,216::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: moving from state preparing -> state finished Thread-19236::DEBUG::2011-01-18 19:58:27,217::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19236::DEBUG::2011-01-18 19:58:27,217::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 666fb74f-f875-4a7d-87cb-ae6d381d85ae releasing Thread-19236::DEBUG::2011-01-18 19:58:27,217::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19236::DEBUG::2011-01-18 19:58:27,217::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19236::DEBUG::2011-01-18 19:58:27,218::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19236::DEBUG::2011-01-18 19:58:27,218::resource::503::irs::Owner 666fb74f-f875-4a7d-87cb-ae6d381d85ae: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19236::DEBUG::2011-01-18 19:58:27,218::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19236::DEBUG::2011-01-18 19:58:27,218::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19236::DEBUG::2011-01-18 19:58:27,219::task::577::irs::Task 666fb74f-f875-4a7d-87cb-ae6d381d85ae: ref 0 aborting False Thread-19236::INFO::2011-01-18 19:58:27,219::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:58:27,925::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:28,457::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500673 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:30,469::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:31,002::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501527 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:58:31,880::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:58:31,881::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:58:31,900::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:58:31,901::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:58:31,909::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:58:31,910::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:58:31,922::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::INFO::2011-01-18 19:58:31,925::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:58:31,925::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:58:31,929::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:58:31,931::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:58:31,942::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:58:31,957::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:31,971::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:31,972::misc::122::irs::SUCCESS: = ''; = 0 Thread-19239::INFO::2011-01-18 19:58:32,379::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19239::DEBUG::2011-01-18 19:58:32,379::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: moving from state init -> state preparing Thread-19239::DEBUG::2011-01-18 19:58:32,379::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ae5c7735-74bc-415f-9e2c-2a20d291cccc acquire shared (120000) Thread-19239::DEBUG::2011-01-18 19:58:32,380::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19239::DEBUG::2011-01-18 19:58:32,380::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ae5c7735-74bc-415f-9e2c-2a20d291cccc' Thread-19239::DEBUG::2011-01-18 19:58:32,380::resource::524::irs::Owner ae5c7735-74bc-415f-9e2c-2a20d291cccc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19239::DEBUG::2011-01-18 19:58:32,380::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19239::DEBUG::2011-01-18 19:58:32,381::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: ref 1 aborting False Thread-19239::DEBUG::2011-01-18 19:58:32,381::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.052924156189', 'lastCheck': 1295373511.961796, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047908782959', 'lastCheck': 1295373511.9478159, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.051285982132', 'lastCheck': 1295373511.9761491, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0473721027374', 'lastCheck': 1295373511.97631, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0495300292969', 'lastCheck': 1295373511.930371, 'valid': True, 'code': 0}} Thread-19239::DEBUG::2011-01-18 19:58:32,382::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: moving from state preparing -> state finished Thread-19239::DEBUG::2011-01-18 19:58:32,382::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19239::DEBUG::2011-01-18 19:58:32,382::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ae5c7735-74bc-415f-9e2c-2a20d291cccc releasing Thread-19239::DEBUG::2011-01-18 19:58:32,382::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19239::DEBUG::2011-01-18 19:58:32,383::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19239::DEBUG::2011-01-18 19:58:32,383::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19239::DEBUG::2011-01-18 19:58:32,383::resource::503::irs::Owner ae5c7735-74bc-415f-9e2c-2a20d291cccc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19239::DEBUG::2011-01-18 19:58:32,383::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19239::DEBUG::2011-01-18 19:58:32,384::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19239::DEBUG::2011-01-18 19:58:32,384::task::577::irs::Task ae5c7735-74bc-415f-9e2c-2a20d291cccc: ref 0 aborting False Thread-19239::INFO::2011-01-18 19:58:32,384::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.052924156189', 'lastCheck': 1295373511.961796, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.051285982132', 'lastCheck': 1295373511.9761491, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0495300292969', 'lastCheck': 1295373511.930371, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0473721027374', 'lastCheck': 1295373511.97631, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047908782959', 'lastCheck': 1295373511.9478159, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:58:33,016::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:33,548::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500307 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:35,561::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:36,104::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511305 seconds, 2.0 MB/s\n'; = 0 Thread-19243::INFO::2011-01-18 19:58:37,271::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19243::DEBUG::2011-01-18 19:58:37,272::task::577::irs::Task 5a0cb3f8-21d9-48f1-8bcd-6eb0bd3be312: moving from state init -> state preparing Thread-19243::DEBUG::2011-01-18 19:58:37,272::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19243::DEBUG::2011-01-18 19:58:37,304::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000462 seconds, 4.4 MB/s\n'; = 0 Thread-19243::DEBUG::2011-01-18 19:58:37,304::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000462 seconds, 4.4 MB/s'], size: 2048 Thread-19243::DEBUG::2011-01-18 19:58:37,305::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19243::DEBUG::2011-01-18 19:58:37,305::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19243::DEBUG::2011-01-18 19:58:37,306::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19243::DEBUG::2011-01-18 19:58:37,306::task::577::irs::Task 5a0cb3f8-21d9-48f1-8bcd-6eb0bd3be312: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19243::DEBUG::2011-01-18 19:58:37,306::task::577::irs::Task 5a0cb3f8-21d9-48f1-8bcd-6eb0bd3be312: moving from state preparing -> state finished Thread-19243::DEBUG::2011-01-18 19:58:37,307::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19243::DEBUG::2011-01-18 19:58:37,307::task::577::irs::Task 5a0cb3f8-21d9-48f1-8bcd-6eb0bd3be312: ref 0 aborting False Thread-19243::INFO::2011-01-18 19:58:37,307::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19244::INFO::2011-01-18 19:58:37,316::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19244::DEBUG::2011-01-18 19:58:37,316::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: moving from state init -> state preparing Thread-19244::DEBUG::2011-01-18 19:58:37,316::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 600253c0-2333-4ae5-b343-75b534cb6d23 acquire shared (120000) Thread-19244::DEBUG::2011-01-18 19:58:37,317::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19244::DEBUG::2011-01-18 19:58:37,317::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '600253c0-2333-4ae5-b343-75b534cb6d23' Thread-19244::DEBUG::2011-01-18 19:58:37,317::resource::524::irs::Owner 600253c0-2333-4ae5-b343-75b534cb6d23: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19244::DEBUG::2011-01-18 19:58:37,318::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19244::DEBUG::2011-01-18 19:58:37,318::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: ref 1 aborting False Thread-19244::INFO::2011-01-18 19:58:37,318::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19244::DEBUG::2011-01-18 19:58:37,319::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19244::DEBUG::2011-01-18 19:58:37,319::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: moving from state preparing -> state finished Thread-19244::DEBUG::2011-01-18 19:58:37,320::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19244::DEBUG::2011-01-18 19:58:37,320::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 600253c0-2333-4ae5-b343-75b534cb6d23 releasing Thread-19244::DEBUG::2011-01-18 19:58:37,320::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19244::DEBUG::2011-01-18 19:58:37,320::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19244::DEBUG::2011-01-18 19:58:37,321::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19244::DEBUG::2011-01-18 19:58:37,321::resource::503::irs::Owner 600253c0-2333-4ae5-b343-75b534cb6d23: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19244::DEBUG::2011-01-18 19:58:37,321::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19244::DEBUG::2011-01-18 19:58:37,322::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19244::DEBUG::2011-01-18 19:58:37,322::task::577::irs::Task 600253c0-2333-4ae5-b343-75b534cb6d23: ref 0 aborting False Thread-19244::INFO::2011-01-18 19:58:37,322::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:58:38,118::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:38,650::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501035 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:40,664::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:41,197::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501256 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:58:41,929::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:58:41,930::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:58:41,948::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:58:41,949::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:58:41,962::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:58:41,963::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:58:41,970::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:58:41,976::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:58:41,977::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:58:41,979::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:58:41,980::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:58:41,991::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:58:42,003::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:42,017::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:42,019::misc::122::irs::SUCCESS: = ''; = 0 Thread-19247::INFO::2011-01-18 19:58:42,549::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19247::DEBUG::2011-01-18 19:58:42,549::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: moving from state init -> state preparing Thread-19247::DEBUG::2011-01-18 19:58:42,549::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0c514de2-5b86-41b4-bc20-d83b51194a9c acquire shared (120000) Thread-19247::DEBUG::2011-01-18 19:58:42,550::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19247::DEBUG::2011-01-18 19:58:42,550::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0c514de2-5b86-41b4-bc20-d83b51194a9c' Thread-19247::DEBUG::2011-01-18 19:58:42,550::resource::524::irs::Owner 0c514de2-5b86-41b4-bc20-d83b51194a9c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19247::DEBUG::2011-01-18 19:58:42,551::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19247::DEBUG::2011-01-18 19:58:42,551::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: ref 1 aborting False Thread-19247::DEBUG::2011-01-18 19:58:42,551::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450689792633', 'lastCheck': 1295373522.006952, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0486700534821', 'lastCheck': 1295373521.996618, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0454521179199', 'lastCheck': 1295373522.024636, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0467050075531', 'lastCheck': 1295373522.0226109, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0457711219788', 'lastCheck': 1295373521.97561, 'valid': True, 'code': 0}} Thread-19247::DEBUG::2011-01-18 19:58:42,552::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: moving from state preparing -> state finished Thread-19247::DEBUG::2011-01-18 19:58:42,552::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19247::DEBUG::2011-01-18 19:58:42,552::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0c514de2-5b86-41b4-bc20-d83b51194a9c releasing Thread-19247::DEBUG::2011-01-18 19:58:42,552::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19247::DEBUG::2011-01-18 19:58:42,553::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19247::DEBUG::2011-01-18 19:58:42,553::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19247::DEBUG::2011-01-18 19:58:42,553::resource::503::irs::Owner 0c514de2-5b86-41b4-bc20-d83b51194a9c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19247::DEBUG::2011-01-18 19:58:42,554::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19247::DEBUG::2011-01-18 19:58:42,554::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19247::DEBUG::2011-01-18 19:58:42,554::task::577::irs::Task 0c514de2-5b86-41b4-bc20-d83b51194a9c: ref 0 aborting False Thread-19247::INFO::2011-01-18 19:58:42,554::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450689792633', 'lastCheck': 1295373522.006952, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0454521179199', 'lastCheck': 1295373522.024636, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0457711219788', 'lastCheck': 1295373521.97561, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0467050075531', 'lastCheck': 1295373522.0226109, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0486700534821', 'lastCheck': 1295373521.996618, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:58:43,209::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:43,743::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500888 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:45,756::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:46,299::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510905 seconds, 2.0 MB/s\n'; = 0 Thread-19251::INFO::2011-01-18 19:58:47,376::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19251::DEBUG::2011-01-18 19:58:47,376::task::577::irs::Task 79dfdb35-d421-450b-ac06-563f42813e1d: moving from state init -> state preparing Thread-19251::DEBUG::2011-01-18 19:58:47,377::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19251::DEBUG::2011-01-18 19:58:47,408::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000399 seconds, 5.1 MB/s\n'; = 0 Thread-19251::DEBUG::2011-01-18 19:58:47,409::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000399 seconds, 5.1 MB/s'], size: 2048 Thread-19251::DEBUG::2011-01-18 19:58:47,409::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19251::DEBUG::2011-01-18 19:58:47,410::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19251::DEBUG::2011-01-18 19:58:47,410::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19251::DEBUG::2011-01-18 19:58:47,411::task::577::irs::Task 79dfdb35-d421-450b-ac06-563f42813e1d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19251::DEBUG::2011-01-18 19:58:47,411::task::577::irs::Task 79dfdb35-d421-450b-ac06-563f42813e1d: moving from state preparing -> state finished Thread-19251::DEBUG::2011-01-18 19:58:47,411::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19251::DEBUG::2011-01-18 19:58:47,412::task::577::irs::Task 79dfdb35-d421-450b-ac06-563f42813e1d: ref 0 aborting False Thread-19251::INFO::2011-01-18 19:58:47,412::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19252::INFO::2011-01-18 19:58:47,420::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19252::DEBUG::2011-01-18 19:58:47,421::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: moving from state init -> state preparing Thread-19252::DEBUG::2011-01-18 19:58:47,421::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c64eb4d-13f1-44bc-9791-610003b1b836 acquire shared (120000) Thread-19252::DEBUG::2011-01-18 19:58:47,422::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19252::DEBUG::2011-01-18 19:58:47,422::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1c64eb4d-13f1-44bc-9791-610003b1b836' Thread-19252::DEBUG::2011-01-18 19:58:47,422::resource::524::irs::Owner 1c64eb4d-13f1-44bc-9791-610003b1b836: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19252::DEBUG::2011-01-18 19:58:47,422::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19252::DEBUG::2011-01-18 19:58:47,423::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: ref 1 aborting False Thread-19252::INFO::2011-01-18 19:58:47,423::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19252::DEBUG::2011-01-18 19:58:47,424::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19252::DEBUG::2011-01-18 19:58:47,424::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: moving from state preparing -> state finished Thread-19252::DEBUG::2011-01-18 19:58:47,424::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19252::DEBUG::2011-01-18 19:58:47,425::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1c64eb4d-13f1-44bc-9791-610003b1b836 releasing Thread-19252::DEBUG::2011-01-18 19:58:47,425::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19252::DEBUG::2011-01-18 19:58:47,425::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19252::DEBUG::2011-01-18 19:58:47,426::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19252::DEBUG::2011-01-18 19:58:47,426::resource::503::irs::Owner 1c64eb4d-13f1-44bc-9791-610003b1b836: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19252::DEBUG::2011-01-18 19:58:47,426::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19252::DEBUG::2011-01-18 19:58:47,426::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19252::DEBUG::2011-01-18 19:58:47,427::task::577::irs::Task 1c64eb4d-13f1-44bc-9791-610003b1b836: ref 0 aborting False Thread-19252::INFO::2011-01-18 19:58:47,427::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:58:48,313::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:48,848::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503271 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:50,861::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:51,395::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501684 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:58:51,974::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:58:51,975::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:58:51,996::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:58:51,997::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:58:52,007::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:58:52,008::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:58:52,015::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:58:52,021::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:58:52,022::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:58:52,024::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:58:52,025::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:58:52,038::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:58:52,049::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:58:52,061::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:58:52,066::misc::122::irs::SUCCESS: = ''; = 0 Thread-19255::INFO::2011-01-18 19:58:52,715::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19255::DEBUG::2011-01-18 19:58:52,716::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: moving from state init -> state preparing Thread-19255::DEBUG::2011-01-18 19:58:52,716::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4ec97395-f4e7-4839-8187-8358981f0e83 acquire shared (120000) Thread-19255::DEBUG::2011-01-18 19:58:52,716::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19255::DEBUG::2011-01-18 19:58:52,717::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4ec97395-f4e7-4839-8187-8358981f0e83' Thread-19255::DEBUG::2011-01-18 19:58:52,717::resource::524::irs::Owner 4ec97395-f4e7-4839-8187-8358981f0e83: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19255::DEBUG::2011-01-18 19:58:52,717::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19255::DEBUG::2011-01-18 19:58:52,717::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: ref 1 aborting False Thread-19255::DEBUG::2011-01-18 19:58:52,718::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0454440116882', 'lastCheck': 1295373532.05232, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0482861995697', 'lastCheck': 1295373532.0441501, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0471038818359', 'lastCheck': 1295373532.0715599, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0448129177094', 'lastCheck': 1295373532.066705, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0459570884705', 'lastCheck': 1295373532.0207911, 'valid': True, 'code': 0}} Thread-19255::DEBUG::2011-01-18 19:58:52,718::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: moving from state preparing -> state finished Thread-19255::DEBUG::2011-01-18 19:58:52,718::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19255::DEBUG::2011-01-18 19:58:52,719::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4ec97395-f4e7-4839-8187-8358981f0e83 releasing Thread-19255::DEBUG::2011-01-18 19:58:52,719::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19255::DEBUG::2011-01-18 19:58:52,719::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19255::DEBUG::2011-01-18 19:58:52,720::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19255::DEBUG::2011-01-18 19:58:52,720::resource::503::irs::Owner 4ec97395-f4e7-4839-8187-8358981f0e83: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19255::DEBUG::2011-01-18 19:58:52,720::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19255::DEBUG::2011-01-18 19:58:52,720::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19255::DEBUG::2011-01-18 19:58:52,721::task::577::irs::Task 4ec97395-f4e7-4839-8187-8358981f0e83: ref 0 aborting False Thread-19255::INFO::2011-01-18 19:58:52,721::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0454440116882', 'lastCheck': 1295373532.05232, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0471038818359', 'lastCheck': 1295373532.0715599, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0459570884705', 'lastCheck': 1295373532.0207911, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0448129177094', 'lastCheck': 1295373532.066705, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0482861995697', 'lastCheck': 1295373532.0441501, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:58:53,408::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:53,940::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500721 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:58:55,953::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:56,496::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511275 seconds, 2.0 MB/s\n'; = 0 Thread-19259::INFO::2011-01-18 19:58:57,479::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19259::DEBUG::2011-01-18 19:58:57,479::task::577::irs::Task dd330d19-d9b8-4776-813c-d187bd619506: moving from state init -> state preparing Thread-19259::DEBUG::2011-01-18 19:58:57,480::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19259::DEBUG::2011-01-18 19:58:57,511::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000429 seconds, 4.8 MB/s\n'; = 0 Thread-19259::DEBUG::2011-01-18 19:58:57,512::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000429 seconds, 4.8 MB/s'], size: 2048 Thread-19259::DEBUG::2011-01-18 19:58:57,512::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19259::DEBUG::2011-01-18 19:58:57,513::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19259::DEBUG::2011-01-18 19:58:57,513::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19259::DEBUG::2011-01-18 19:58:57,514::task::577::irs::Task dd330d19-d9b8-4776-813c-d187bd619506: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19259::DEBUG::2011-01-18 19:58:57,514::task::577::irs::Task dd330d19-d9b8-4776-813c-d187bd619506: moving from state preparing -> state finished Thread-19259::DEBUG::2011-01-18 19:58:57,514::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19259::DEBUG::2011-01-18 19:58:57,515::task::577::irs::Task dd330d19-d9b8-4776-813c-d187bd619506: ref 0 aborting False Thread-19259::INFO::2011-01-18 19:58:57,515::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19260::INFO::2011-01-18 19:58:57,524::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19260::DEBUG::2011-01-18 19:58:57,524::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: moving from state init -> state preparing Thread-19260::DEBUG::2011-01-18 19:58:57,524::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4dac5d33-c988-48b6-b433-d7e52c0e5e96 acquire shared (120000) Thread-19260::DEBUG::2011-01-18 19:58:57,525::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19260::DEBUG::2011-01-18 19:58:57,525::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4dac5d33-c988-48b6-b433-d7e52c0e5e96' Thread-19260::DEBUG::2011-01-18 19:58:57,525::resource::524::irs::Owner 4dac5d33-c988-48b6-b433-d7e52c0e5e96: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19260::DEBUG::2011-01-18 19:58:57,525::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19260::DEBUG::2011-01-18 19:58:57,526::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: ref 1 aborting False Thread-19260::INFO::2011-01-18 19:58:57,526::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19260::DEBUG::2011-01-18 19:58:57,527::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19260::DEBUG::2011-01-18 19:58:57,527::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: moving from state preparing -> state finished Thread-19260::DEBUG::2011-01-18 19:58:57,528::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19260::DEBUG::2011-01-18 19:58:57,528::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4dac5d33-c988-48b6-b433-d7e52c0e5e96 releasing Thread-19260::DEBUG::2011-01-18 19:58:57,528::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19260::DEBUG::2011-01-18 19:58:57,528::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19260::DEBUG::2011-01-18 19:58:57,529::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19260::DEBUG::2011-01-18 19:58:57,529::resource::503::irs::Owner 4dac5d33-c988-48b6-b433-d7e52c0e5e96: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19260::DEBUG::2011-01-18 19:58:57,529::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19260::DEBUG::2011-01-18 19:58:57,529::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19260::DEBUG::2011-01-18 19:58:57,530::task::577::irs::Task 4dac5d33-c988-48b6-b433-d7e52c0e5e96: ref 0 aborting False Thread-19260::INFO::2011-01-18 19:58:57,530::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:58:58,510::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:58:59,045::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503194 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:01,058::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:01,593::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502343 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 19:59:02,020::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:59:02,021::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:59:02,044::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:59:02,045::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 19:59:02,054::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:59:02,055::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:59:02,066::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:59:02,067::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:59:02,071::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:59:02,072::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 19:59:02,228::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:59:02,228::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 19:59:02,228::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:59:02,229::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:59:02,229::misc::122::irs::SUCCESS: = ''; = 0 Thread-19263::INFO::2011-01-18 19:59:02,880::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19263::DEBUG::2011-01-18 19:59:02,880::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: moving from state init -> state preparing Thread-19263::DEBUG::2011-01-18 19:59:02,881::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6 acquire shared (120000) Thread-19263::DEBUG::2011-01-18 19:59:02,881::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19263::DEBUG::2011-01-18 19:59:02,881::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '56ecfc9e-ab43-48d9-8bb9-8577deedb1d6' Thread-19263::DEBUG::2011-01-18 19:59:02,882::resource::524::irs::Owner 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19263::DEBUG::2011-01-18 19:59:02,882::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19263::DEBUG::2011-01-18 19:59:02,882::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: ref 1 aborting False Thread-19263::DEBUG::2011-01-18 19:59:02,882::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.184430837631', 'lastCheck': 1295373542.2384629, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.192481040955', 'lastCheck': 1295373542.2363491, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.167861938477', 'lastCheck': 1295373542.2387459, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.171192884445', 'lastCheck': 1295373542.2370989, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.216387987137', 'lastCheck': 1295373542.237237, 'valid': True, 'code': 0}} Thread-19263::DEBUG::2011-01-18 19:59:02,883::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: moving from state preparing -> state finished Thread-19263::DEBUG::2011-01-18 19:59:02,883::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19263::DEBUG::2011-01-18 19:59:02,883::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6 releasing Thread-19263::DEBUG::2011-01-18 19:59:02,884::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19263::DEBUG::2011-01-18 19:59:02,884::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19263::DEBUG::2011-01-18 19:59:02,884::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19263::DEBUG::2011-01-18 19:59:02,885::resource::503::irs::Owner 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19263::DEBUG::2011-01-18 19:59:02,885::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19263::DEBUG::2011-01-18 19:59:02,885::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19263::DEBUG::2011-01-18 19:59:02,885::task::577::irs::Task 56ecfc9e-ab43-48d9-8bb9-8577deedb1d6: ref 0 aborting False Thread-19263::INFO::2011-01-18 19:59:02,886::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.184430837631', 'lastCheck': 1295373542.2384629, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.167861938477', 'lastCheck': 1295373542.2387459, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.216387987137', 'lastCheck': 1295373542.237237, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.171192884445', 'lastCheck': 1295373542.2370989, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.192481040955', 'lastCheck': 1295373542.2363491, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:59:03,606::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:04,138::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500522 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:06,152::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:06,695::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51072 seconds, 2.0 MB/s\n'; = 0 Thread-19267::INFO::2011-01-18 19:59:07,583::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19267::DEBUG::2011-01-18 19:59:07,583::task::577::irs::Task 8923d4e0-1628-478d-aa4d-791b8a46ba33: moving from state init -> state preparing Thread-19267::DEBUG::2011-01-18 19:59:07,584::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19267::DEBUG::2011-01-18 19:59:07,616::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000864 seconds, 2.4 MB/s\n'; = 0 Thread-19267::DEBUG::2011-01-18 19:59:07,616::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000864 seconds, 2.4 MB/s'], size: 2048 Thread-19267::DEBUG::2011-01-18 19:59:07,617::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19267::DEBUG::2011-01-18 19:59:07,617::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19267::DEBUG::2011-01-18 19:59:07,618::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19267::DEBUG::2011-01-18 19:59:07,618::task::577::irs::Task 8923d4e0-1628-478d-aa4d-791b8a46ba33: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19267::DEBUG::2011-01-18 19:59:07,618::task::577::irs::Task 8923d4e0-1628-478d-aa4d-791b8a46ba33: moving from state preparing -> state finished Thread-19267::DEBUG::2011-01-18 19:59:07,619::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19267::DEBUG::2011-01-18 19:59:07,619::task::577::irs::Task 8923d4e0-1628-478d-aa4d-791b8a46ba33: ref 0 aborting False Thread-19267::INFO::2011-01-18 19:59:07,619::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19268::INFO::2011-01-18 19:59:07,627::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19268::DEBUG::2011-01-18 19:59:07,627::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: moving from state init -> state preparing Thread-19268::DEBUG::2011-01-18 19:59:07,628::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0b4d778-f91a-4f94-9e2c-a641333222d9 acquire shared (120000) Thread-19268::DEBUG::2011-01-18 19:59:07,628::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19268::DEBUG::2011-01-18 19:59:07,628::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c0b4d778-f91a-4f94-9e2c-a641333222d9' Thread-19268::DEBUG::2011-01-18 19:59:07,629::resource::524::irs::Owner c0b4d778-f91a-4f94-9e2c-a641333222d9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19268::DEBUG::2011-01-18 19:59:07,629::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19268::DEBUG::2011-01-18 19:59:07,629::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: ref 1 aborting False Thread-19268::INFO::2011-01-18 19:59:07,630::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19268::DEBUG::2011-01-18 19:59:07,631::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19268::DEBUG::2011-01-18 19:59:07,632::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: moving from state preparing -> state finished Thread-19268::DEBUG::2011-01-18 19:59:07,632::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19268::DEBUG::2011-01-18 19:59:07,632::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c0b4d778-f91a-4f94-9e2c-a641333222d9 releasing Thread-19268::DEBUG::2011-01-18 19:59:07,632::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19268::DEBUG::2011-01-18 19:59:07,633::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19268::DEBUG::2011-01-18 19:59:07,633::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19268::DEBUG::2011-01-18 19:59:07,633::resource::503::irs::Owner c0b4d778-f91a-4f94-9e2c-a641333222d9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19268::DEBUG::2011-01-18 19:59:07,634::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19268::DEBUG::2011-01-18 19:59:07,634::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19268::DEBUG::2011-01-18 19:59:07,634::task::577::irs::Task c0b4d778-f91a-4f94-9e2c-a641333222d9: ref 0 aborting False Thread-19268::INFO::2011-01-18 19:59:07,634::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:59:08,707::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:09,239::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500245 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:11,251::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:11,785::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501969 seconds, 2.0 MB/s\n'; = 0 Thread-18494::INFO::2011-01-18 19:59:12,235::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:59:12,236::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:59:12,236::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::INFO::2011-01-18 19:59:12,237::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18493::INFO::2011-01-18 19:59:12,239::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::INFO::2011-01-18 19:59:12,239::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18496::DEBUG::2011-01-18 19:59:12,240::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 19:59:12,241::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:59:12,242::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:59:12,243::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:59:12,276::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:59:12,278::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata count=1' (cwd None) Thread-18497::DEBUG::2011-01-18 19:59:12,285::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:59:12,286::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:59:12,287::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata count=1' (cwd None) Thread-18493::DEBUG::2011-01-18 19:59:12,288::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:59:12,291::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata count=1' (cwd None) Thread-18495::DEBUG::2011-01-18 19:59:12,291::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:59:12,315::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000882 seconds, 2.3 MB/s\n'; = 0 Thread-18494::DEBUG::2011-01-18 19:59:12,316::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000882 seconds, 2.3 MB/s'], size: 2048 Thread-18494::DEBUG::2011-01-18 19:59:12,316::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=None', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE0,uuid:JhuxXz-oY2f-VTKM-jZw1-vjeb-1yfc-4DEMhe,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE1,uuid:3aUVw3-VXRN-GbIT-jnEQ-RmUc-Kqcf-cj2Q3x,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE2,uuid:OFmc1C-VUM2-UeEr-4PaC-e2G4-YjTo-0aIgd3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE3,uuid:kyzPWM-1lW2-zYaO-2BIR-W66P-XrsG-fpehsp,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE4,uuid:EacnTZ-z822-xe9v-9t6A-1u3S-t96k-bOlSQM,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE5,uuid:N8Yas4-g1Rl-y3qt-Zb1d-t4ty-y8Iv-5LxYUR,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE6,uuid:aAF0AR-v83k-qND9-ZwAN-3p89-o9p0-rAF1zi,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE7,uuid:Qf3LTH-Ai55-3Lp0-FKFJ-zmfX-yyf8-yEyqIf,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=zSkJHd-z2vi-SfdH-OmXK-HHD2-HSSF-I7j139', 'MASTER_VERSION=0', '_SHA_CKSUM=6ac9d8deed2c8198ad87a15fde0e9be690649fe9'] Thread-18494::DEBUG::2011-01-18 19:59:12,317::metadata::89::irs::metadata.__validate() __cksum(md) = 6ac9d8deed2c8198ad87a15fde0e9be690649fe9 Thread-18497::DEBUG::2011-01-18 19:59:12,320::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00087 seconds, 2.4 MB/s\n'; = 0 Thread-18496::DEBUG::2011-01-18 19:59:12,325::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000899 seconds, 2.3 MB/s\n'; = 0 Thread-18497::DEBUG::2011-01-18 19:59:12,345::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00087 seconds, 2.4 MB/s'], size: 2048 Thread-18496::DEBUG::2011-01-18 19:59:12,346::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000899 seconds, 2.3 MB/s'], size: 2048 Thread-18497::DEBUG::2011-01-18 19:59:12,346::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_4', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE25,uuid:oT9Njr-43C6-OFn2-Pb1m-OHmv-q1ko-qWVZfU,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE24,uuid:zAhT6X-lhHA-0tpM-y8Ir-qdYz-cToH-QS34Qd,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE26,uuid:iai1Ih-p3aO-aJfa-m0Vu-bbUI-Bzmt-faQpU3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE27,uuid:Po2nTz-ZVf1-9CUn-XrvV-KFvh-bVc0-0UlRfc,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE28,uuid:7RfWRw-dleE-FJGk-unwH-mCIt-vjvO-cFlwEV,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE29,uuid:o0eNOA-eXTU-lOuo-1pOl-S9Kc-t3SS-qmqoxq,pestart:0,pecount:95,mapoffset:475', 'ROLE=Regular', 'SDUUID=d36e088c-e33f-41c9-9799-60f27d683f24', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=Rg9Ok4-Ts62-7x69-dnoq-vXMJ-1kxr-7V4hzD', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=506390723e870e52d768c8a93509b36b71d536b4'] Thread-18496::DEBUG::2011-01-18 19:59:12,346::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_5', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE30,uuid:6OMUem-Ea8u-ePsj-ZtiI-PS2g-9lar-vDE1yw,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE31,uuid:rp1dI7-UPsb-ZzJX-eptN-usNA-7bhM-O2aeC0,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE32,uuid:REuolt-m2qg-IguX-yQ6Q-a88i-QbOk-KfxuNR,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE33,uuid:auCyUI-Qzi4-nPej-g5ji-3O7c-PNdD-YSr4HX,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE34,uuid:nxQIzE-gINr-2WGk-fBFz-xWdc-VKpc-0AkgEu,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE35,uuid:9rYRaB-6vqa-jeNi-8d70-Olyy-x5FR-Sfd9rm,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE36,uuid:aj40O1-nJLf-RfMK-vPfA-zy3M-CGZP-gFOulR,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE37,uuid:vCUrIv-sXPe-09Ze-EYzV-cj0C-67iG-ukcW5V,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=YlGdeL-gaDB-Es97-ogbJ-3LdW-crm3-jWw9cH', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=f0ac78701aec46eb830881e3c6db5e3fa21ea53c'] Thread-18497::DEBUG::2011-01-18 19:59:12,347::metadata::89::irs::metadata.__validate() __cksum(md) = 506390723e870e52d768c8a93509b36b71d536b4 Thread-18496::DEBUG::2011-01-18 19:59:12,347::metadata::89::irs::metadata.__validate() __cksum(md) = f0ac78701aec46eb830881e3c6db5e3fa21ea53c Thread-19271::INFO::2011-01-18 19:59:13,065::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19271::DEBUG::2011-01-18 19:59:13,065::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: moving from state init -> state preparing Thread-19271::DEBUG::2011-01-18 19:59:13,066::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: afae7878-9810-4574-a6ef-99faf0938a46 acquire shared (120000) Thread-19271::DEBUG::2011-01-18 19:59:13,066::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19271::DEBUG::2011-01-18 19:59:13,066::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'afae7878-9810-4574-a6ef-99faf0938a46' Thread-19271::DEBUG::2011-01-18 19:59:13,066::resource::524::irs::Owner afae7878-9810-4574-a6ef-99faf0938a46: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19271::DEBUG::2011-01-18 19:59:13,067::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19271::DEBUG::2011-01-18 19:59:13,067::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: ref 1 aborting False Thread-19271::DEBUG::2011-01-18 19:59:13,067::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0591509342194', 'lastCheck': 1295373552.298496, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.113224983215', 'lastCheck': 1295373552.3490779, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0609049797058', 'lastCheck': 1295373552.3006971, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.116561889648', 'lastCheck': 1295373552.353482, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.114216089249', 'lastCheck': 1295373552.3514431, 'valid': True, 'code': 0}} Thread-19271::DEBUG::2011-01-18 19:59:13,068::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: moving from state preparing -> state finished Thread-19271::DEBUG::2011-01-18 19:59:13,068::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19271::DEBUG::2011-01-18 19:59:13,068::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: afae7878-9810-4574-a6ef-99faf0938a46 releasing Thread-19271::DEBUG::2011-01-18 19:59:13,069::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19271::DEBUG::2011-01-18 19:59:13,069::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19271::DEBUG::2011-01-18 19:59:13,069::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19271::DEBUG::2011-01-18 19:59:13,069::resource::503::irs::Owner afae7878-9810-4574-a6ef-99faf0938a46: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19271::DEBUG::2011-01-18 19:59:13,070::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19271::DEBUG::2011-01-18 19:59:13,070::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19271::DEBUG::2011-01-18 19:59:13,070::task::577::irs::Task afae7878-9810-4574-a6ef-99faf0938a46: ref 0 aborting False Thread-19271::INFO::2011-01-18 19:59:13,071::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0591509342194', 'lastCheck': 1295373552.298496, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0609049797058', 'lastCheck': 1295373552.3006971, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.114216089249', 'lastCheck': 1295373552.3514431, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.116561889648', 'lastCheck': 1295373552.353482, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.113224983215', 'lastCheck': 1295373552.3490779, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:59:13,798::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:14,332::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50222 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:16,347::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:16,891::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512292 seconds, 2.0 MB/s\n'; = 0 Thread-19275::INFO::2011-01-18 19:59:17,689::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19275::DEBUG::2011-01-18 19:59:17,689::task::577::irs::Task c0dd1c00-0b24-425d-b990-fa5d1efad44f: moving from state init -> state preparing Thread-19275::DEBUG::2011-01-18 19:59:17,690::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19275::DEBUG::2011-01-18 19:59:17,721::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00043 seconds, 4.8 MB/s\n'; = 0 Thread-19275::DEBUG::2011-01-18 19:59:17,722::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00043 seconds, 4.8 MB/s'], size: 2048 Thread-19275::DEBUG::2011-01-18 19:59:17,722::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19275::DEBUG::2011-01-18 19:59:17,723::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19275::DEBUG::2011-01-18 19:59:17,723::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19275::DEBUG::2011-01-18 19:59:17,724::task::577::irs::Task c0dd1c00-0b24-425d-b990-fa5d1efad44f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19275::DEBUG::2011-01-18 19:59:17,724::task::577::irs::Task c0dd1c00-0b24-425d-b990-fa5d1efad44f: moving from state preparing -> state finished Thread-19275::DEBUG::2011-01-18 19:59:17,724::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19275::DEBUG::2011-01-18 19:59:17,724::task::577::irs::Task c0dd1c00-0b24-425d-b990-fa5d1efad44f: ref 0 aborting False Thread-19275::INFO::2011-01-18 19:59:17,725::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19276::INFO::2011-01-18 19:59:17,733::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19276::DEBUG::2011-01-18 19:59:17,733::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: moving from state init -> state preparing Thread-19276::DEBUG::2011-01-18 19:59:17,734::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a4769fbb-2f70-4ba1-8432-7d2f4b2445d7 acquire shared (120000) Thread-19276::DEBUG::2011-01-18 19:59:17,734::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19276::DEBUG::2011-01-18 19:59:17,734::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a4769fbb-2f70-4ba1-8432-7d2f4b2445d7' Thread-19276::DEBUG::2011-01-18 19:59:17,735::resource::524::irs::Owner a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19276::DEBUG::2011-01-18 19:59:17,735::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19276::DEBUG::2011-01-18 19:59:17,735::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: ref 1 aborting False Thread-19276::INFO::2011-01-18 19:59:17,736::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19276::DEBUG::2011-01-18 19:59:17,736::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19276::DEBUG::2011-01-18 19:59:17,737::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: moving from state preparing -> state finished Thread-19276::DEBUG::2011-01-18 19:59:17,737::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19276::DEBUG::2011-01-18 19:59:17,737::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a4769fbb-2f70-4ba1-8432-7d2f4b2445d7 releasing Thread-19276::DEBUG::2011-01-18 19:59:17,738::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19276::DEBUG::2011-01-18 19:59:17,738::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19276::DEBUG::2011-01-18 19:59:17,738::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19276::DEBUG::2011-01-18 19:59:17,738::resource::503::irs::Owner a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19276::DEBUG::2011-01-18 19:59:17,739::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19276::DEBUG::2011-01-18 19:59:17,739::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19276::DEBUG::2011-01-18 19:59:17,739::task::577::irs::Task a4769fbb-2f70-4ba1-8432-7d2f4b2445d7: ref 0 aborting False Thread-19276::INFO::2011-01-18 19:59:17,740::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:59:18,904::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:19,437::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500544 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:21,449::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:21,984::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502329 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:59:22,297::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:59:22,298::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:59:22,301::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:59:22,303::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:59:22,340::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:59:22,342::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:59:22,348::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:59:22,349::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:59:22,352::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::INFO::2011-01-18 19:59:22,353::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 19:59:22,355::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 19:59:22,355::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:59:22,389::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:59:22,397::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:59:22,398::misc::122::irs::SUCCESS: = ''; = 0 Thread-19279::INFO::2011-01-18 19:59:23,256::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19279::DEBUG::2011-01-18 19:59:23,257::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: moving from state init -> state preparing Thread-19279::DEBUG::2011-01-18 19:59:23,257::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7b3ae93b-6d9c-4b05-8c59-c71a2223015f acquire shared (120000) Thread-19279::DEBUG::2011-01-18 19:59:23,257::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19279::DEBUG::2011-01-18 19:59:23,258::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '7b3ae93b-6d9c-4b05-8c59-c71a2223015f' Thread-19279::DEBUG::2011-01-18 19:59:23,258::resource::524::irs::Owner 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19279::DEBUG::2011-01-18 19:59:23,258::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19279::DEBUG::2011-01-18 19:59:23,259::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: ref 1 aborting False Thread-19279::DEBUG::2011-01-18 19:59:23,259::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0469648838043', 'lastCheck': 1295373562.344811, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.044410943985', 'lastCheck': 1295373562.3932559, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0466952323914', 'lastCheck': 1295373562.3478751, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0495898723602', 'lastCheck': 1295373562.402849, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0479910373688', 'lastCheck': 1295373562.4002991, 'valid': True, 'code': 0}} Thread-19279::DEBUG::2011-01-18 19:59:23,259::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: moving from state preparing -> state finished Thread-19279::DEBUG::2011-01-18 19:59:23,260::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19279::DEBUG::2011-01-18 19:59:23,260::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7b3ae93b-6d9c-4b05-8c59-c71a2223015f releasing Thread-19279::DEBUG::2011-01-18 19:59:23,260::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19279::DEBUG::2011-01-18 19:59:23,260::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19279::DEBUG::2011-01-18 19:59:23,261::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19279::DEBUG::2011-01-18 19:59:23,261::resource::503::irs::Owner 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19279::DEBUG::2011-01-18 19:59:23,261::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19279::DEBUG::2011-01-18 19:59:23,262::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19279::DEBUG::2011-01-18 19:59:23,262::task::577::irs::Task 7b3ae93b-6d9c-4b05-8c59-c71a2223015f: ref 0 aborting False Thread-19279::INFO::2011-01-18 19:59:23,262::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0469648838043', 'lastCheck': 1295373562.344811, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0466952323914', 'lastCheck': 1295373562.3478751, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0479910373688', 'lastCheck': 1295373562.4002991, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0495898723602', 'lastCheck': 1295373562.402849, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.044410943985', 'lastCheck': 1295373562.3932559, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:59:24,000::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:24,534::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502889 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:26,549::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:27,099::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.517719 seconds, 2.0 MB/s\n'; = 0 Thread-19283::INFO::2011-01-18 19:59:27,791::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19283::DEBUG::2011-01-18 19:59:27,792::task::577::irs::Task 09f6e5be-f692-4ebe-a209-36d43374ddaa: moving from state init -> state preparing Thread-19283::DEBUG::2011-01-18 19:59:27,792::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19283::DEBUG::2011-01-18 19:59:27,824::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000444 seconds, 4.6 MB/s\n'; = 0 Thread-19283::DEBUG::2011-01-18 19:59:27,824::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000444 seconds, 4.6 MB/s'], size: 2048 Thread-19283::DEBUG::2011-01-18 19:59:27,825::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19283::DEBUG::2011-01-18 19:59:27,825::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19283::DEBUG::2011-01-18 19:59:27,826::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19283::DEBUG::2011-01-18 19:59:27,826::task::577::irs::Task 09f6e5be-f692-4ebe-a209-36d43374ddaa: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19283::DEBUG::2011-01-18 19:59:27,826::task::577::irs::Task 09f6e5be-f692-4ebe-a209-36d43374ddaa: moving from state preparing -> state finished Thread-19283::DEBUG::2011-01-18 19:59:27,827::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19283::DEBUG::2011-01-18 19:59:27,827::task::577::irs::Task 09f6e5be-f692-4ebe-a209-36d43374ddaa: ref 0 aborting False Thread-19283::INFO::2011-01-18 19:59:27,827::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19284::INFO::2011-01-18 19:59:27,835::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19284::DEBUG::2011-01-18 19:59:27,835::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: moving from state init -> state preparing Thread-19284::DEBUG::2011-01-18 19:59:27,835::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1d9260bc-32be-486d-9361-4a7e91990c29 acquire shared (120000) Thread-19284::DEBUG::2011-01-18 19:59:27,836::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19284::DEBUG::2011-01-18 19:59:27,836::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1d9260bc-32be-486d-9361-4a7e91990c29' Thread-19284::DEBUG::2011-01-18 19:59:27,836::resource::524::irs::Owner 1d9260bc-32be-486d-9361-4a7e91990c29: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19284::DEBUG::2011-01-18 19:59:27,836::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19284::DEBUG::2011-01-18 19:59:27,837::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: ref 1 aborting False Thread-19284::INFO::2011-01-18 19:59:27,837::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19284::DEBUG::2011-01-18 19:59:27,838::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19284::DEBUG::2011-01-18 19:59:27,838::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: moving from state preparing -> state finished Thread-19284::DEBUG::2011-01-18 19:59:27,839::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19284::DEBUG::2011-01-18 19:59:27,839::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1d9260bc-32be-486d-9361-4a7e91990c29 releasing Thread-19284::DEBUG::2011-01-18 19:59:27,839::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19284::DEBUG::2011-01-18 19:59:27,839::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19284::DEBUG::2011-01-18 19:59:27,840::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19284::DEBUG::2011-01-18 19:59:27,840::resource::503::irs::Owner 1d9260bc-32be-486d-9361-4a7e91990c29: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19284::DEBUG::2011-01-18 19:59:27,840::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19284::DEBUG::2011-01-18 19:59:27,841::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19284::DEBUG::2011-01-18 19:59:27,841::task::577::irs::Task 1d9260bc-32be-486d-9361-4a7e91990c29: ref 0 aborting False Thread-19284::INFO::2011-01-18 19:59:27,841::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:59:29,112::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:29,644::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500599 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:31,656::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:32,191::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50274 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 19:59:32,344::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:59:32,345::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:59:32,348::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:59:32,349::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:59:32,385::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 19:59:32,387::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:59:32,392::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:59:32,393::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:59:32,400::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:59:32,401::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:59:32,404::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:59:32,406::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:59:32,433::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:59:32,442::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:59:32,449::misc::122::irs::SUCCESS: = ''; = 0 Thread-19287::INFO::2011-01-18 19:59:33,419::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19287::DEBUG::2011-01-18 19:59:33,419::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: moving from state init -> state preparing Thread-19287::DEBUG::2011-01-18 19:59:33,420::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 84021719-48d4-48a2-8aa1-36b604849481 acquire shared (120000) Thread-19287::DEBUG::2011-01-18 19:59:33,420::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19287::DEBUG::2011-01-18 19:59:33,420::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '84021719-48d4-48a2-8aa1-36b604849481' Thread-19287::DEBUG::2011-01-18 19:59:33,421::resource::524::irs::Owner 84021719-48d4-48a2-8aa1-36b604849481: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19287::DEBUG::2011-01-18 19:59:33,421::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19287::DEBUG::2011-01-18 19:59:33,421::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: ref 1 aborting False Thread-19287::DEBUG::2011-01-18 19:59:33,421::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0459001064301', 'lastCheck': 1295373572.3907571, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.045334815979', 'lastCheck': 1295373572.4382329, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0449738502502', 'lastCheck': 1295373572.3928559, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0496349334717', 'lastCheck': 1295373572.453656, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0461258888245', 'lastCheck': 1295373572.4460039, 'valid': True, 'code': 0}} Thread-19287::DEBUG::2011-01-18 19:59:33,422::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: moving from state preparing -> state finished Thread-19287::DEBUG::2011-01-18 19:59:33,422::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19287::DEBUG::2011-01-18 19:59:33,422::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 84021719-48d4-48a2-8aa1-36b604849481 releasing Thread-19287::DEBUG::2011-01-18 19:59:33,423::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19287::DEBUG::2011-01-18 19:59:33,423::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19287::DEBUG::2011-01-18 19:59:33,423::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19287::DEBUG::2011-01-18 19:59:33,424::resource::503::irs::Owner 84021719-48d4-48a2-8aa1-36b604849481: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19287::DEBUG::2011-01-18 19:59:33,424::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19287::DEBUG::2011-01-18 19:59:33,424::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19287::DEBUG::2011-01-18 19:59:33,424::task::577::irs::Task 84021719-48d4-48a2-8aa1-36b604849481: ref 0 aborting False Thread-19287::INFO::2011-01-18 19:59:33,425::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0459001064301', 'lastCheck': 1295373572.3907571, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0449738502502', 'lastCheck': 1295373572.3928559, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0461258888245', 'lastCheck': 1295373572.4460039, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0496349334717', 'lastCheck': 1295373572.453656, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.045334815979', 'lastCheck': 1295373572.4382329, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:59:34,203::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:34,737::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502472 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:36,751::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:37,294::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510813 seconds, 2.0 MB/s\n'; = 0 Thread-19291::INFO::2011-01-18 19:59:37,896::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19291::DEBUG::2011-01-18 19:59:37,897::task::577::irs::Task 11608ae1-b679-4ed2-915d-ca046ca82b7a: moving from state init -> state preparing Thread-19291::DEBUG::2011-01-18 19:59:37,897::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19291::DEBUG::2011-01-18 19:59:37,929::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s\n'; = 0 Thread-19291::DEBUG::2011-01-18 19:59:37,929::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s'], size: 2048 Thread-19291::DEBUG::2011-01-18 19:59:37,930::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19291::DEBUG::2011-01-18 19:59:37,930::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19291::DEBUG::2011-01-18 19:59:37,931::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19291::DEBUG::2011-01-18 19:59:37,931::task::577::irs::Task 11608ae1-b679-4ed2-915d-ca046ca82b7a: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19291::DEBUG::2011-01-18 19:59:37,931::task::577::irs::Task 11608ae1-b679-4ed2-915d-ca046ca82b7a: moving from state preparing -> state finished Thread-19291::DEBUG::2011-01-18 19:59:37,932::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19291::DEBUG::2011-01-18 19:59:37,932::task::577::irs::Task 11608ae1-b679-4ed2-915d-ca046ca82b7a: ref 0 aborting False Thread-19291::INFO::2011-01-18 19:59:37,932::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19292::INFO::2011-01-18 19:59:37,940::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19292::DEBUG::2011-01-18 19:59:37,941::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: moving from state init -> state preparing Thread-19292::DEBUG::2011-01-18 19:59:37,941::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fdf0813c-9224-4edc-a168-0416e8fa65ad acquire shared (120000) Thread-19292::DEBUG::2011-01-18 19:59:37,941::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19292::DEBUG::2011-01-18 19:59:37,942::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fdf0813c-9224-4edc-a168-0416e8fa65ad' Thread-19292::DEBUG::2011-01-18 19:59:37,942::resource::524::irs::Owner fdf0813c-9224-4edc-a168-0416e8fa65ad: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19292::DEBUG::2011-01-18 19:59:37,942::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19292::DEBUG::2011-01-18 19:59:37,942::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: ref 1 aborting False Thread-19292::INFO::2011-01-18 19:59:37,943::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19292::DEBUG::2011-01-18 19:59:37,944::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19292::DEBUG::2011-01-18 19:59:37,944::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: moving from state preparing -> state finished Thread-19292::DEBUG::2011-01-18 19:59:37,944::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19292::DEBUG::2011-01-18 19:59:37,944::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fdf0813c-9224-4edc-a168-0416e8fa65ad releasing Thread-19292::DEBUG::2011-01-18 19:59:37,945::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19292::DEBUG::2011-01-18 19:59:37,945::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19292::DEBUG::2011-01-18 19:59:37,945::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19292::DEBUG::2011-01-18 19:59:37,946::resource::503::irs::Owner fdf0813c-9224-4edc-a168-0416e8fa65ad: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19292::DEBUG::2011-01-18 19:59:37,946::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19292::DEBUG::2011-01-18 19:59:37,946::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19292::DEBUG::2011-01-18 19:59:37,946::task::577::irs::Task fdf0813c-9224-4edc-a168-0416e8fa65ad: ref 0 aborting False Thread-19292::INFO::2011-01-18 19:59:37,947::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:59:39,307::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:39,841::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501758 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:41,856::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:59:42,390::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:59:42,390::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:59:42,393::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Dummy-18546::DEBUG::2011-01-18 19:59:42,394::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503627 seconds, 2.0 MB/s\n'; = 0 Thread-18495::DEBUG::2011-01-18 19:59:42,395::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 19:59:42,433::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 19:59:42,437::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 19:59:42,438::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:59:42,444::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 19:59:42,445::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:59:42,446::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 19:59:42,453::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:59:42,454::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:59:42,482::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:59:42,486::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:59:42,498::misc::122::irs::SUCCESS: = ''; = 0 Thread-19295::INFO::2011-01-18 19:59:43,581::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19295::DEBUG::2011-01-18 19:59:43,582::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: moving from state init -> state preparing Thread-19295::DEBUG::2011-01-18 19:59:43,582::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 57b02dcd-c162-4d64-b264-ef07e0b273ca acquire shared (120000) Thread-19295::DEBUG::2011-01-18 19:59:43,582::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19295::DEBUG::2011-01-18 19:59:43,583::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '57b02dcd-c162-4d64-b264-ef07e0b273ca' Thread-19295::DEBUG::2011-01-18 19:59:43,583::resource::524::irs::Owner 57b02dcd-c162-4d64-b264-ef07e0b273ca: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19295::DEBUG::2011-01-18 19:59:43,583::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19295::DEBUG::2011-01-18 19:59:43,584::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: ref 1 aborting False Thread-19295::DEBUG::2011-01-18 19:59:43,584::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0493369102478', 'lastCheck': 1295373582.4391949, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0488369464874', 'lastCheck': 1295373582.486727, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0565409660339', 'lastCheck': 1295373582.4501359, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0500681400299', 'lastCheck': 1295373582.5029471, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0443520545959', 'lastCheck': 1295373582.4902151, 'valid': True, 'code': 0}} Thread-19295::DEBUG::2011-01-18 19:59:43,584::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: moving from state preparing -> state finished Thread-19295::DEBUG::2011-01-18 19:59:43,585::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19295::DEBUG::2011-01-18 19:59:43,585::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 57b02dcd-c162-4d64-b264-ef07e0b273ca releasing Thread-19295::DEBUG::2011-01-18 19:59:43,585::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19295::DEBUG::2011-01-18 19:59:43,585::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19295::DEBUG::2011-01-18 19:59:43,586::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19295::DEBUG::2011-01-18 19:59:43,586::resource::503::irs::Owner 57b02dcd-c162-4d64-b264-ef07e0b273ca: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19295::DEBUG::2011-01-18 19:59:43,586::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19295::DEBUG::2011-01-18 19:59:43,587::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19295::DEBUG::2011-01-18 19:59:43,587::task::577::irs::Task 57b02dcd-c162-4d64-b264-ef07e0b273ca: ref 0 aborting False Thread-19295::INFO::2011-01-18 19:59:43,587::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0493369102478', 'lastCheck': 1295373582.4391949, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0565409660339', 'lastCheck': 1295373582.4501359, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0443520545959', 'lastCheck': 1295373582.4902151, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0500681400299', 'lastCheck': 1295373582.5029471, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0488369464874', 'lastCheck': 1295373582.486727, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:59:44,412::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:44,945::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501115 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:46,959::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:47,503::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512876 seconds, 2.0 MB/s\n'; = 0 Thread-19299::INFO::2011-01-18 19:59:48,000::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19299::DEBUG::2011-01-18 19:59:48,000::task::577::irs::Task ff599bb0-ff09-495c-b8ab-575bbf895cf0: moving from state init -> state preparing Thread-19299::DEBUG::2011-01-18 19:59:48,001::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19299::DEBUG::2011-01-18 19:59:48,033::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000441 seconds, 4.6 MB/s\n'; = 0 Thread-19299::DEBUG::2011-01-18 19:59:48,033::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000441 seconds, 4.6 MB/s'], size: 2048 Thread-19299::DEBUG::2011-01-18 19:59:48,034::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19299::DEBUG::2011-01-18 19:59:48,034::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19299::DEBUG::2011-01-18 19:59:48,035::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19299::DEBUG::2011-01-18 19:59:48,035::task::577::irs::Task ff599bb0-ff09-495c-b8ab-575bbf895cf0: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19299::DEBUG::2011-01-18 19:59:48,035::task::577::irs::Task ff599bb0-ff09-495c-b8ab-575bbf895cf0: moving from state preparing -> state finished Thread-19299::DEBUG::2011-01-18 19:59:48,036::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19299::DEBUG::2011-01-18 19:59:48,036::task::577::irs::Task ff599bb0-ff09-495c-b8ab-575bbf895cf0: ref 0 aborting False Thread-19299::INFO::2011-01-18 19:59:48,036::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19300::INFO::2011-01-18 19:59:48,044::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19300::DEBUG::2011-01-18 19:59:48,044::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: moving from state init -> state preparing Thread-19300::DEBUG::2011-01-18 19:59:48,045::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 39153607-d3fb-43ca-9d68-1ce98f04dca1 acquire shared (120000) Thread-19300::DEBUG::2011-01-18 19:59:48,045::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19300::DEBUG::2011-01-18 19:59:48,045::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '39153607-d3fb-43ca-9d68-1ce98f04dca1' Thread-19300::DEBUG::2011-01-18 19:59:48,046::resource::524::irs::Owner 39153607-d3fb-43ca-9d68-1ce98f04dca1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19300::DEBUG::2011-01-18 19:59:48,046::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19300::DEBUG::2011-01-18 19:59:48,046::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: ref 1 aborting False Thread-19300::INFO::2011-01-18 19:59:48,047::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19300::DEBUG::2011-01-18 19:59:48,047::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19300::DEBUG::2011-01-18 19:59:48,048::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: moving from state preparing -> state finished Thread-19300::DEBUG::2011-01-18 19:59:48,048::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19300::DEBUG::2011-01-18 19:59:48,048::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 39153607-d3fb-43ca-9d68-1ce98f04dca1 releasing Thread-19300::DEBUG::2011-01-18 19:59:48,049::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19300::DEBUG::2011-01-18 19:59:48,049::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19300::DEBUG::2011-01-18 19:59:48,049::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19300::DEBUG::2011-01-18 19:59:48,049::resource::503::irs::Owner 39153607-d3fb-43ca-9d68-1ce98f04dca1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19300::DEBUG::2011-01-18 19:59:48,050::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19300::DEBUG::2011-01-18 19:59:48,050::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19300::DEBUG::2011-01-18 19:59:48,050::task::577::irs::Task 39153607-d3fb-43ca-9d68-1ce98f04dca1: ref 0 aborting False Thread-19300::INFO::2011-01-18 19:59:48,051::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:59:49,518::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:50,051::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501458 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:52,065::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 19:59:52,439::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 19:59:52,440::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 19:59:52,450::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 19:59:52,451::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 19:59:52,486::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::DEBUG::2011-01-18 19:59:52,485::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 19:59:52,487::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 19:59:52,490::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 19:59:52,492::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 19:59:52,495::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 19:59:52,502::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 19:59:52,504::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 19:59:52,532::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 19:59:52,534::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 19:59:52,546::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:52,633::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.536019 seconds, 1.9 MB/s\n'; = 0 Thread-19303::INFO::2011-01-18 19:59:53,744::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19303::DEBUG::2011-01-18 19:59:53,744::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: moving from state init -> state preparing Thread-19303::DEBUG::2011-01-18 19:59:53,745::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3245f1d5-fa87-49ab-b83c-83c496e2fb0d acquire shared (120000) Thread-19303::DEBUG::2011-01-18 19:59:53,745::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19303::DEBUG::2011-01-18 19:59:53,745::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '3245f1d5-fa87-49ab-b83c-83c496e2fb0d' Thread-19303::DEBUG::2011-01-18 19:59:53,746::resource::524::irs::Owner 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19303::DEBUG::2011-01-18 19:59:53,746::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19303::DEBUG::2011-01-18 19:59:53,746::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: ref 1 aborting False Thread-19303::DEBUG::2011-01-18 19:59:53,747::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0560941696167', 'lastCheck': 1295373592.4949601, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.052041053772', 'lastCheck': 1295373592.5380161, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0522480010986', 'lastCheck': 1295373592.502115, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477669239044', 'lastCheck': 1295373592.550627, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0484690666199', 'lastCheck': 1295373592.5386, 'valid': True, 'code': 0}} Thread-19303::DEBUG::2011-01-18 19:59:53,747::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: moving from state preparing -> state finished Thread-19303::DEBUG::2011-01-18 19:59:53,747::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19303::DEBUG::2011-01-18 19:59:53,748::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3245f1d5-fa87-49ab-b83c-83c496e2fb0d releasing Thread-19303::DEBUG::2011-01-18 19:59:53,748::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19303::DEBUG::2011-01-18 19:59:53,748::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19303::DEBUG::2011-01-18 19:59:53,748::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19303::DEBUG::2011-01-18 19:59:53,749::resource::503::irs::Owner 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19303::DEBUG::2011-01-18 19:59:53,749::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19303::DEBUG::2011-01-18 19:59:53,749::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19303::DEBUG::2011-01-18 19:59:53,749::task::577::irs::Task 3245f1d5-fa87-49ab-b83c-83c496e2fb0d: ref 0 aborting False Thread-19303::INFO::2011-01-18 19:59:53,750::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0560941696167', 'lastCheck': 1295373592.4949601, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0522480010986', 'lastCheck': 1295373592.502115, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0484690666199', 'lastCheck': 1295373592.5386, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477669239044', 'lastCheck': 1295373592.550627, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.052041053772', 'lastCheck': 1295373592.5380161, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 19:59:54,652::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:55,185::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500721 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 19:59:57,198::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 19:59:57,742::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512415 seconds, 2.0 MB/s\n'; = 0 Thread-19307::INFO::2011-01-18 19:59:58,104::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19307::DEBUG::2011-01-18 19:59:58,104::task::577::irs::Task 84228751-36f1-4a0e-bf2b-a01f2d399b1c: moving from state init -> state preparing Thread-19307::DEBUG::2011-01-18 19:59:58,105::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19307::DEBUG::2011-01-18 19:59:58,136::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000439 seconds, 4.7 MB/s\n'; = 0 Thread-19307::DEBUG::2011-01-18 19:59:58,137::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000439 seconds, 4.7 MB/s'], size: 2048 Thread-19307::DEBUG::2011-01-18 19:59:58,137::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19307::DEBUG::2011-01-18 19:59:58,138::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19307::DEBUG::2011-01-18 19:59:58,138::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19307::DEBUG::2011-01-18 19:59:58,138::task::577::irs::Task 84228751-36f1-4a0e-bf2b-a01f2d399b1c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19307::DEBUG::2011-01-18 19:59:58,139::task::577::irs::Task 84228751-36f1-4a0e-bf2b-a01f2d399b1c: moving from state preparing -> state finished Thread-19307::DEBUG::2011-01-18 19:59:58,139::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19307::DEBUG::2011-01-18 19:59:58,139::task::577::irs::Task 84228751-36f1-4a0e-bf2b-a01f2d399b1c: ref 0 aborting False Thread-19307::INFO::2011-01-18 19:59:58,140::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19308::INFO::2011-01-18 19:59:58,147::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19308::DEBUG::2011-01-18 19:59:58,147::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: moving from state init -> state preparing Thread-19308::DEBUG::2011-01-18 19:59:58,148::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 364020d1-0ee8-4a04-acc4-ad796b066878 acquire shared (120000) Thread-19308::DEBUG::2011-01-18 19:59:58,148::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19308::DEBUG::2011-01-18 19:59:58,148::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '364020d1-0ee8-4a04-acc4-ad796b066878' Thread-19308::DEBUG::2011-01-18 19:59:58,149::resource::524::irs::Owner 364020d1-0ee8-4a04-acc4-ad796b066878: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19308::DEBUG::2011-01-18 19:59:58,149::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19308::DEBUG::2011-01-18 19:59:58,149::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: ref 1 aborting False Thread-19308::INFO::2011-01-18 19:59:58,150::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19308::DEBUG::2011-01-18 19:59:58,150::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19308::DEBUG::2011-01-18 19:59:58,151::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: moving from state preparing -> state finished Thread-19308::DEBUG::2011-01-18 19:59:58,151::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19308::DEBUG::2011-01-18 19:59:58,151::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 364020d1-0ee8-4a04-acc4-ad796b066878 releasing Thread-19308::DEBUG::2011-01-18 19:59:58,152::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19308::DEBUG::2011-01-18 19:59:58,152::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19308::DEBUG::2011-01-18 19:59:58,152::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19308::DEBUG::2011-01-18 19:59:58,152::resource::503::irs::Owner 364020d1-0ee8-4a04-acc4-ad796b066878: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19308::DEBUG::2011-01-18 19:59:58,153::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19308::DEBUG::2011-01-18 19:59:58,153::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19308::DEBUG::2011-01-18 19:59:58,153::task::577::irs::Task 364020d1-0ee8-4a04-acc4-ad796b066878: ref 0 aborting False Thread-19308::INFO::2011-01-18 19:59:58,154::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 19:59:59,758::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:00,291::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501069 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:02,305::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 20:00:02,495::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:00:02,496::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:00:02,502::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:00:02,503::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:00:02,538::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18494::INFO::2011-01-18 20:00:02,538::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::DEBUG::2011-01-18 20:00:02,539::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:00:02,539::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:00:02,540::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:00:02,548::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 20:00:02,550::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:00:02,551::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:00:02,586::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:00:02,587::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:02,596::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:02,867::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.529954 seconds, 1.9 MB/s\n'; = 0 Thread-19311::INFO::2011-01-18 20:00:03,907::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19311::DEBUG::2011-01-18 20:00:03,908::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: moving from state init -> state preparing Thread-19311::DEBUG::2011-01-18 20:00:03,908::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e8055105-b681-4424-8a25-6beb08a49750 acquire shared (120000) Thread-19311::DEBUG::2011-01-18 20:00:03,908::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19311::DEBUG::2011-01-18 20:00:03,908::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e8055105-b681-4424-8a25-6beb08a49750' Thread-19311::DEBUG::2011-01-18 20:00:03,909::resource::524::irs::Owner e8055105-b681-4424-8a25-6beb08a49750: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19311::DEBUG::2011-01-18 20:00:03,909::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19311::DEBUG::2011-01-18 20:00:03,909::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: ref 1 aborting False Thread-19311::DEBUG::2011-01-18 20:00:03,910::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0553548336029', 'lastCheck': 1295373602.5502069, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0544629096985', 'lastCheck': 1295373602.5929019, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0541620254517', 'lastCheck': 1295373602.5560501, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0511889457703', 'lastCheck': 1295373602.601485, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0539858341217', 'lastCheck': 1295373602.5918579, 'valid': True, 'code': 0}} Thread-19311::DEBUG::2011-01-18 20:00:03,910::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: moving from state preparing -> state finished Thread-19311::DEBUG::2011-01-18 20:00:03,910::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19311::DEBUG::2011-01-18 20:00:03,911::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e8055105-b681-4424-8a25-6beb08a49750 releasing Thread-19311::DEBUG::2011-01-18 20:00:03,911::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19311::DEBUG::2011-01-18 20:00:03,911::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19311::DEBUG::2011-01-18 20:00:03,911::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19311::DEBUG::2011-01-18 20:00:03,912::resource::503::irs::Owner e8055105-b681-4424-8a25-6beb08a49750: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19311::DEBUG::2011-01-18 20:00:03,912::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19311::DEBUG::2011-01-18 20:00:03,912::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19311::DEBUG::2011-01-18 20:00:03,913::task::577::irs::Task e8055105-b681-4424-8a25-6beb08a49750: ref 0 aborting False Thread-19311::INFO::2011-01-18 20:00:03,913::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0553548336029', 'lastCheck': 1295373602.5502069, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0541620254517', 'lastCheck': 1295373602.5560501, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0539858341217', 'lastCheck': 1295373602.5918579, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0511889457703', 'lastCheck': 1295373602.601485, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0544629096985', 'lastCheck': 1295373602.5929019, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:00:04,880::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:05,413::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500505 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:07,426::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:07,970::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512154 seconds, 2.0 MB/s\n'; = 0 Thread-19315::INFO::2011-01-18 20:00:08,206::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19315::DEBUG::2011-01-18 20:00:08,206::task::577::irs::Task 3fc3909b-2ac6-4e05-a7c8-3819ae986484: moving from state init -> state preparing Thread-19315::DEBUG::2011-01-18 20:00:08,207::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19315::DEBUG::2011-01-18 20:00:08,239::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000434 seconds, 4.7 MB/s\n'; = 0 Thread-19315::DEBUG::2011-01-18 20:00:08,239::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000434 seconds, 4.7 MB/s'], size: 2048 Thread-19315::DEBUG::2011-01-18 20:00:08,240::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19315::DEBUG::2011-01-18 20:00:08,240::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19315::DEBUG::2011-01-18 20:00:08,241::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19315::DEBUG::2011-01-18 20:00:08,241::task::577::irs::Task 3fc3909b-2ac6-4e05-a7c8-3819ae986484: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19315::DEBUG::2011-01-18 20:00:08,241::task::577::irs::Task 3fc3909b-2ac6-4e05-a7c8-3819ae986484: moving from state preparing -> state finished Thread-19315::DEBUG::2011-01-18 20:00:08,241::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19315::DEBUG::2011-01-18 20:00:08,242::task::577::irs::Task 3fc3909b-2ac6-4e05-a7c8-3819ae986484: ref 0 aborting False Thread-19315::INFO::2011-01-18 20:00:08,242::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19316::INFO::2011-01-18 20:00:08,250::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19316::DEBUG::2011-01-18 20:00:08,250::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: moving from state init -> state preparing Thread-19316::DEBUG::2011-01-18 20:00:08,251::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b8d87793-b3f7-446b-895c-f813a952885f acquire shared (120000) Thread-19316::DEBUG::2011-01-18 20:00:08,251::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19316::DEBUG::2011-01-18 20:00:08,251::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b8d87793-b3f7-446b-895c-f813a952885f' Thread-19316::DEBUG::2011-01-18 20:00:08,252::resource::524::irs::Owner b8d87793-b3f7-446b-895c-f813a952885f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19316::DEBUG::2011-01-18 20:00:08,252::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19316::DEBUG::2011-01-18 20:00:08,252::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: ref 1 aborting False Thread-19316::INFO::2011-01-18 20:00:08,253::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19316::DEBUG::2011-01-18 20:00:08,253::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19316::DEBUG::2011-01-18 20:00:08,254::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: moving from state preparing -> state finished Thread-19316::DEBUG::2011-01-18 20:00:08,254::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19316::DEBUG::2011-01-18 20:00:08,254::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b8d87793-b3f7-446b-895c-f813a952885f releasing Thread-19316::DEBUG::2011-01-18 20:00:08,255::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19316::DEBUG::2011-01-18 20:00:08,255::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19316::DEBUG::2011-01-18 20:00:08,255::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19316::DEBUG::2011-01-18 20:00:08,255::resource::503::irs::Owner b8d87793-b3f7-446b-895c-f813a952885f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19316::DEBUG::2011-01-18 20:00:08,256::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19316::DEBUG::2011-01-18 20:00:08,256::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19316::DEBUG::2011-01-18 20:00:08,256::task::577::irs::Task b8d87793-b3f7-446b-895c-f813a952885f: ref 0 aborting False Thread-19316::INFO::2011-01-18 20:00:08,257::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:00:09,983::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:10,516::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501629 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:12,528::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 20:00:12,550::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:00:12,551::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:00:12,556::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:00:12,557::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:00:12,592::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:00:12,592::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:00:12,593::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:00:12,596::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:00:12,597::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 20:00:12,601::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18495::DEBUG::2011-01-18 20:00:12,602::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:12,604::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:00:12,638::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:00:12,646::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:12,651::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:13,093::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.529094 seconds, 1.9 MB/s\n'; = 0 Thread-19319::INFO::2011-01-18 20:00:14,074::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19319::DEBUG::2011-01-18 20:00:14,075::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: moving from state init -> state preparing Thread-19319::DEBUG::2011-01-18 20:00:14,075::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f784e823-c6af-46f6-a458-d5b75a50755f acquire shared (120000) Thread-19319::DEBUG::2011-01-18 20:00:14,076::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19319::DEBUG::2011-01-18 20:00:14,076::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f784e823-c6af-46f6-a458-d5b75a50755f' Thread-19319::DEBUG::2011-01-18 20:00:14,076::resource::524::irs::Owner f784e823-c6af-46f6-a458-d5b75a50755f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19319::DEBUG::2011-01-18 20:00:14,076::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19319::DEBUG::2011-01-18 20:00:14,077::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: ref 1 aborting False Thread-19319::DEBUG::2011-01-18 20:00:14,077::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0588181018829', 'lastCheck': 1295373612.6086941, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0759110450745', 'lastCheck': 1295373612.6690249, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0577969551086', 'lastCheck': 1295373612.6136761, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0675239562988', 'lastCheck': 1295373612.668927, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0748779773712', 'lastCheck': 1295373612.6667371, 'valid': True, 'code': 0}} Thread-19319::DEBUG::2011-01-18 20:00:14,078::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: moving from state preparing -> state finished Thread-19319::DEBUG::2011-01-18 20:00:14,078::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19319::DEBUG::2011-01-18 20:00:14,078::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f784e823-c6af-46f6-a458-d5b75a50755f releasing Thread-19319::DEBUG::2011-01-18 20:00:14,078::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19319::DEBUG::2011-01-18 20:00:14,079::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19319::DEBUG::2011-01-18 20:00:14,079::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19319::DEBUG::2011-01-18 20:00:14,079::resource::503::irs::Owner f784e823-c6af-46f6-a458-d5b75a50755f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19319::DEBUG::2011-01-18 20:00:14,079::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19319::DEBUG::2011-01-18 20:00:14,080::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19319::DEBUG::2011-01-18 20:00:14,080::task::577::irs::Task f784e823-c6af-46f6-a458-d5b75a50755f: ref 0 aborting False Thread-19319::INFO::2011-01-18 20:00:14,080::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0588181018829', 'lastCheck': 1295373612.6086941, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0577969551086', 'lastCheck': 1295373612.6136761, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0748779773712', 'lastCheck': 1295373612.6667371, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0675239562988', 'lastCheck': 1295373612.668927, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0759110450745', 'lastCheck': 1295373612.6690249, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:00:15,108::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:15,640::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500579 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:17,653::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:18,198::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.513182 seconds, 2.0 MB/s\n'; = 0 Thread-19323::INFO::2011-01-18 20:00:18,309::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19323::DEBUG::2011-01-18 20:00:18,309::task::577::irs::Task 0555c8db-3c97-4c91-a552-5b6f1ae3322f: moving from state init -> state preparing Thread-19323::DEBUG::2011-01-18 20:00:18,310::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19323::DEBUG::2011-01-18 20:00:18,342::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000442 seconds, 4.6 MB/s\n'; = 0 Thread-19323::DEBUG::2011-01-18 20:00:18,343::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000442 seconds, 4.6 MB/s'], size: 2048 Thread-19323::DEBUG::2011-01-18 20:00:18,343::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19323::DEBUG::2011-01-18 20:00:18,343::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19323::DEBUG::2011-01-18 20:00:18,344::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19323::DEBUG::2011-01-18 20:00:18,344::task::577::irs::Task 0555c8db-3c97-4c91-a552-5b6f1ae3322f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19323::DEBUG::2011-01-18 20:00:18,345::task::577::irs::Task 0555c8db-3c97-4c91-a552-5b6f1ae3322f: moving from state preparing -> state finished Thread-19323::DEBUG::2011-01-18 20:00:18,345::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19323::DEBUG::2011-01-18 20:00:18,345::task::577::irs::Task 0555c8db-3c97-4c91-a552-5b6f1ae3322f: ref 0 aborting False Thread-19323::INFO::2011-01-18 20:00:18,345::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19324::INFO::2011-01-18 20:00:18,353::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19324::DEBUG::2011-01-18 20:00:18,354::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: moving from state init -> state preparing Thread-19324::DEBUG::2011-01-18 20:00:18,354::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631 acquire shared (120000) Thread-19324::DEBUG::2011-01-18 20:00:18,354::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19324::DEBUG::2011-01-18 20:00:18,355::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631' Thread-19324::DEBUG::2011-01-18 20:00:18,355::resource::524::irs::Owner 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19324::DEBUG::2011-01-18 20:00:18,355::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19324::DEBUG::2011-01-18 20:00:18,355::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: ref 1 aborting False Thread-19324::INFO::2011-01-18 20:00:18,356::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19324::DEBUG::2011-01-18 20:00:18,357::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19324::DEBUG::2011-01-18 20:00:18,357::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: moving from state preparing -> state finished Thread-19324::DEBUG::2011-01-18 20:00:18,357::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19324::DEBUG::2011-01-18 20:00:18,358::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631 releasing Thread-19324::DEBUG::2011-01-18 20:00:18,358::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19324::DEBUG::2011-01-18 20:00:18,358::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19324::DEBUG::2011-01-18 20:00:18,358::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19324::DEBUG::2011-01-18 20:00:18,359::resource::503::irs::Owner 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19324::DEBUG::2011-01-18 20:00:18,359::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19324::DEBUG::2011-01-18 20:00:18,359::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19324::DEBUG::2011-01-18 20:00:18,359::task::577::irs::Task 99b5a66e-09bf-4a4d-b52a-4cbd2e2ae631: ref 0 aborting False Thread-19324::INFO::2011-01-18 20:00:18,360::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:00:20,213::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:20,746::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501427 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:00:22,607::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:00:22,608::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:00:22,613::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:00:22,614::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:00:22,648::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:00:22,656::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 20:00:22,665::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:00:22,666::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:00:22,669::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18496::INFO::2011-01-18 20:00:22,669::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18494::DEBUG::2011-01-18 20:00:22,670::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 20:00:22,671::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:00:22,705::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:00:22,712::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:22,713::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:22,761::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:23,296::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503005 seconds, 2.0 MB/s\n'; = 0 Thread-19327::INFO::2011-01-18 20:00:24,240::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19327::DEBUG::2011-01-18 20:00:24,241::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: moving from state init -> state preparing Thread-19327::DEBUG::2011-01-18 20:00:24,241::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e3bbde75-e943-41d9-bb76-3b5841ba23d5 acquire shared (120000) Thread-19327::DEBUG::2011-01-18 20:00:24,242::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19327::DEBUG::2011-01-18 20:00:24,242::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e3bbde75-e943-41d9-bb76-3b5841ba23d5' Thread-19327::DEBUG::2011-01-18 20:00:24,242::resource::524::irs::Owner e3bbde75-e943-41d9-bb76-3b5841ba23d5: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19327::DEBUG::2011-01-18 20:00:24,242::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19327::DEBUG::2011-01-18 20:00:24,243::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: ref 1 aborting False Thread-19327::DEBUG::2011-01-18 20:00:24,243::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0458629131317', 'lastCheck': 1295373622.653697, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0465490818024', 'lastCheck': 1295373622.715467, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0494639873505', 'lastCheck': 1295373622.6623311, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484158992767', 'lastCheck': 1295373622.7180209, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0432069301605', 'lastCheck': 1295373622.7090559, 'valid': True, 'code': 0}} Thread-19327::DEBUG::2011-01-18 20:00:24,243::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: moving from state preparing -> state finished Thread-19327::DEBUG::2011-01-18 20:00:24,244::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19327::DEBUG::2011-01-18 20:00:24,244::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e3bbde75-e943-41d9-bb76-3b5841ba23d5 releasing Thread-19327::DEBUG::2011-01-18 20:00:24,244::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19327::DEBUG::2011-01-18 20:00:24,245::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19327::DEBUG::2011-01-18 20:00:24,245::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19327::DEBUG::2011-01-18 20:00:24,245::resource::503::irs::Owner e3bbde75-e943-41d9-bb76-3b5841ba23d5: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19327::DEBUG::2011-01-18 20:00:24,245::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19327::DEBUG::2011-01-18 20:00:24,246::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19327::DEBUG::2011-01-18 20:00:24,246::task::577::irs::Task e3bbde75-e943-41d9-bb76-3b5841ba23d5: ref 0 aborting False Thread-19327::INFO::2011-01-18 20:00:24,246::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0458629131317', 'lastCheck': 1295373622.653697, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0494639873505', 'lastCheck': 1295373622.6623311, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0432069301605', 'lastCheck': 1295373622.7090559, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484158992767', 'lastCheck': 1295373622.7180209, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0465490818024', 'lastCheck': 1295373622.715467, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:00:25,309::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:25,842::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500895 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:27,855::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:28,390::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503147 seconds, 2.0 MB/s\n'; = 0 Thread-19331::INFO::2011-01-18 20:00:28,413::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19331::DEBUG::2011-01-18 20:00:28,414::task::577::irs::Task ba9c5370-1493-466e-8397-8452035158ee: moving from state init -> state preparing Thread-19331::DEBUG::2011-01-18 20:00:28,414::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19331::DEBUG::2011-01-18 20:00:28,446::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000546 seconds, 3.8 MB/s\n'; = 0 Thread-19331::DEBUG::2011-01-18 20:00:28,447::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000546 seconds, 3.8 MB/s'], size: 2048 Thread-19331::DEBUG::2011-01-18 20:00:28,447::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19331::DEBUG::2011-01-18 20:00:28,447::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19331::DEBUG::2011-01-18 20:00:28,448::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19331::DEBUG::2011-01-18 20:00:28,448::task::577::irs::Task ba9c5370-1493-466e-8397-8452035158ee: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19331::DEBUG::2011-01-18 20:00:28,449::task::577::irs::Task ba9c5370-1493-466e-8397-8452035158ee: moving from state preparing -> state finished Thread-19331::DEBUG::2011-01-18 20:00:28,449::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19331::DEBUG::2011-01-18 20:00:28,449::task::577::irs::Task ba9c5370-1493-466e-8397-8452035158ee: ref 0 aborting False Thread-19331::INFO::2011-01-18 20:00:28,450::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19332::INFO::2011-01-18 20:00:28,457::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19332::DEBUG::2011-01-18 20:00:28,458::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: moving from state init -> state preparing Thread-19332::DEBUG::2011-01-18 20:00:28,458::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 653c076d-258d-4695-aa97-8cc3fb9aebfc acquire shared (120000) Thread-19332::DEBUG::2011-01-18 20:00:28,458::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19332::DEBUG::2011-01-18 20:00:28,459::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '653c076d-258d-4695-aa97-8cc3fb9aebfc' Thread-19332::DEBUG::2011-01-18 20:00:28,459::resource::524::irs::Owner 653c076d-258d-4695-aa97-8cc3fb9aebfc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19332::DEBUG::2011-01-18 20:00:28,459::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19332::DEBUG::2011-01-18 20:00:28,459::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: ref 1 aborting False Thread-19332::INFO::2011-01-18 20:00:28,460::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19332::DEBUG::2011-01-18 20:00:28,460::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19332::DEBUG::2011-01-18 20:00:28,461::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: moving from state preparing -> state finished Thread-19332::DEBUG::2011-01-18 20:00:28,461::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19332::DEBUG::2011-01-18 20:00:28,461::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 653c076d-258d-4695-aa97-8cc3fb9aebfc releasing Thread-19332::DEBUG::2011-01-18 20:00:28,462::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19332::DEBUG::2011-01-18 20:00:28,462::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19332::DEBUG::2011-01-18 20:00:28,462::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19332::DEBUG::2011-01-18 20:00:28,463::resource::503::irs::Owner 653c076d-258d-4695-aa97-8cc3fb9aebfc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19332::DEBUG::2011-01-18 20:00:28,463::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19332::DEBUG::2011-01-18 20:00:28,463::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19332::DEBUG::2011-01-18 20:00:28,463::task::577::irs::Task 653c076d-258d-4695-aa97-8cc3fb9aebfc: ref 0 aborting False Thread-19332::INFO::2011-01-18 20:00:28,464::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:00:30,403::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:30,945::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510467 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:00:32,652::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:00:32,653::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:00:32,662::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:00:32,663::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:00:32,693::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:00:32,703::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 20:00:32,708::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:00:32,709::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:00:32,715::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:00:32,716::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:00:32,718::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:00:32,720::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:00:32,751::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:00:32,758::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:32,760::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:32,957::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:33,491::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502776 seconds, 2.0 MB/s\n'; = 0 Thread-19335::INFO::2011-01-18 20:00:34,408::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19335::DEBUG::2011-01-18 20:00:34,408::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: moving from state init -> state preparing Thread-19335::DEBUG::2011-01-18 20:00:34,408::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 37575648-2c2d-4412-9b1c-fd08088ae72f acquire shared (120000) Thread-19335::DEBUG::2011-01-18 20:00:34,409::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19335::DEBUG::2011-01-18 20:00:34,409::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '37575648-2c2d-4412-9b1c-fd08088ae72f' Thread-19335::DEBUG::2011-01-18 20:00:34,409::resource::524::irs::Owner 37575648-2c2d-4412-9b1c-fd08088ae72f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19335::DEBUG::2011-01-18 20:00:34,409::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19335::DEBUG::2011-01-18 20:00:34,410::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: ref 1 aborting False Thread-19335::DEBUG::2011-01-18 20:00:34,410::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0461349487305', 'lastCheck': 1295373632.698971, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047404050827', 'lastCheck': 1295373632.7622781, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0468971729279', 'lastCheck': 1295373632.7087941, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0462779998779', 'lastCheck': 1295373632.764781, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462779998779', 'lastCheck': 1295373632.755126, 'valid': True, 'code': 0}} Thread-19335::DEBUG::2011-01-18 20:00:34,411::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: moving from state preparing -> state finished Thread-19335::DEBUG::2011-01-18 20:00:34,411::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19335::DEBUG::2011-01-18 20:00:34,411::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 37575648-2c2d-4412-9b1c-fd08088ae72f releasing Thread-19335::DEBUG::2011-01-18 20:00:34,411::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19335::DEBUG::2011-01-18 20:00:34,412::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19335::DEBUG::2011-01-18 20:00:34,412::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19335::DEBUG::2011-01-18 20:00:34,412::resource::503::irs::Owner 37575648-2c2d-4412-9b1c-fd08088ae72f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19335::DEBUG::2011-01-18 20:00:34,412::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19335::DEBUG::2011-01-18 20:00:34,413::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19335::DEBUG::2011-01-18 20:00:34,413::task::577::irs::Task 37575648-2c2d-4412-9b1c-fd08088ae72f: ref 0 aborting False Thread-19335::INFO::2011-01-18 20:00:34,413::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0461349487305', 'lastCheck': 1295373632.698971, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0468971729279', 'lastCheck': 1295373632.7087941, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462779998779', 'lastCheck': 1295373632.755126, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0462779998779', 'lastCheck': 1295373632.764781, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.047404050827', 'lastCheck': 1295373632.7622781, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:00:35,506::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:36,038::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500522 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:38,051::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19339::INFO::2011-01-18 20:00:38,517::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19339::DEBUG::2011-01-18 20:00:38,518::task::577::irs::Task e25fe318-be09-48a0-a998-fc89ae88ebc7: moving from state init -> state preparing Thread-19339::DEBUG::2011-01-18 20:00:38,518::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19339::DEBUG::2011-01-18 20:00:38,550::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000446 seconds, 4.6 MB/s\n'; = 0 Thread-19339::DEBUG::2011-01-18 20:00:38,551::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000446 seconds, 4.6 MB/s'], size: 2048 Thread-19339::DEBUG::2011-01-18 20:00:38,551::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19339::DEBUG::2011-01-18 20:00:38,552::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19339::DEBUG::2011-01-18 20:00:38,552::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19339::DEBUG::2011-01-18 20:00:38,553::task::577::irs::Task e25fe318-be09-48a0-a998-fc89ae88ebc7: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19339::DEBUG::2011-01-18 20:00:38,553::task::577::irs::Task e25fe318-be09-48a0-a998-fc89ae88ebc7: moving from state preparing -> state finished Thread-19339::DEBUG::2011-01-18 20:00:38,554::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19339::DEBUG::2011-01-18 20:00:38,554::task::577::irs::Task e25fe318-be09-48a0-a998-fc89ae88ebc7: ref 0 aborting False Thread-19339::INFO::2011-01-18 20:00:38,554::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19340::INFO::2011-01-18 20:00:38,562::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19340::DEBUG::2011-01-18 20:00:38,563::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: moving from state init -> state preparing Thread-19340::DEBUG::2011-01-18 20:00:38,563::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8f1978e6-7e9e-4eb5-a3cf-5b3778824983 acquire shared (120000) Thread-19340::DEBUG::2011-01-18 20:00:38,563::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19340::DEBUG::2011-01-18 20:00:38,564::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8f1978e6-7e9e-4eb5-a3cf-5b3778824983' Thread-19340::DEBUG::2011-01-18 20:00:38,564::resource::524::irs::Owner 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19340::DEBUG::2011-01-18 20:00:38,564::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19340::DEBUG::2011-01-18 20:00:38,565::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: ref 1 aborting False Thread-19340::INFO::2011-01-18 20:00:38,565::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19340::DEBUG::2011-01-18 20:00:38,566::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19340::DEBUG::2011-01-18 20:00:38,566::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: moving from state preparing -> state finished Thread-19340::DEBUG::2011-01-18 20:00:38,567::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19340::DEBUG::2011-01-18 20:00:38,567::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8f1978e6-7e9e-4eb5-a3cf-5b3778824983 releasing Thread-19340::DEBUG::2011-01-18 20:00:38,567::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19340::DEBUG::2011-01-18 20:00:38,568::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19340::DEBUG::2011-01-18 20:00:38,568::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19340::DEBUG::2011-01-18 20:00:38,568::resource::503::irs::Owner 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19340::DEBUG::2011-01-18 20:00:38,569::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19340::DEBUG::2011-01-18 20:00:38,569::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19340::DEBUG::2011-01-18 20:00:38,569::task::577::irs::Task 8f1978e6-7e9e-4eb5-a3cf-5b3778824983: ref 0 aborting False Thread-19340::INFO::2011-01-18 20:00:38,570::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:00:38,587::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504255 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:40,599::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:41,142::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510902 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:00:42,698::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:00:42,699::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:00:42,708::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:00:42,709::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:00:42,739::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:00:42,748::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 20:00:42,754::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:00:42,755::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:00:42,762::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18496::INFO::2011-01-18 20:00:42,764::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18494::DEBUG::2011-01-18 20:00:42,763::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 20:00:42,765::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:00:42,796::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:00:42,805::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:42,806::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:43,155::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:43,689::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502656 seconds, 2.0 MB/s\n'; = 0 Thread-19343::INFO::2011-01-18 20:00:44,570::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19343::DEBUG::2011-01-18 20:00:44,571::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: moving from state init -> state preparing Thread-19343::DEBUG::2011-01-18 20:00:44,571::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5d022c84-b5de-4451-9f0f-3094d5ab1185 acquire shared (120000) Thread-19343::DEBUG::2011-01-18 20:00:44,572::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19343::DEBUG::2011-01-18 20:00:44,572::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5d022c84-b5de-4451-9f0f-3094d5ab1185' Thread-19343::DEBUG::2011-01-18 20:00:44,572::resource::524::irs::Owner 5d022c84-b5de-4451-9f0f-3094d5ab1185: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19343::DEBUG::2011-01-18 20:00:44,572::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19343::DEBUG::2011-01-18 20:00:44,573::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: ref 1 aborting False Thread-19343::DEBUG::2011-01-18 20:00:44,573::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0456819534302', 'lastCheck': 1295373642.744523, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0482749938965', 'lastCheck': 1295373642.8101511, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.045077085495', 'lastCheck': 1295373642.753056, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477638244629', 'lastCheck': 1295373642.8116479, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462160110474', 'lastCheck': 1295373642.801089, 'valid': True, 'code': 0}} Thread-19343::DEBUG::2011-01-18 20:00:44,574::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: moving from state preparing -> state finished Thread-19343::DEBUG::2011-01-18 20:00:44,574::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19343::DEBUG::2011-01-18 20:00:44,574::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5d022c84-b5de-4451-9f0f-3094d5ab1185 releasing Thread-19343::DEBUG::2011-01-18 20:00:44,574::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19343::DEBUG::2011-01-18 20:00:44,575::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19343::DEBUG::2011-01-18 20:00:44,575::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19343::DEBUG::2011-01-18 20:00:44,575::resource::503::irs::Owner 5d022c84-b5de-4451-9f0f-3094d5ab1185: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19343::DEBUG::2011-01-18 20:00:44,576::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19343::DEBUG::2011-01-18 20:00:44,576::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19343::DEBUG::2011-01-18 20:00:44,576::task::577::irs::Task 5d022c84-b5de-4451-9f0f-3094d5ab1185: ref 0 aborting False Thread-19343::INFO::2011-01-18 20:00:44,576::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0456819534302', 'lastCheck': 1295373642.744523, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.045077085495', 'lastCheck': 1295373642.753056, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462160110474', 'lastCheck': 1295373642.801089, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477638244629', 'lastCheck': 1295373642.8116479, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0482749938965', 'lastCheck': 1295373642.8101511, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:00:45,701::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:46,261::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.527447 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:48,276::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19346::INFO::2011-01-18 20:00:48,624::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19346::DEBUG::2011-01-18 20:00:48,625::task::577::irs::Task 57849c04-eba1-41c6-a61e-f2db64748ab3: moving from state init -> state preparing Thread-19346::DEBUG::2011-01-18 20:00:48,626::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19346::DEBUG::2011-01-18 20:00:48,664::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000866 seconds, 2.4 MB/s\n'; = 0 Thread-19346::DEBUG::2011-01-18 20:00:48,664::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000866 seconds, 2.4 MB/s'], size: 2048 Thread-19346::DEBUG::2011-01-18 20:00:48,665::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19346::DEBUG::2011-01-18 20:00:48,665::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19346::DEBUG::2011-01-18 20:00:48,666::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19346::DEBUG::2011-01-18 20:00:48,666::task::577::irs::Task 57849c04-eba1-41c6-a61e-f2db64748ab3: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19346::DEBUG::2011-01-18 20:00:48,667::task::577::irs::Task 57849c04-eba1-41c6-a61e-f2db64748ab3: moving from state preparing -> state finished Thread-19346::DEBUG::2011-01-18 20:00:48,667::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19346::DEBUG::2011-01-18 20:00:48,667::task::577::irs::Task 57849c04-eba1-41c6-a61e-f2db64748ab3: ref 0 aborting False Thread-19346::INFO::2011-01-18 20:00:48,668::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19347::INFO::2011-01-18 20:00:48,676::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19347::DEBUG::2011-01-18 20:00:48,677::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: moving from state init -> state preparing Thread-19347::DEBUG::2011-01-18 20:00:48,677::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2c4d904f-f647-4f5f-bf73-8f3eff8e437b acquire shared (120000) Thread-19347::DEBUG::2011-01-18 20:00:48,677::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19347::DEBUG::2011-01-18 20:00:48,678::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2c4d904f-f647-4f5f-bf73-8f3eff8e437b' Thread-19347::DEBUG::2011-01-18 20:00:48,678::resource::524::irs::Owner 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19347::DEBUG::2011-01-18 20:00:48,678::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19347::DEBUG::2011-01-18 20:00:48,679::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: ref 1 aborting False Thread-19347::INFO::2011-01-18 20:00:48,679::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19347::DEBUG::2011-01-18 20:00:48,680::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19347::DEBUG::2011-01-18 20:00:48,680::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: moving from state preparing -> state finished Thread-19347::DEBUG::2011-01-18 20:00:48,681::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19347::DEBUG::2011-01-18 20:00:48,681::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2c4d904f-f647-4f5f-bf73-8f3eff8e437b releasing Thread-19347::DEBUG::2011-01-18 20:00:48,681::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19347::DEBUG::2011-01-18 20:00:48,681::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19347::DEBUG::2011-01-18 20:00:48,682::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19347::DEBUG::2011-01-18 20:00:48,682::resource::503::irs::Owner 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19347::DEBUG::2011-01-18 20:00:48,682::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19347::DEBUG::2011-01-18 20:00:48,683::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19347::DEBUG::2011-01-18 20:00:48,683::task::577::irs::Task 2c4d904f-f647-4f5f-bf73-8f3eff8e437b: ref 0 aborting False Thread-19347::INFO::2011-01-18 20:00:48,683::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:00:48,816::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.508102 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:50,832::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:51,374::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.509759 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:00:52,743::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:00:52,744::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:00:52,753::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:00:52,754::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:00:52,784::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:00:52,793::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 20:00:52,801::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:00:52,801::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:00:52,810::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:00:52,811::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:00:52,811::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:00:52,812::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:00:52,841::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:00:52,854::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:00:52,855::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:53,387::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:53,921::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502531 seconds, 2.0 MB/s\n'; = 0 Thread-19351::INFO::2011-01-18 20:00:54,753::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19351::DEBUG::2011-01-18 20:00:54,753::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: moving from state init -> state preparing Thread-19351::DEBUG::2011-01-18 20:00:54,754::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a71aa5a7-5123-4913-876a-1946af9c7e13 acquire shared (120000) Thread-19351::DEBUG::2011-01-18 20:00:54,754::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19351::DEBUG::2011-01-18 20:00:54,754::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a71aa5a7-5123-4913-876a-1946af9c7e13' Thread-19351::DEBUG::2011-01-18 20:00:54,754::resource::524::irs::Owner a71aa5a7-5123-4913-876a-1946af9c7e13: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19351::DEBUG::2011-01-18 20:00:54,755::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19351::DEBUG::2011-01-18 20:00:54,755::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: ref 1 aborting False Thread-19351::DEBUG::2011-01-18 20:00:54,755::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452921390533', 'lastCheck': 1295373652.7891381, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0480809211731', 'lastCheck': 1295373652.8579459, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0456030368805', 'lastCheck': 1295373652.7984741, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0486278533936', 'lastCheck': 1295373652.8599989, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0450780391693', 'lastCheck': 1295373652.846015, 'valid': True, 'code': 0}} Thread-19351::DEBUG::2011-01-18 20:00:54,756::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: moving from state preparing -> state finished Thread-19351::DEBUG::2011-01-18 20:00:54,756::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19351::DEBUG::2011-01-18 20:00:54,756::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a71aa5a7-5123-4913-876a-1946af9c7e13 releasing Thread-19351::DEBUG::2011-01-18 20:00:54,756::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19351::DEBUG::2011-01-18 20:00:54,757::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19351::DEBUG::2011-01-18 20:00:54,757::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19351::DEBUG::2011-01-18 20:00:54,757::resource::503::irs::Owner a71aa5a7-5123-4913-876a-1946af9c7e13: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19351::DEBUG::2011-01-18 20:00:54,758::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19351::DEBUG::2011-01-18 20:00:54,758::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19351::DEBUG::2011-01-18 20:00:54,758::task::577::irs::Task a71aa5a7-5123-4913-876a-1946af9c7e13: ref 0 aborting False Thread-19351::INFO::2011-01-18 20:00:54,758::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0452921390533', 'lastCheck': 1295373652.7891381, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0456030368805', 'lastCheck': 1295373652.7984741, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0450780391693', 'lastCheck': 1295373652.846015, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0486278533936', 'lastCheck': 1295373652.8599989, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0480809211731', 'lastCheck': 1295373652.8579459, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:00:55,933::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:00:56,466::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500443 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:00:58,482::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19354::INFO::2011-01-18 20:00:58,743::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19354::DEBUG::2011-01-18 20:00:58,743::task::577::irs::Task a6994ced-29d2-454b-8eee-fc99c48de435: moving from state init -> state preparing Thread-19354::DEBUG::2011-01-18 20:00:58,744::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19354::DEBUG::2011-01-18 20:00:58,776::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000855 seconds, 2.4 MB/s\n'; = 0 Thread-19354::DEBUG::2011-01-18 20:00:58,776::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000855 seconds, 2.4 MB/s'], size: 2048 Thread-19354::DEBUG::2011-01-18 20:00:58,777::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19354::DEBUG::2011-01-18 20:00:58,777::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19354::DEBUG::2011-01-18 20:00:58,778::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19354::DEBUG::2011-01-18 20:00:58,778::task::577::irs::Task a6994ced-29d2-454b-8eee-fc99c48de435: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19354::DEBUG::2011-01-18 20:00:58,779::task::577::irs::Task a6994ced-29d2-454b-8eee-fc99c48de435: moving from state preparing -> state finished Thread-19354::DEBUG::2011-01-18 20:00:58,780::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19354::DEBUG::2011-01-18 20:00:58,780::task::577::irs::Task a6994ced-29d2-454b-8eee-fc99c48de435: ref 0 aborting False Thread-19354::INFO::2011-01-18 20:00:58,780::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19355::INFO::2011-01-18 20:00:58,789::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19355::DEBUG::2011-01-18 20:00:58,789::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: moving from state init -> state preparing Thread-19355::DEBUG::2011-01-18 20:00:58,790::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a702c2d1-4081-4e7e-a264-663085e0b13c acquire shared (120000) Thread-19355::DEBUG::2011-01-18 20:00:58,790::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19355::DEBUG::2011-01-18 20:00:58,790::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a702c2d1-4081-4e7e-a264-663085e0b13c' Thread-19355::DEBUG::2011-01-18 20:00:58,791::resource::524::irs::Owner a702c2d1-4081-4e7e-a264-663085e0b13c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19355::DEBUG::2011-01-18 20:00:58,791::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19355::DEBUG::2011-01-18 20:00:58,792::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: ref 1 aborting False Thread-19355::INFO::2011-01-18 20:00:58,792::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19355::DEBUG::2011-01-18 20:00:58,793::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19355::DEBUG::2011-01-18 20:00:58,793::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: moving from state preparing -> state finished Thread-19355::DEBUG::2011-01-18 20:00:58,794::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19355::DEBUG::2011-01-18 20:00:58,794::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a702c2d1-4081-4e7e-a264-663085e0b13c releasing Thread-19355::DEBUG::2011-01-18 20:00:58,795::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19355::DEBUG::2011-01-18 20:00:58,795::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19355::DEBUG::2011-01-18 20:00:58,795::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19355::DEBUG::2011-01-18 20:00:58,796::resource::503::irs::Owner a702c2d1-4081-4e7e-a264-663085e0b13c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19355::DEBUG::2011-01-18 20:00:58,796::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19355::DEBUG::2011-01-18 20:00:58,796::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19355::DEBUG::2011-01-18 20:00:58,797::task::577::irs::Task a702c2d1-4081-4e7e-a264-663085e0b13c: ref 0 aborting False Thread-19355::INFO::2011-01-18 20:00:58,797::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:00:59,021::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50727 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:01,033::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:01,577::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510811 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:01:02,788::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:01:02,789::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:01:02,798::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:01:02,799::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:02,829::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:01:02,838::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 20:01:02,845::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:01:02,846::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:01:02,858::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:01:02,859::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:01:02,862::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:01:02,864::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:01:02,885::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:01:02,902::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:01:02,903::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:03,592::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:04,126::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500627 seconds, 2.0 MB/s\n'; = 0 Thread-19359::INFO::2011-01-18 20:01:04,935::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19359::DEBUG::2011-01-18 20:01:04,935::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: moving from state init -> state preparing Thread-19359::DEBUG::2011-01-18 20:01:04,935::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5579de2d-e6df-4023-8ba3-d1b494dd5c29 acquire shared (120000) Thread-19359::DEBUG::2011-01-18 20:01:04,936::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19359::DEBUG::2011-01-18 20:01:04,936::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5579de2d-e6df-4023-8ba3-d1b494dd5c29' Thread-19359::DEBUG::2011-01-18 20:01:04,936::resource::524::irs::Owner 5579de2d-e6df-4023-8ba3-d1b494dd5c29: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19359::DEBUG::2011-01-18 20:01:04,937::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19359::DEBUG::2011-01-18 20:01:04,937::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: ref 1 aborting False Thread-19359::DEBUG::2011-01-18 20:01:04,937::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0453970432281', 'lastCheck': 1295373662.8342371, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0481297969818', 'lastCheck': 1295373662.9059899, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0461881160736', 'lastCheck': 1295373662.8440831, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0464220046997', 'lastCheck': 1295373662.9085031, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0435628890991', 'lastCheck': 1295373662.889483, 'valid': True, 'code': 0}} Thread-19359::DEBUG::2011-01-18 20:01:04,938::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: moving from state preparing -> state finished Thread-19359::DEBUG::2011-01-18 20:01:04,938::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19359::DEBUG::2011-01-18 20:01:04,938::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5579de2d-e6df-4023-8ba3-d1b494dd5c29 releasing Thread-19359::DEBUG::2011-01-18 20:01:04,938::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19359::DEBUG::2011-01-18 20:01:04,939::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19359::DEBUG::2011-01-18 20:01:04,939::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19359::DEBUG::2011-01-18 20:01:04,939::resource::503::irs::Owner 5579de2d-e6df-4023-8ba3-d1b494dd5c29: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19359::DEBUG::2011-01-18 20:01:04,940::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19359::DEBUG::2011-01-18 20:01:04,940::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19359::DEBUG::2011-01-18 20:01:04,940::task::577::irs::Task 5579de2d-e6df-4023-8ba3-d1b494dd5c29: ref 0 aborting False Thread-19359::INFO::2011-01-18 20:01:04,940::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0453970432281', 'lastCheck': 1295373662.8342371, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0461881160736', 'lastCheck': 1295373662.8440831, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0435628890991', 'lastCheck': 1295373662.889483, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0464220046997', 'lastCheck': 1295373662.9085031, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0481297969818', 'lastCheck': 1295373662.9059899, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:01:06,136::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:06,672::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503036 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:08,684::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19362::INFO::2011-01-18 20:01:08,863::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19362::DEBUG::2011-01-18 20:01:08,864::task::577::irs::Task e7261925-6555-4cd9-9ad6-a908954564ff: moving from state init -> state preparing Thread-19362::DEBUG::2011-01-18 20:01:08,865::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19362::DEBUG::2011-01-18 20:01:08,897::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000405 seconds, 5.1 MB/s\n'; = 0 Thread-19362::DEBUG::2011-01-18 20:01:08,897::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000405 seconds, 5.1 MB/s'], size: 2048 Thread-19362::DEBUG::2011-01-18 20:01:08,897::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19362::DEBUG::2011-01-18 20:01:08,898::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19362::DEBUG::2011-01-18 20:01:08,899::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19362::DEBUG::2011-01-18 20:01:08,899::task::577::irs::Task e7261925-6555-4cd9-9ad6-a908954564ff: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19362::DEBUG::2011-01-18 20:01:08,900::task::577::irs::Task e7261925-6555-4cd9-9ad6-a908954564ff: moving from state preparing -> state finished Thread-19362::DEBUG::2011-01-18 20:01:08,900::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19362::DEBUG::2011-01-18 20:01:08,900::task::577::irs::Task e7261925-6555-4cd9-9ad6-a908954564ff: ref 0 aborting False Thread-19362::INFO::2011-01-18 20:01:08,901::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19363::INFO::2011-01-18 20:01:08,909::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19363::DEBUG::2011-01-18 20:01:08,909::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: moving from state init -> state preparing Thread-19363::DEBUG::2011-01-18 20:01:08,910::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8347afb9-71a4-40a2-aab8-5f48511fd851 acquire shared (120000) Thread-19363::DEBUG::2011-01-18 20:01:08,910::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19363::DEBUG::2011-01-18 20:01:08,910::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8347afb9-71a4-40a2-aab8-5f48511fd851' Thread-19363::DEBUG::2011-01-18 20:01:08,911::resource::524::irs::Owner 8347afb9-71a4-40a2-aab8-5f48511fd851: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19363::DEBUG::2011-01-18 20:01:08,911::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19363::DEBUG::2011-01-18 20:01:08,911::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: ref 1 aborting False Thread-19363::INFO::2011-01-18 20:01:08,912::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19363::DEBUG::2011-01-18 20:01:08,913::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19363::DEBUG::2011-01-18 20:01:08,913::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: moving from state preparing -> state finished Thread-19363::DEBUG::2011-01-18 20:01:08,913::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19363::DEBUG::2011-01-18 20:01:08,914::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8347afb9-71a4-40a2-aab8-5f48511fd851 releasing Thread-19363::DEBUG::2011-01-18 20:01:08,914::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19363::DEBUG::2011-01-18 20:01:08,914::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19363::DEBUG::2011-01-18 20:01:08,914::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19363::DEBUG::2011-01-18 20:01:08,915::resource::503::irs::Owner 8347afb9-71a4-40a2-aab8-5f48511fd851: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19363::DEBUG::2011-01-18 20:01:08,915::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19363::DEBUG::2011-01-18 20:01:08,915::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19363::DEBUG::2011-01-18 20:01:08,916::task::577::irs::Task 8347afb9-71a4-40a2-aab8-5f48511fd851: ref 0 aborting False Thread-19363::INFO::2011-01-18 20:01:08,916::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:01:09,222::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50632 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:11,237::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:11,782::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512452 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:01:12,833::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:01:12,834::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:01:12,844::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:01:12,845::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:12,874::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:01:12,875::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata count=1' (cwd None) Thread-18495::DEBUG::2011-01-18 20:01:12,885::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::INFO::2011-01-18 20:01:12,889::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:01:12,890::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:01:12,906::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:01:12,907::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:01:12,910::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:01:12,911::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:12,915::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000475 seconds, 4.3 MB/s\n'; = 0 Thread-18493::DEBUG::2011-01-18 20:01:12,915::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000475 seconds, 4.3 MB/s'], size: 2048 Thread-18493::DEBUG::2011-01-18 20:01:12,916::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_3', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE18,uuid:Qgf46A-WY12-2WRV-PrRt-wlBf-dG5l-Y0CiR2,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE19,uuid:I9Af7U-Xs1p-25wD-eipC-Fidg-XxVv-g51Ql4,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE16,uuid:Nvl4M2-De3J-JsKJ-JkBe-GZ6s-AjKD-lcInZA,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE17,uuid:bLZC8w-2nd6-mSQL-l7bf-qTMV-V0zG-2AjV5E,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE23,uuid:6a4K6m-i3eH-fMq3-o87l-7Vrd-u85A-gukoFD,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE22,uuid:Bq8FkT-8D7Z-QeDV-eZzx-RGR3-UzBm-xdyAgL,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE21,uuid:Vnwbgp-85vv-DFdc-LxUu-kPBu-pkQ3-jsIHqv,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE20,uuid:WqzA8s-xBVm-fjUO-1mxU-s8GQ-BTji-sWHK8S,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=u7udFg-03KL-F8eg-BQhY-TAJA-bV0h-ylO1p8', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=8fd1c0112168759eac1d4afe75228b2ee79efc2f'] Thread-18493::DEBUG::2011-01-18 20:01:12,916::metadata::89::irs::metadata.__validate() __cksum(md) = 8fd1c0112168759eac1d4afe75228b2ee79efc2f Thread-18497::DEBUG::2011-01-18 20:01:12,929::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:01:12,948::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:01:12,952::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:13,797::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:14,330::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501673 seconds, 2.0 MB/s\n'; = 0 Thread-19367::INFO::2011-01-18 20:01:15,102::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19367::DEBUG::2011-01-18 20:01:15,102::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: moving from state init -> state preparing Thread-19367::DEBUG::2011-01-18 20:01:15,103::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3 acquire shared (120000) Thread-19367::DEBUG::2011-01-18 20:01:15,103::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19367::DEBUG::2011-01-18 20:01:15,103::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3' Thread-19367::DEBUG::2011-01-18 20:01:15,104::resource::524::irs::Owner 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19367::DEBUG::2011-01-18 20:01:15,104::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19367::DEBUG::2011-01-18 20:01:15,104::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: ref 1 aborting False Thread-19367::DEBUG::2011-01-18 20:01:15,105::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.086592912674', 'lastCheck': 1295373672.9204459, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0452151298523', 'lastCheck': 1295373672.951081, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0507669448853', 'lastCheck': 1295373672.8946309, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.047150850296', 'lastCheck': 1295373672.9573579, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455780029297', 'lastCheck': 1295373672.934454, 'valid': True, 'code': 0}} Thread-19367::DEBUG::2011-01-18 20:01:15,105::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: moving from state preparing -> state finished Thread-19367::DEBUG::2011-01-18 20:01:15,105::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19367::DEBUG::2011-01-18 20:01:15,106::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3 releasing Thread-19367::DEBUG::2011-01-18 20:01:15,106::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19367::DEBUG::2011-01-18 20:01:15,106::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19367::DEBUG::2011-01-18 20:01:15,106::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19367::DEBUG::2011-01-18 20:01:15,107::resource::503::irs::Owner 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19367::DEBUG::2011-01-18 20:01:15,107::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19367::DEBUG::2011-01-18 20:01:15,107::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19367::DEBUG::2011-01-18 20:01:15,108::task::577::irs::Task 6e71ee1e-25d4-44a7-85a9-078bcc6a0cc3: ref 0 aborting False Thread-19367::INFO::2011-01-18 20:01:15,108::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.086592912674', 'lastCheck': 1295373672.9204459, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0507669448853', 'lastCheck': 1295373672.8946309, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455780029297', 'lastCheck': 1295373672.934454, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.047150850296', 'lastCheck': 1295373672.9573579, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0452151298523', 'lastCheck': 1295373672.951081, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:01:16,344::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:16,881::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505101 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:18,894::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19370::INFO::2011-01-18 20:01:18,969::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19370::DEBUG::2011-01-18 20:01:18,970::task::577::irs::Task 331d0817-be76-4d4d-8f6f-23339b1a6c0f: moving from state init -> state preparing Thread-19370::DEBUG::2011-01-18 20:01:18,970::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19370::DEBUG::2011-01-18 20:01:19,002::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s\n'; = 0 Thread-19370::DEBUG::2011-01-18 20:01:19,002::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s'], size: 2048 Thread-19370::DEBUG::2011-01-18 20:01:19,003::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19370::DEBUG::2011-01-18 20:01:19,003::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19370::DEBUG::2011-01-18 20:01:19,004::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19370::DEBUG::2011-01-18 20:01:19,004::task::577::irs::Task 331d0817-be76-4d4d-8f6f-23339b1a6c0f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19370::DEBUG::2011-01-18 20:01:19,005::task::577::irs::Task 331d0817-be76-4d4d-8f6f-23339b1a6c0f: moving from state preparing -> state finished Thread-19370::DEBUG::2011-01-18 20:01:19,005::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19370::DEBUG::2011-01-18 20:01:19,005::task::577::irs::Task 331d0817-be76-4d4d-8f6f-23339b1a6c0f: ref 0 aborting False Thread-19370::INFO::2011-01-18 20:01:19,006::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19371::INFO::2011-01-18 20:01:19,014::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19371::DEBUG::2011-01-18 20:01:19,014::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: moving from state init -> state preparing Thread-19371::DEBUG::2011-01-18 20:01:19,015::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 89767f64-4e04-4026-9d3d-05807adc5aee acquire shared (120000) Thread-19371::DEBUG::2011-01-18 20:01:19,015::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19371::DEBUG::2011-01-18 20:01:19,015::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '89767f64-4e04-4026-9d3d-05807adc5aee' Thread-19371::DEBUG::2011-01-18 20:01:19,016::resource::524::irs::Owner 89767f64-4e04-4026-9d3d-05807adc5aee: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19371::DEBUG::2011-01-18 20:01:19,016::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19371::DEBUG::2011-01-18 20:01:19,016::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: ref 1 aborting False Thread-19371::INFO::2011-01-18 20:01:19,017::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19371::DEBUG::2011-01-18 20:01:19,017::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19371::DEBUG::2011-01-18 20:01:19,018::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: moving from state preparing -> state finished Thread-19371::DEBUG::2011-01-18 20:01:19,018::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19371::DEBUG::2011-01-18 20:01:19,018::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 89767f64-4e04-4026-9d3d-05807adc5aee releasing Thread-19371::DEBUG::2011-01-18 20:01:19,019::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19371::DEBUG::2011-01-18 20:01:19,019::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19371::DEBUG::2011-01-18 20:01:19,019::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19371::DEBUG::2011-01-18 20:01:19,020::resource::503::irs::Owner 89767f64-4e04-4026-9d3d-05807adc5aee: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19371::DEBUG::2011-01-18 20:01:19,020::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19371::DEBUG::2011-01-18 20:01:19,020::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19371::DEBUG::2011-01-18 20:01:19,021::task::577::irs::Task 89767f64-4e04-4026-9d3d-05807adc5aee: ref 0 aborting False Thread-19371::INFO::2011-01-18 20:01:19,021::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:01:19,429::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502503 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:21,440::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:21,988::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51495 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:01:22,893::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:01:22,894::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:01:22,920::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:01:22,921::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:01:22,934::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:01:22,935::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:01:22,937::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 20:01:22,951::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:01:22,951::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:01:22,958::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:01:22,959::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:22,963::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:01:22,978::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:01:22,992::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:01:23,002::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:24,000::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:24,533::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501967 seconds, 2.0 MB/s\n'; = 0 Thread-19375::INFO::2011-01-18 20:01:25,280::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19375::DEBUG::2011-01-18 20:01:25,280::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: moving from state init -> state preparing Thread-19375::DEBUG::2011-01-18 20:01:25,280::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3c5d2745-7664-4e81-8050-08812960c0df acquire shared (120000) Thread-19375::DEBUG::2011-01-18 20:01:25,281::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19375::DEBUG::2011-01-18 20:01:25,281::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '3c5d2745-7664-4e81-8050-08812960c0df' Thread-19375::DEBUG::2011-01-18 20:01:25,281::resource::524::irs::Owner 3c5d2745-7664-4e81-8050-08812960c0df: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19375::DEBUG::2011-01-18 20:01:25,282::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19375::DEBUG::2011-01-18 20:01:25,282::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: ref 1 aborting False Thread-19375::DEBUG::2011-01-18 20:01:25,282::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0479030609131', 'lastCheck': 1295373682.967803, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.046275138855', 'lastCheck': 1295373682.997184, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0500609874725', 'lastCheck': 1295373682.9438989, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494499206543', 'lastCheck': 1295373683.007324, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0485000610352', 'lastCheck': 1295373682.9823861, 'valid': True, 'code': 0}} Thread-19375::DEBUG::2011-01-18 20:01:25,283::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: moving from state preparing -> state finished Thread-19375::DEBUG::2011-01-18 20:01:25,283::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19375::DEBUG::2011-01-18 20:01:25,283::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3c5d2745-7664-4e81-8050-08812960c0df releasing Thread-19375::DEBUG::2011-01-18 20:01:25,283::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19375::DEBUG::2011-01-18 20:01:25,284::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19375::DEBUG::2011-01-18 20:01:25,284::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19375::DEBUG::2011-01-18 20:01:25,284::resource::503::irs::Owner 3c5d2745-7664-4e81-8050-08812960c0df: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19375::DEBUG::2011-01-18 20:01:25,285::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19375::DEBUG::2011-01-18 20:01:25,285::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19375::DEBUG::2011-01-18 20:01:25,285::task::577::irs::Task 3c5d2745-7664-4e81-8050-08812960c0df: ref 0 aborting False Thread-19375::INFO::2011-01-18 20:01:25,285::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0479030609131', 'lastCheck': 1295373682.967803, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0500609874725', 'lastCheck': 1295373682.9438989, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0485000610352', 'lastCheck': 1295373682.9823861, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494499206543', 'lastCheck': 1295373683.007324, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.046275138855', 'lastCheck': 1295373682.997184, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:01:26,546::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:27,082::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503679 seconds, 2.0 MB/s\n'; = 0 Thread-19378::INFO::2011-01-18 20:01:29,073::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19378::DEBUG::2011-01-18 20:01:29,073::task::577::irs::Task 931a953e-88ca-4a01-b84e-4e92d7519ac7: moving from state init -> state preparing Thread-19378::DEBUG::2011-01-18 20:01:29,074::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:29,093::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19378::DEBUG::2011-01-18 20:01:29,106::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000453 seconds, 4.5 MB/s\n'; = 0 Thread-19378::DEBUG::2011-01-18 20:01:29,106::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000453 seconds, 4.5 MB/s'], size: 2048 Thread-19378::DEBUG::2011-01-18 20:01:29,107::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19378::DEBUG::2011-01-18 20:01:29,107::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19378::DEBUG::2011-01-18 20:01:29,108::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19378::DEBUG::2011-01-18 20:01:29,108::task::577::irs::Task 931a953e-88ca-4a01-b84e-4e92d7519ac7: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19378::DEBUG::2011-01-18 20:01:29,109::task::577::irs::Task 931a953e-88ca-4a01-b84e-4e92d7519ac7: moving from state preparing -> state finished Thread-19378::DEBUG::2011-01-18 20:01:29,109::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19378::DEBUG::2011-01-18 20:01:29,109::task::577::irs::Task 931a953e-88ca-4a01-b84e-4e92d7519ac7: ref 0 aborting False Thread-19378::INFO::2011-01-18 20:01:29,110::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19379::INFO::2011-01-18 20:01:29,118::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19379::DEBUG::2011-01-18 20:01:29,119::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: moving from state init -> state preparing Thread-19379::DEBUG::2011-01-18 20:01:29,119::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: caf64be4-b152-43a0-bd94-b7504b7dbab1 acquire shared (120000) Thread-19379::DEBUG::2011-01-18 20:01:29,119::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19379::DEBUG::2011-01-18 20:01:29,120::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'caf64be4-b152-43a0-bd94-b7504b7dbab1' Thread-19379::DEBUG::2011-01-18 20:01:29,120::resource::524::irs::Owner caf64be4-b152-43a0-bd94-b7504b7dbab1: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19379::DEBUG::2011-01-18 20:01:29,120::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19379::DEBUG::2011-01-18 20:01:29,120::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: ref 1 aborting False Thread-19379::INFO::2011-01-18 20:01:29,121::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19379::DEBUG::2011-01-18 20:01:29,122::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19379::DEBUG::2011-01-18 20:01:29,122::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: moving from state preparing -> state finished Thread-19379::DEBUG::2011-01-18 20:01:29,123::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19379::DEBUG::2011-01-18 20:01:29,123::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: caf64be4-b152-43a0-bd94-b7504b7dbab1 releasing Thread-19379::DEBUG::2011-01-18 20:01:29,123::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19379::DEBUG::2011-01-18 20:01:29,123::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19379::DEBUG::2011-01-18 20:01:29,124::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19379::DEBUG::2011-01-18 20:01:29,124::resource::503::irs::Owner caf64be4-b152-43a0-bd94-b7504b7dbab1: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19379::DEBUG::2011-01-18 20:01:29,124::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19379::DEBUG::2011-01-18 20:01:29,125::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19379::DEBUG::2011-01-18 20:01:29,125::task::577::irs::Task caf64be4-b152-43a0-bd94-b7504b7dbab1: ref 0 aborting False Thread-19379::INFO::2011-01-18 20:01:29,125::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:01:29,629::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503672 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:31,640::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:32,186::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.513727 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:01:32,943::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:01:32,944::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:01:32,968::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:01:32,969::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:01:32,982::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:01:32,983::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:01:32,986::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 20:01:32,996::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:01:32,997::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:01:33,007::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:01:33,008::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:33,012::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:01:33,024::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:01:33,041::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:01:33,050::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:34,199::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:34,732::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500994 seconds, 2.0 MB/s\n'; = 0 Thread-19383::INFO::2011-01-18 20:01:35,443::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19383::DEBUG::2011-01-18 20:01:35,443::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: moving from state init -> state preparing Thread-19383::DEBUG::2011-01-18 20:01:35,443::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0d0af22c-309d-4f6f-a259-1967b2c7c143 acquire shared (120000) Thread-19383::DEBUG::2011-01-18 20:01:35,444::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19383::DEBUG::2011-01-18 20:01:35,444::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0d0af22c-309d-4f6f-a259-1967b2c7c143' Thread-19383::DEBUG::2011-01-18 20:01:35,444::resource::524::irs::Owner 0d0af22c-309d-4f6f-a259-1967b2c7c143: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19383::DEBUG::2011-01-18 20:01:35,444::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19383::DEBUG::2011-01-18 20:01:35,445::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: ref 1 aborting False Thread-19383::DEBUG::2011-01-18 20:01:35,445::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0483920574188', 'lastCheck': 1295373693.016252, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0495431423187', 'lastCheck': 1295373693.046401, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0488290786743', 'lastCheck': 1295373692.9926691, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.047728061676', 'lastCheck': 1295373693.0546401, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.046334028244', 'lastCheck': 1295373693.0282481, 'valid': True, 'code': 0}} Thread-19383::DEBUG::2011-01-18 20:01:35,446::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: moving from state preparing -> state finished Thread-19383::DEBUG::2011-01-18 20:01:35,446::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19383::DEBUG::2011-01-18 20:01:35,446::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0d0af22c-309d-4f6f-a259-1967b2c7c143 releasing Thread-19383::DEBUG::2011-01-18 20:01:35,446::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19383::DEBUG::2011-01-18 20:01:35,447::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19383::DEBUG::2011-01-18 20:01:35,447::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19383::DEBUG::2011-01-18 20:01:35,447::resource::503::irs::Owner 0d0af22c-309d-4f6f-a259-1967b2c7c143: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19383::DEBUG::2011-01-18 20:01:35,447::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19383::DEBUG::2011-01-18 20:01:35,448::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19383::DEBUG::2011-01-18 20:01:35,448::task::577::irs::Task 0d0af22c-309d-4f6f-a259-1967b2c7c143: ref 0 aborting False Thread-19383::INFO::2011-01-18 20:01:35,448::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0483920574188', 'lastCheck': 1295373693.016252, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0488290786743', 'lastCheck': 1295373692.9926691, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.046334028244', 'lastCheck': 1295373693.0282481, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.047728061676', 'lastCheck': 1295373693.0546401, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0495431423187', 'lastCheck': 1295373693.046401, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:01:36,743::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:37,279::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503752 seconds, 2.0 MB/s\n'; = 0 Thread-19386::INFO::2011-01-18 20:01:39,180::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19386::DEBUG::2011-01-18 20:01:39,180::task::577::irs::Task b7b96b76-14e5-426c-a124-5fbde661e6b8: moving from state init -> state preparing Thread-19386::DEBUG::2011-01-18 20:01:39,180::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19386::DEBUG::2011-01-18 20:01:39,213::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000458 seconds, 4.5 MB/s\n'; = 0 Thread-19386::DEBUG::2011-01-18 20:01:39,213::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000458 seconds, 4.5 MB/s'], size: 2048 Thread-19386::DEBUG::2011-01-18 20:01:39,213::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19386::DEBUG::2011-01-18 20:01:39,214::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19386::DEBUG::2011-01-18 20:01:39,214::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19386::DEBUG::2011-01-18 20:01:39,215::task::577::irs::Task b7b96b76-14e5-426c-a124-5fbde661e6b8: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19386::DEBUG::2011-01-18 20:01:39,215::task::577::irs::Task b7b96b76-14e5-426c-a124-5fbde661e6b8: moving from state preparing -> state finished Thread-19386::DEBUG::2011-01-18 20:01:39,215::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19386::DEBUG::2011-01-18 20:01:39,216::task::577::irs::Task b7b96b76-14e5-426c-a124-5fbde661e6b8: ref 0 aborting False Thread-19386::INFO::2011-01-18 20:01:39,216::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19387::INFO::2011-01-18 20:01:39,225::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19387::DEBUG::2011-01-18 20:01:39,225::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: moving from state init -> state preparing Thread-19387::DEBUG::2011-01-18 20:01:39,226::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8a47d712-ede5-47c4-8ce2-193da1b86c07 acquire shared (120000) Thread-19387::DEBUG::2011-01-18 20:01:39,226::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19387::DEBUG::2011-01-18 20:01:39,226::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8a47d712-ede5-47c4-8ce2-193da1b86c07' Thread-19387::DEBUG::2011-01-18 20:01:39,227::resource::524::irs::Owner 8a47d712-ede5-47c4-8ce2-193da1b86c07: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19387::DEBUG::2011-01-18 20:01:39,227::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19387::DEBUG::2011-01-18 20:01:39,227::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: ref 1 aborting False Thread-19387::INFO::2011-01-18 20:01:39,228::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19387::DEBUG::2011-01-18 20:01:39,228::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19387::DEBUG::2011-01-18 20:01:39,229::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: moving from state preparing -> state finished Thread-19387::DEBUG::2011-01-18 20:01:39,229::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19387::DEBUG::2011-01-18 20:01:39,229::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8a47d712-ede5-47c4-8ce2-193da1b86c07 releasing Thread-19387::DEBUG::2011-01-18 20:01:39,230::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19387::DEBUG::2011-01-18 20:01:39,230::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19387::DEBUG::2011-01-18 20:01:39,230::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19387::DEBUG::2011-01-18 20:01:39,230::resource::503::irs::Owner 8a47d712-ede5-47c4-8ce2-193da1b86c07: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19387::DEBUG::2011-01-18 20:01:39,231::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19387::DEBUG::2011-01-18 20:01:39,231::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19387::DEBUG::2011-01-18 20:01:39,231::task::577::irs::Task 8a47d712-ede5-47c4-8ce2-193da1b86c07: ref 0 aborting False Thread-19387::INFO::2011-01-18 20:01:39,232::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:01:39,290::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:39,823::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501842 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:41,837::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:42,382::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.513156 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:01:42,991::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:01:42,992::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:01:43,016::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:01:43,017::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:01:43,028::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:01:43,029::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:01:43,032::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 20:01:43,046::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:01:43,046::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:01:43,054::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:01:43,055::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:43,061::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:01:43,070::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:01:43,087::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:01:43,099::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:44,395::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:44,927::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500755 seconds, 2.0 MB/s\n'; = 0 Thread-19391::INFO::2011-01-18 20:01:45,607::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19391::DEBUG::2011-01-18 20:01:45,607::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: moving from state init -> state preparing Thread-19391::DEBUG::2011-01-18 20:01:45,608::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 701f7eb6-0f2d-4e24-b16e-1231650999a6 acquire shared (120000) Thread-19391::DEBUG::2011-01-18 20:01:45,608::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19391::DEBUG::2011-01-18 20:01:45,608::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '701f7eb6-0f2d-4e24-b16e-1231650999a6' Thread-19391::DEBUG::2011-01-18 20:01:45,609::resource::524::irs::Owner 701f7eb6-0f2d-4e24-b16e-1231650999a6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19391::DEBUG::2011-01-18 20:01:45,609::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19391::DEBUG::2011-01-18 20:01:45,609::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: ref 1 aborting False Thread-19391::DEBUG::2011-01-18 20:01:45,610::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0509369373322', 'lastCheck': 1295373703.0667989, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0454049110413', 'lastCheck': 1295373703.091274, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.04807305336', 'lastCheck': 1295373703.0399101, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0499830245972', 'lastCheck': 1295373703.1038649, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0465998649597', 'lastCheck': 1295373703.0745699, 'valid': True, 'code': 0}} Thread-19391::DEBUG::2011-01-18 20:01:45,610::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: moving from state preparing -> state finished Thread-19391::DEBUG::2011-01-18 20:01:45,610::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19391::DEBUG::2011-01-18 20:01:45,611::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 701f7eb6-0f2d-4e24-b16e-1231650999a6 releasing Thread-19391::DEBUG::2011-01-18 20:01:45,611::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19391::DEBUG::2011-01-18 20:01:45,611::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19391::DEBUG::2011-01-18 20:01:45,611::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19391::DEBUG::2011-01-18 20:01:45,612::resource::503::irs::Owner 701f7eb6-0f2d-4e24-b16e-1231650999a6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19391::DEBUG::2011-01-18 20:01:45,612::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19391::DEBUG::2011-01-18 20:01:45,612::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19391::DEBUG::2011-01-18 20:01:45,612::task::577::irs::Task 701f7eb6-0f2d-4e24-b16e-1231650999a6: ref 0 aborting False Thread-19391::INFO::2011-01-18 20:01:45,613::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0509369373322', 'lastCheck': 1295373703.0667989, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.04807305336', 'lastCheck': 1295373703.0399101, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0465998649597', 'lastCheck': 1295373703.0745699, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0499830245972', 'lastCheck': 1295373703.1038649, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0454049110413', 'lastCheck': 1295373703.091274, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:01:46,941::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:47,476::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503285 seconds, 2.0 MB/s\n'; = 0 Thread-19394::INFO::2011-01-18 20:01:49,284::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19394::DEBUG::2011-01-18 20:01:49,285::task::577::irs::Task 38b77449-99b5-4aa3-9054-1c0b7592242d: moving from state init -> state preparing Thread-19394::DEBUG::2011-01-18 20:01:49,285::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19394::DEBUG::2011-01-18 20:01:49,317::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000467 seconds, 4.4 MB/s\n'; = 0 Thread-19394::DEBUG::2011-01-18 20:01:49,317::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000467 seconds, 4.4 MB/s'], size: 2048 Thread-19394::DEBUG::2011-01-18 20:01:49,318::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19394::DEBUG::2011-01-18 20:01:49,318::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19394::DEBUG::2011-01-18 20:01:49,319::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19394::DEBUG::2011-01-18 20:01:49,319::task::577::irs::Task 38b77449-99b5-4aa3-9054-1c0b7592242d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19394::DEBUG::2011-01-18 20:01:49,320::task::577::irs::Task 38b77449-99b5-4aa3-9054-1c0b7592242d: moving from state preparing -> state finished Thread-19394::DEBUG::2011-01-18 20:01:49,320::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19394::DEBUG::2011-01-18 20:01:49,320::task::577::irs::Task 38b77449-99b5-4aa3-9054-1c0b7592242d: ref 0 aborting False Thread-19394::INFO::2011-01-18 20:01:49,321::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19395::INFO::2011-01-18 20:01:49,329::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19395::DEBUG::2011-01-18 20:01:49,329::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: moving from state init -> state preparing Thread-19395::DEBUG::2011-01-18 20:01:49,329::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 70c634f3-b6fb-4401-bfb7-2fa649f1725b acquire shared (120000) Thread-19395::DEBUG::2011-01-18 20:01:49,330::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19395::DEBUG::2011-01-18 20:01:49,330::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '70c634f3-b6fb-4401-bfb7-2fa649f1725b' Thread-19395::DEBUG::2011-01-18 20:01:49,330::resource::524::irs::Owner 70c634f3-b6fb-4401-bfb7-2fa649f1725b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19395::DEBUG::2011-01-18 20:01:49,331::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19395::DEBUG::2011-01-18 20:01:49,331::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: ref 1 aborting False Thread-19395::INFO::2011-01-18 20:01:49,331::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19395::DEBUG::2011-01-18 20:01:49,332::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19395::DEBUG::2011-01-18 20:01:49,332::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: moving from state preparing -> state finished Thread-19395::DEBUG::2011-01-18 20:01:49,333::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19395::DEBUG::2011-01-18 20:01:49,333::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 70c634f3-b6fb-4401-bfb7-2fa649f1725b releasing Thread-19395::DEBUG::2011-01-18 20:01:49,333::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19395::DEBUG::2011-01-18 20:01:49,333::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19395::DEBUG::2011-01-18 20:01:49,334::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19395::DEBUG::2011-01-18 20:01:49,334::resource::503::irs::Owner 70c634f3-b6fb-4401-bfb7-2fa649f1725b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19395::DEBUG::2011-01-18 20:01:49,334::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19395::DEBUG::2011-01-18 20:01:49,334::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19395::DEBUG::2011-01-18 20:01:49,335::task::577::irs::Task 70c634f3-b6fb-4401-bfb7-2fa649f1725b: ref 0 aborting False Thread-19395::INFO::2011-01-18 20:01:49,335::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:01:49,490::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:50,028::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505992 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:52,042::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:52,585::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511371 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:01:53,041::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:01:53,042::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:01:53,067::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:01:53,068::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:01:53,074::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:01:53,075::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:01:53,082::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 20:01:53,091::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:01:53,091::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:01:53,104::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:01:53,105::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:01:53,115::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:01:53,115::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:01:53,137::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:01:53,146::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:01:54,598::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:55,133::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503317 seconds, 2.0 MB/s\n'; = 0 Thread-19399::INFO::2011-01-18 20:01:55,773::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19399::DEBUG::2011-01-18 20:01:55,774::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: moving from state init -> state preparing Thread-19399::DEBUG::2011-01-18 20:01:55,774::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ed26f28a-24bf-4a6e-8a72-0eafea356ad4 acquire shared (120000) Thread-19399::DEBUG::2011-01-18 20:01:55,774::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19399::DEBUG::2011-01-18 20:01:55,775::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ed26f28a-24bf-4a6e-8a72-0eafea356ad4' Thread-19399::DEBUG::2011-01-18 20:01:55,775::resource::524::irs::Owner ed26f28a-24bf-4a6e-8a72-0eafea356ad4: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19399::DEBUG::2011-01-18 20:01:55,775::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19399::DEBUG::2011-01-18 20:01:55,776::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: ref 1 aborting False Thread-19399::DEBUG::2011-01-18 20:01:55,776::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0553929805756', 'lastCheck': 1295373713.1222539, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0500538349152', 'lastCheck': 1295373713.1409149, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0480320453644', 'lastCheck': 1295373713.0898759, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0474510192871', 'lastCheck': 1295373713.1513309, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.047385931015', 'lastCheck': 1295373713.1212599, 'valid': True, 'code': 0}} Thread-19399::DEBUG::2011-01-18 20:01:55,776::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: moving from state preparing -> state finished Thread-19399::DEBUG::2011-01-18 20:01:55,777::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19399::DEBUG::2011-01-18 20:01:55,777::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ed26f28a-24bf-4a6e-8a72-0eafea356ad4 releasing Thread-19399::DEBUG::2011-01-18 20:01:55,777::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19399::DEBUG::2011-01-18 20:01:55,777::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19399::DEBUG::2011-01-18 20:01:55,778::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19399::DEBUG::2011-01-18 20:01:55,778::resource::503::irs::Owner ed26f28a-24bf-4a6e-8a72-0eafea356ad4: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19399::DEBUG::2011-01-18 20:01:55,778::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19399::DEBUG::2011-01-18 20:01:55,779::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19399::DEBUG::2011-01-18 20:01:55,779::task::577::irs::Task ed26f28a-24bf-4a6e-8a72-0eafea356ad4: ref 0 aborting False Thread-19399::INFO::2011-01-18 20:01:55,779::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0553929805756', 'lastCheck': 1295373713.1222539, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0480320453644', 'lastCheck': 1295373713.0898759, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.047385931015', 'lastCheck': 1295373713.1212599, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0474510192871', 'lastCheck': 1295373713.1513309, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0500538349152', 'lastCheck': 1295373713.1409149, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:01:57,145::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:01:57,680::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503788 seconds, 2.0 MB/s\n'; = 0 Thread-19402::INFO::2011-01-18 20:01:59,388::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19402::DEBUG::2011-01-18 20:01:59,388::task::577::irs::Task eca1b039-e658-442a-9673-ae1fabd4938f: moving from state init -> state preparing Thread-19402::DEBUG::2011-01-18 20:01:59,389::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19402::DEBUG::2011-01-18 20:01:59,421::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000903 seconds, 2.3 MB/s\n'; = 0 Thread-19402::DEBUG::2011-01-18 20:01:59,421::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000903 seconds, 2.3 MB/s'], size: 2048 Thread-19402::DEBUG::2011-01-18 20:01:59,422::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19402::DEBUG::2011-01-18 20:01:59,422::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19402::DEBUG::2011-01-18 20:01:59,423::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19402::DEBUG::2011-01-18 20:01:59,423::task::577::irs::Task eca1b039-e658-442a-9673-ae1fabd4938f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19402::DEBUG::2011-01-18 20:01:59,424::task::577::irs::Task eca1b039-e658-442a-9673-ae1fabd4938f: moving from state preparing -> state finished Thread-19402::DEBUG::2011-01-18 20:01:59,424::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19402::DEBUG::2011-01-18 20:01:59,424::task::577::irs::Task eca1b039-e658-442a-9673-ae1fabd4938f: ref 0 aborting False Thread-19402::INFO::2011-01-18 20:01:59,425::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19403::INFO::2011-01-18 20:01:59,433::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19403::DEBUG::2011-01-18 20:01:59,433::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: moving from state init -> state preparing Thread-19403::DEBUG::2011-01-18 20:01:59,433::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 55f57221-7e57-4fef-be69-6b39c24fa585 acquire shared (120000) Thread-19403::DEBUG::2011-01-18 20:01:59,434::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19403::DEBUG::2011-01-18 20:01:59,434::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '55f57221-7e57-4fef-be69-6b39c24fa585' Thread-19403::DEBUG::2011-01-18 20:01:59,434::resource::524::irs::Owner 55f57221-7e57-4fef-be69-6b39c24fa585: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19403::DEBUG::2011-01-18 20:01:59,434::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19403::DEBUG::2011-01-18 20:01:59,435::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: ref 1 aborting False Thread-19403::INFO::2011-01-18 20:01:59,435::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19403::DEBUG::2011-01-18 20:01:59,436::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19403::DEBUG::2011-01-18 20:01:59,436::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: moving from state preparing -> state finished Thread-19403::DEBUG::2011-01-18 20:01:59,437::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19403::DEBUG::2011-01-18 20:01:59,437::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 55f57221-7e57-4fef-be69-6b39c24fa585 releasing Thread-19403::DEBUG::2011-01-18 20:01:59,437::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19403::DEBUG::2011-01-18 20:01:59,437::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19403::DEBUG::2011-01-18 20:01:59,438::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19403::DEBUG::2011-01-18 20:01:59,438::resource::503::irs::Owner 55f57221-7e57-4fef-be69-6b39c24fa585: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19403::DEBUG::2011-01-18 20:01:59,438::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19403::DEBUG::2011-01-18 20:01:59,438::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19403::DEBUG::2011-01-18 20:01:59,439::task::577::irs::Task 55f57221-7e57-4fef-be69-6b39c24fa585: ref 0 aborting False Thread-19403::INFO::2011-01-18 20:01:59,439::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:01:59,694::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:00,228::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502508 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:02,241::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:02,785::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512954 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:02:03,089::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:02:03,090::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:02:03,121::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:02:03,122::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:02:03,122::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:02:03,125::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:02:03,131::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 20:02:03,144::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:02:03,145::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:02:03,151::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:02:03,152::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:02:03,162::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:02:03,165::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:02:03,185::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:02:03,193::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:04,798::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:05,344::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514286 seconds, 2.0 MB/s\n'; = 0 Thread-19407::INFO::2011-01-18 20:02:05,936::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19407::DEBUG::2011-01-18 20:02:05,936::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: moving from state init -> state preparing Thread-19407::DEBUG::2011-01-18 20:02:05,936::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 06a332e5-4149-4c2c-8923-1fa8cce9c929 acquire shared (120000) Thread-19407::DEBUG::2011-01-18 20:02:05,937::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19407::DEBUG::2011-01-18 20:02:05,937::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '06a332e5-4149-4c2c-8923-1fa8cce9c929' Thread-19407::DEBUG::2011-01-18 20:02:05,937::resource::524::irs::Owner 06a332e5-4149-4c2c-8923-1fa8cce9c929: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19407::DEBUG::2011-01-18 20:02:05,938::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19407::DEBUG::2011-01-18 20:02:05,938::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: ref 1 aborting False Thread-19407::DEBUG::2011-01-18 20:02:05,938::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0479378700256', 'lastCheck': 1295373723.1704869, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.043468952179', 'lastCheck': 1295373723.188318, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0482680797577', 'lastCheck': 1295373723.138118, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0475280284882', 'lastCheck': 1295373723.198415, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0471410751343', 'lastCheck': 1295373723.167995, 'valid': True, 'code': 0}} Thread-19407::DEBUG::2011-01-18 20:02:05,939::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: moving from state preparing -> state finished Thread-19407::DEBUG::2011-01-18 20:02:05,939::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19407::DEBUG::2011-01-18 20:02:05,939::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 06a332e5-4149-4c2c-8923-1fa8cce9c929 releasing Thread-19407::DEBUG::2011-01-18 20:02:05,939::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19407::DEBUG::2011-01-18 20:02:05,940::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19407::DEBUG::2011-01-18 20:02:05,940::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19407::DEBUG::2011-01-18 20:02:05,940::resource::503::irs::Owner 06a332e5-4149-4c2c-8923-1fa8cce9c929: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19407::DEBUG::2011-01-18 20:02:05,941::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19407::DEBUG::2011-01-18 20:02:05,941::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19407::DEBUG::2011-01-18 20:02:05,941::task::577::irs::Task 06a332e5-4149-4c2c-8923-1fa8cce9c929: ref 0 aborting False Thread-19407::INFO::2011-01-18 20:02:05,941::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0479378700256', 'lastCheck': 1295373723.1704869, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0482680797577', 'lastCheck': 1295373723.138118, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0471410751343', 'lastCheck': 1295373723.167995, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0475280284882', 'lastCheck': 1295373723.198415, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.043468952179', 'lastCheck': 1295373723.188318, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:02:07,356::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:07,892::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502682 seconds, 2.0 MB/s\n'; = 0 Thread-19410::INFO::2011-01-18 20:02:09,491::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19410::DEBUG::2011-01-18 20:02:09,492::task::577::irs::Task e654e0fe-337b-4aac-bb52-5cfed366933e: moving from state init -> state preparing Thread-19410::DEBUG::2011-01-18 20:02:09,492::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19410::DEBUG::2011-01-18 20:02:09,524::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000482 seconds, 4.2 MB/s\n'; = 0 Thread-19410::DEBUG::2011-01-18 20:02:09,525::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000482 seconds, 4.2 MB/s'], size: 2048 Thread-19410::DEBUG::2011-01-18 20:02:09,525::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19410::DEBUG::2011-01-18 20:02:09,526::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19410::DEBUG::2011-01-18 20:02:09,526::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19410::DEBUG::2011-01-18 20:02:09,527::task::577::irs::Task e654e0fe-337b-4aac-bb52-5cfed366933e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19410::DEBUG::2011-01-18 20:02:09,527::task::577::irs::Task e654e0fe-337b-4aac-bb52-5cfed366933e: moving from state preparing -> state finished Thread-19410::DEBUG::2011-01-18 20:02:09,527::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19410::DEBUG::2011-01-18 20:02:09,528::task::577::irs::Task e654e0fe-337b-4aac-bb52-5cfed366933e: ref 0 aborting False Thread-19410::INFO::2011-01-18 20:02:09,528::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19411::INFO::2011-01-18 20:02:09,536::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19411::DEBUG::2011-01-18 20:02:09,536::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: moving from state init -> state preparing Thread-19411::DEBUG::2011-01-18 20:02:09,537::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 79f77545-d6a8-431b-a4db-3c52164ffc13 acquire shared (120000) Thread-19411::DEBUG::2011-01-18 20:02:09,537::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19411::DEBUG::2011-01-18 20:02:09,537::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '79f77545-d6a8-431b-a4db-3c52164ffc13' Thread-19411::DEBUG::2011-01-18 20:02:09,538::resource::524::irs::Owner 79f77545-d6a8-431b-a4db-3c52164ffc13: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19411::DEBUG::2011-01-18 20:02:09,538::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19411::DEBUG::2011-01-18 20:02:09,538::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: ref 1 aborting False Thread-19411::INFO::2011-01-18 20:02:09,539::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19411::DEBUG::2011-01-18 20:02:09,539::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19411::DEBUG::2011-01-18 20:02:09,540::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: moving from state preparing -> state finished Thread-19411::DEBUG::2011-01-18 20:02:09,540::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19411::DEBUG::2011-01-18 20:02:09,540::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 79f77545-d6a8-431b-a4db-3c52164ffc13 releasing Thread-19411::DEBUG::2011-01-18 20:02:09,541::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19411::DEBUG::2011-01-18 20:02:09,541::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19411::DEBUG::2011-01-18 20:02:09,541::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19411::DEBUG::2011-01-18 20:02:09,541::resource::503::irs::Owner 79f77545-d6a8-431b-a4db-3c52164ffc13: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19411::DEBUG::2011-01-18 20:02:09,542::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19411::DEBUG::2011-01-18 20:02:09,542::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19411::DEBUG::2011-01-18 20:02:09,542::task::577::irs::Task 79f77545-d6a8-431b-a4db-3c52164ffc13: ref 0 aborting False Thread-19411::INFO::2011-01-18 20:02:09,543::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:02:09,905::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:10,440::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503853 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:12,452::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:12,997::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51209 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:02:13,137::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:02:13,138::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:02:13,168::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:02:13,169::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:02:13,172::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:02:13,174::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:02:13,179::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::INFO::2011-01-18 20:02:13,188::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:02:13,188::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:02:13,198::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:02:13,199::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:02:13,209::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:02:13,212::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:02:13,228::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:02:13,241::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:15,008::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:15,545::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505719 seconds, 2.0 MB/s\n'; = 0 Thread-19415::INFO::2011-01-18 20:02:16,103::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19415::DEBUG::2011-01-18 20:02:16,103::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: moving from state init -> state preparing Thread-19415::DEBUG::2011-01-18 20:02:16,104::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8644bb5d-695c-4a78-a243-3894efbbdc87 acquire shared (120000) Thread-19415::DEBUG::2011-01-18 20:02:16,104::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19415::DEBUG::2011-01-18 20:02:16,104::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '8644bb5d-695c-4a78-a243-3894efbbdc87' Thread-19415::DEBUG::2011-01-18 20:02:16,104::resource::524::irs::Owner 8644bb5d-695c-4a78-a243-3894efbbdc87: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19415::DEBUG::2011-01-18 20:02:16,105::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19415::DEBUG::2011-01-18 20:02:16,105::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: ref 1 aborting False Thread-19415::DEBUG::2011-01-18 20:02:16,105::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0456409454346', 'lastCheck': 1295373733.2179739, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0438630580902', 'lastCheck': 1295373733.231811, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0469648838043', 'lastCheck': 1295373733.18484, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0480921268463', 'lastCheck': 1295373733.2459581, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0460379123688', 'lastCheck': 1295373733.213897, 'valid': True, 'code': 0}} Thread-19415::DEBUG::2011-01-18 20:02:16,106::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: moving from state preparing -> state finished Thread-19415::DEBUG::2011-01-18 20:02:16,106::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19415::DEBUG::2011-01-18 20:02:16,106::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 8644bb5d-695c-4a78-a243-3894efbbdc87 releasing Thread-19415::DEBUG::2011-01-18 20:02:16,107::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19415::DEBUG::2011-01-18 20:02:16,107::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19415::DEBUG::2011-01-18 20:02:16,107::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19415::DEBUG::2011-01-18 20:02:16,107::resource::503::irs::Owner 8644bb5d-695c-4a78-a243-3894efbbdc87: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19415::DEBUG::2011-01-18 20:02:16,108::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19415::DEBUG::2011-01-18 20:02:16,108::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19415::DEBUG::2011-01-18 20:02:16,108::task::577::irs::Task 8644bb5d-695c-4a78-a243-3894efbbdc87: ref 0 aborting False Thread-19415::INFO::2011-01-18 20:02:16,109::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0456409454346', 'lastCheck': 1295373733.2179739, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0469648838043', 'lastCheck': 1295373733.18484, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0460379123688', 'lastCheck': 1295373733.213897, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0480921268463', 'lastCheck': 1295373733.2459581, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0438630580902', 'lastCheck': 1295373733.231811, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:02:17,557::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:18,092::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504117 seconds, 2.0 MB/s\n'; = 0 Thread-19418::INFO::2011-01-18 20:02:19,596::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19418::DEBUG::2011-01-18 20:02:19,596::task::577::irs::Task 48d8a8db-9e1c-4f87-acff-7ca822a91487: moving from state init -> state preparing Thread-19418::DEBUG::2011-01-18 20:02:19,597::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19418::DEBUG::2011-01-18 20:02:19,629::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000911 seconds, 2.2 MB/s\n'; = 0 Thread-19418::DEBUG::2011-01-18 20:02:19,630::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000911 seconds, 2.2 MB/s'], size: 2048 Thread-19418::DEBUG::2011-01-18 20:02:19,630::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19418::DEBUG::2011-01-18 20:02:19,631::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19418::DEBUG::2011-01-18 20:02:19,631::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19418::DEBUG::2011-01-18 20:02:19,631::task::577::irs::Task 48d8a8db-9e1c-4f87-acff-7ca822a91487: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19418::DEBUG::2011-01-18 20:02:19,632::task::577::irs::Task 48d8a8db-9e1c-4f87-acff-7ca822a91487: moving from state preparing -> state finished Thread-19418::DEBUG::2011-01-18 20:02:19,632::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19418::DEBUG::2011-01-18 20:02:19,632::task::577::irs::Task 48d8a8db-9e1c-4f87-acff-7ca822a91487: ref 0 aborting False Thread-19418::INFO::2011-01-18 20:02:19,633::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19419::INFO::2011-01-18 20:02:19,642::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19419::DEBUG::2011-01-18 20:02:19,642::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: moving from state init -> state preparing Thread-19419::DEBUG::2011-01-18 20:02:19,643::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 49b2bebb-ba8f-4976-bfa9-4202a73c3199 acquire shared (120000) Thread-19419::DEBUG::2011-01-18 20:02:19,643::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19419::DEBUG::2011-01-18 20:02:19,643::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '49b2bebb-ba8f-4976-bfa9-4202a73c3199' Thread-19419::DEBUG::2011-01-18 20:02:19,643::resource::524::irs::Owner 49b2bebb-ba8f-4976-bfa9-4202a73c3199: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19419::DEBUG::2011-01-18 20:02:19,644::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19419::DEBUG::2011-01-18 20:02:19,644::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: ref 1 aborting False Thread-19419::INFO::2011-01-18 20:02:19,644::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19419::DEBUG::2011-01-18 20:02:19,645::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19419::DEBUG::2011-01-18 20:02:19,646::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: moving from state preparing -> state finished Thread-19419::DEBUG::2011-01-18 20:02:19,646::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19419::DEBUG::2011-01-18 20:02:19,646::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 49b2bebb-ba8f-4976-bfa9-4202a73c3199 releasing Thread-19419::DEBUG::2011-01-18 20:02:19,646::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19419::DEBUG::2011-01-18 20:02:19,647::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19419::DEBUG::2011-01-18 20:02:19,647::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19419::DEBUG::2011-01-18 20:02:19,647::resource::503::irs::Owner 49b2bebb-ba8f-4976-bfa9-4202a73c3199: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19419::DEBUG::2011-01-18 20:02:19,647::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19419::DEBUG::2011-01-18 20:02:19,648::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19419::DEBUG::2011-01-18 20:02:19,648::task::577::irs::Task 49b2bebb-ba8f-4976-bfa9-4202a73c3199: ref 0 aborting False Thread-19419::INFO::2011-01-18 20:02:19,648::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:02:20,105::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:20,638::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502223 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:22,650::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::INFO::2011-01-18 20:02:23,185::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Dummy-18546::DEBUG::2011-01-18 20:02:23,185::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50219 seconds, 2.0 MB/s\n'; = 0 Thread-18495::DEBUG::2011-01-18 20:02:23,186::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:02:23,214::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:02:23,215::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:02:23,218::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:02:23,219::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:02:23,232::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:02:23,233::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:02:23,239::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 20:02:23,246::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:02:23,247::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:02:23,255::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:02:23,265::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:02:23,273::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:02:23,289::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:25,199::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:25,741::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510765 seconds, 2.0 MB/s\n'; = 0 Thread-19423::INFO::2011-01-18 20:02:26,277::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19423::DEBUG::2011-01-18 20:02:26,277::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: moving from state init -> state preparing Thread-19423::DEBUG::2011-01-18 20:02:26,277::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c586b2dd-1f2c-4001-882f-0d586b2965d0 acquire shared (120000) Thread-19423::DEBUG::2011-01-18 20:02:26,278::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19423::DEBUG::2011-01-18 20:02:26,278::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c586b2dd-1f2c-4001-882f-0d586b2965d0' Thread-19423::DEBUG::2011-01-18 20:02:26,278::resource::524::irs::Owner c586b2dd-1f2c-4001-882f-0d586b2965d0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19423::DEBUG::2011-01-18 20:02:26,279::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19423::DEBUG::2011-01-18 20:02:26,279::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: ref 1 aborting False Thread-19423::DEBUG::2011-01-18 20:02:26,279::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0518219470978', 'lastCheck': 1295373743.2698469, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0450270175934', 'lastCheck': 1295373743.277076, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0673151016235', 'lastCheck': 1295373743.2522421, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484068393707', 'lastCheck': 1295373743.2943089, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0451321601868', 'lastCheck': 1295373743.2589991, 'valid': True, 'code': 0}} Thread-19423::DEBUG::2011-01-18 20:02:26,280::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: moving from state preparing -> state finished Thread-19423::DEBUG::2011-01-18 20:02:26,280::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19423::DEBUG::2011-01-18 20:02:26,280::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c586b2dd-1f2c-4001-882f-0d586b2965d0 releasing Thread-19423::DEBUG::2011-01-18 20:02:26,280::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19423::DEBUG::2011-01-18 20:02:26,281::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19423::DEBUG::2011-01-18 20:02:26,281::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19423::DEBUG::2011-01-18 20:02:26,281::resource::503::irs::Owner c586b2dd-1f2c-4001-882f-0d586b2965d0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19423::DEBUG::2011-01-18 20:02:26,282::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19423::DEBUG::2011-01-18 20:02:26,282::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19423::DEBUG::2011-01-18 20:02:26,282::task::577::irs::Task c586b2dd-1f2c-4001-882f-0d586b2965d0: ref 0 aborting False Thread-19423::INFO::2011-01-18 20:02:26,283::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0518219470978', 'lastCheck': 1295373743.2698469, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0673151016235', 'lastCheck': 1295373743.2522421, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0451321601868', 'lastCheck': 1295373743.2589991, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484068393707', 'lastCheck': 1295373743.2943089, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0450270175934', 'lastCheck': 1295373743.277076, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:02:27,754::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:28,289::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502755 seconds, 2.0 MB/s\n'; = 0 Thread-19426::INFO::2011-01-18 20:02:29,704::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19426::DEBUG::2011-01-18 20:02:29,704::task::577::irs::Task 185546c6-9abb-40f3-a657-4204c7515c21: moving from state init -> state preparing Thread-19426::DEBUG::2011-01-18 20:02:29,705::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19426::DEBUG::2011-01-18 20:02:29,736::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000423 seconds, 4.8 MB/s\n'; = 0 Thread-19426::DEBUG::2011-01-18 20:02:29,737::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000423 seconds, 4.8 MB/s'], size: 2048 Thread-19426::DEBUG::2011-01-18 20:02:29,737::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19426::DEBUG::2011-01-18 20:02:29,738::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19426::DEBUG::2011-01-18 20:02:29,738::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19426::DEBUG::2011-01-18 20:02:29,738::task::577::irs::Task 185546c6-9abb-40f3-a657-4204c7515c21: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19426::DEBUG::2011-01-18 20:02:29,739::task::577::irs::Task 185546c6-9abb-40f3-a657-4204c7515c21: moving from state preparing -> state finished Thread-19426::DEBUG::2011-01-18 20:02:29,739::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19426::DEBUG::2011-01-18 20:02:29,739::task::577::irs::Task 185546c6-9abb-40f3-a657-4204c7515c21: ref 0 aborting False Thread-19426::INFO::2011-01-18 20:02:29,740::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19427::INFO::2011-01-18 20:02:29,748::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19427::DEBUG::2011-01-18 20:02:29,748::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: moving from state init -> state preparing Thread-19427::DEBUG::2011-01-18 20:02:29,748::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0fbc8733-7464-4479-b851-d708107854a4 acquire shared (120000) Thread-19427::DEBUG::2011-01-18 20:02:29,749::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19427::DEBUG::2011-01-18 20:02:29,749::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0fbc8733-7464-4479-b851-d708107854a4' Thread-19427::DEBUG::2011-01-18 20:02:29,749::resource::524::irs::Owner 0fbc8733-7464-4479-b851-d708107854a4: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19427::DEBUG::2011-01-18 20:02:29,750::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19427::DEBUG::2011-01-18 20:02:29,750::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: ref 1 aborting False Thread-19427::INFO::2011-01-18 20:02:29,750::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19427::DEBUG::2011-01-18 20:02:29,751::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19427::DEBUG::2011-01-18 20:02:29,751::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: moving from state preparing -> state finished Thread-19427::DEBUG::2011-01-18 20:02:29,752::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19427::DEBUG::2011-01-18 20:02:29,752::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0fbc8733-7464-4479-b851-d708107854a4 releasing Thread-19427::DEBUG::2011-01-18 20:02:29,752::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19427::DEBUG::2011-01-18 20:02:29,752::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19427::DEBUG::2011-01-18 20:02:29,753::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19427::DEBUG::2011-01-18 20:02:29,753::resource::503::irs::Owner 0fbc8733-7464-4479-b851-d708107854a4: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19427::DEBUG::2011-01-18 20:02:29,753::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19427::DEBUG::2011-01-18 20:02:29,753::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19427::DEBUG::2011-01-18 20:02:29,754::task::577::irs::Task 0fbc8733-7464-4479-b851-d708107854a4: ref 0 aborting False Thread-19427::INFO::2011-01-18 20:02:29,754::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:02:30,305::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:30,840::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503272 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:32,851::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::INFO::2011-01-18 20:02:33,252::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:02:33,253::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:02:33,259::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:02:33,260::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:02:33,270::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:02:33,271::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:02:33,277::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:02:33,279::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:02:33,294::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:02:33,296::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:02:33,300::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:02:33,310::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:02:33,322::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:02:33,324::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:02:33,339::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:33,420::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.536469 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:35,433::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:35,975::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510585 seconds, 2.0 MB/s\n'; = 0 Thread-19431::INFO::2011-01-18 20:02:36,441::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19431::DEBUG::2011-01-18 20:02:36,441::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: moving from state init -> state preparing Thread-19431::DEBUG::2011-01-18 20:02:36,441::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ac11859e-5ecf-4530-8007-a480b351ee34 acquire shared (120000) Thread-19431::DEBUG::2011-01-18 20:02:36,442::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19431::DEBUG::2011-01-18 20:02:36,442::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ac11859e-5ecf-4530-8007-a480b351ee34' Thread-19431::DEBUG::2011-01-18 20:02:36,442::resource::524::irs::Owner ac11859e-5ecf-4530-8007-a480b351ee34: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19431::DEBUG::2011-01-18 20:02:36,442::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19431::DEBUG::2011-01-18 20:02:36,443::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: ref 1 aborting False Thread-19431::DEBUG::2011-01-18 20:02:36,443::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0578260421753', 'lastCheck': 1295373753.327703, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0487170219421', 'lastCheck': 1295373753.325633, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0558609962463', 'lastCheck': 1295373753.3077149, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0504009723663', 'lastCheck': 1295373753.344285, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0554800033569', 'lastCheck': 1295373753.314358, 'valid': True, 'code': 0}} Thread-19431::DEBUG::2011-01-18 20:02:36,444::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: moving from state preparing -> state finished Thread-19431::DEBUG::2011-01-18 20:02:36,444::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19431::DEBUG::2011-01-18 20:02:36,444::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ac11859e-5ecf-4530-8007-a480b351ee34 releasing Thread-19431::DEBUG::2011-01-18 20:02:36,444::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19431::DEBUG::2011-01-18 20:02:36,445::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19431::DEBUG::2011-01-18 20:02:36,445::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19431::DEBUG::2011-01-18 20:02:36,445::resource::503::irs::Owner ac11859e-5ecf-4530-8007-a480b351ee34: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19431::DEBUG::2011-01-18 20:02:36,446::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19431::DEBUG::2011-01-18 20:02:36,446::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19431::DEBUG::2011-01-18 20:02:36,446::task::577::irs::Task ac11859e-5ecf-4530-8007-a480b351ee34: ref 0 aborting False Thread-19431::INFO::2011-01-18 20:02:36,447::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0578260421753', 'lastCheck': 1295373753.327703, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0558609962463', 'lastCheck': 1295373753.3077149, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0554800033569', 'lastCheck': 1295373753.314358, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0504009723663', 'lastCheck': 1295373753.344285, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0487170219421', 'lastCheck': 1295373753.325633, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:02:37,988::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:38,527::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507577 seconds, 2.0 MB/s\n'; = 0 Thread-19434::INFO::2011-01-18 20:02:39,806::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19434::DEBUG::2011-01-18 20:02:39,806::task::577::irs::Task 503c00e4-4ec4-4d63-b27c-38cd02c7a4e6: moving from state init -> state preparing Thread-19434::DEBUG::2011-01-18 20:02:39,807::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19434::DEBUG::2011-01-18 20:02:39,839::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00047 seconds, 4.4 MB/s\n'; = 0 Thread-19434::DEBUG::2011-01-18 20:02:39,839::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00047 seconds, 4.4 MB/s'], size: 2048 Thread-19434::DEBUG::2011-01-18 20:02:39,840::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19434::DEBUG::2011-01-18 20:02:39,840::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19434::DEBUG::2011-01-18 20:02:39,841::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19434::DEBUG::2011-01-18 20:02:39,841::task::577::irs::Task 503c00e4-4ec4-4d63-b27c-38cd02c7a4e6: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19434::DEBUG::2011-01-18 20:02:39,841::task::577::irs::Task 503c00e4-4ec4-4d63-b27c-38cd02c7a4e6: moving from state preparing -> state finished Thread-19434::DEBUG::2011-01-18 20:02:39,842::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19434::DEBUG::2011-01-18 20:02:39,842::task::577::irs::Task 503c00e4-4ec4-4d63-b27c-38cd02c7a4e6: ref 0 aborting False Thread-19434::INFO::2011-01-18 20:02:39,842::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19435::INFO::2011-01-18 20:02:39,851::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19435::DEBUG::2011-01-18 20:02:39,851::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: moving from state init -> state preparing Thread-19435::DEBUG::2011-01-18 20:02:39,852::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b753d06f-54df-4b85-bbab-159f5c6194ce acquire shared (120000) Thread-19435::DEBUG::2011-01-18 20:02:39,852::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19435::DEBUG::2011-01-18 20:02:39,852::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b753d06f-54df-4b85-bbab-159f5c6194ce' Thread-19435::DEBUG::2011-01-18 20:02:39,853::resource::524::irs::Owner b753d06f-54df-4b85-bbab-159f5c6194ce: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19435::DEBUG::2011-01-18 20:02:39,853::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19435::DEBUG::2011-01-18 20:02:39,853::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: ref 1 aborting False Thread-19435::INFO::2011-01-18 20:02:39,854::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19435::DEBUG::2011-01-18 20:02:39,854::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19435::DEBUG::2011-01-18 20:02:39,855::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: moving from state preparing -> state finished Thread-19435::DEBUG::2011-01-18 20:02:39,855::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19435::DEBUG::2011-01-18 20:02:39,855::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b753d06f-54df-4b85-bbab-159f5c6194ce releasing Thread-19435::DEBUG::2011-01-18 20:02:39,855::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19435::DEBUG::2011-01-18 20:02:39,856::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19435::DEBUG::2011-01-18 20:02:39,856::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19435::DEBUG::2011-01-18 20:02:39,856::resource::503::irs::Owner b753d06f-54df-4b85-bbab-159f5c6194ce: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19435::DEBUG::2011-01-18 20:02:39,856::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19435::DEBUG::2011-01-18 20:02:39,857::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19435::DEBUG::2011-01-18 20:02:39,857::task::577::irs::Task b753d06f-54df-4b85-bbab-159f5c6194ce: ref 0 aborting False Thread-19435::INFO::2011-01-18 20:02:39,857::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:02:40,541::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:41,075::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501699 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:43,088::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::INFO::2011-01-18 20:02:43,307::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:02:43,307::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:02:43,314::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:02:43,315::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:02:43,325::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:02:43,326::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:02:43,327::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:02:43,328::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:02:43,344::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:02:43,346::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:02:43,351::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:02:43,361::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:02:43,371::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:02:43,378::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:02:43,391::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:43,653::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.534036 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:45,666::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:46,208::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510139 seconds, 2.0 MB/s\n'; = 0 Thread-19439::INFO::2011-01-18 20:02:46,607::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19439::DEBUG::2011-01-18 20:02:46,607::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: moving from state init -> state preparing Thread-19439::DEBUG::2011-01-18 20:02:46,608::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 498a0f5f-a344-4314-9010-28c5d25dc107 acquire shared (120000) Thread-19439::DEBUG::2011-01-18 20:02:46,608::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19439::DEBUG::2011-01-18 20:02:46,608::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '498a0f5f-a344-4314-9010-28c5d25dc107' Thread-19439::DEBUG::2011-01-18 20:02:46,609::resource::524::irs::Owner 498a0f5f-a344-4314-9010-28c5d25dc107: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19439::DEBUG::2011-01-18 20:02:46,609::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19439::DEBUG::2011-01-18 20:02:46,609::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: ref 1 aborting False Thread-19439::DEBUG::2011-01-18 20:02:46,609::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0558478832245', 'lastCheck': 1295373763.3827939, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0495789051056', 'lastCheck': 1295373763.3744979, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.051735162735', 'lastCheck': 1295373763.3585861, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0515809059143', 'lastCheck': 1295373763.3955059, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0514991283417', 'lastCheck': 1295373763.365463, 'valid': True, 'code': 0}} Thread-19439::DEBUG::2011-01-18 20:02:46,610::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: moving from state preparing -> state finished Thread-19439::DEBUG::2011-01-18 20:02:46,610::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19439::DEBUG::2011-01-18 20:02:46,610::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 498a0f5f-a344-4314-9010-28c5d25dc107 releasing Thread-19439::DEBUG::2011-01-18 20:02:46,611::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19439::DEBUG::2011-01-18 20:02:46,611::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19439::DEBUG::2011-01-18 20:02:46,611::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19439::DEBUG::2011-01-18 20:02:46,611::resource::503::irs::Owner 498a0f5f-a344-4314-9010-28c5d25dc107: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19439::DEBUG::2011-01-18 20:02:46,612::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19439::DEBUG::2011-01-18 20:02:46,612::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19439::DEBUG::2011-01-18 20:02:46,612::task::577::irs::Task 498a0f5f-a344-4314-9010-28c5d25dc107: ref 0 aborting False Thread-19439::INFO::2011-01-18 20:02:46,613::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0558478832245', 'lastCheck': 1295373763.3827939, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.051735162735', 'lastCheck': 1295373763.3585861, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0514991283417', 'lastCheck': 1295373763.365463, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0515809059143', 'lastCheck': 1295373763.3955059, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0495789051056', 'lastCheck': 1295373763.3744979, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:02:48,221::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:48,757::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504134 seconds, 2.0 MB/s\n'; = 0 Thread-19442::INFO::2011-01-18 20:02:49,911::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19442::DEBUG::2011-01-18 20:02:49,911::task::577::irs::Task e1fa53ae-cf4c-43d5-a7c1-b58d2041f589: moving from state init -> state preparing Thread-19442::DEBUG::2011-01-18 20:02:49,912::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19442::DEBUG::2011-01-18 20:02:49,944::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000518 seconds, 4.0 MB/s\n'; = 0 Thread-19442::DEBUG::2011-01-18 20:02:49,944::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000518 seconds, 4.0 MB/s'], size: 2048 Thread-19442::DEBUG::2011-01-18 20:02:49,945::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19442::DEBUG::2011-01-18 20:02:49,945::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19442::DEBUG::2011-01-18 20:02:49,945::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19442::DEBUG::2011-01-18 20:02:49,946::task::577::irs::Task e1fa53ae-cf4c-43d5-a7c1-b58d2041f589: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19442::DEBUG::2011-01-18 20:02:49,946::task::577::irs::Task e1fa53ae-cf4c-43d5-a7c1-b58d2041f589: moving from state preparing -> state finished Thread-19442::DEBUG::2011-01-18 20:02:49,946::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19442::DEBUG::2011-01-18 20:02:49,947::task::577::irs::Task e1fa53ae-cf4c-43d5-a7c1-b58d2041f589: ref 0 aborting False Thread-19442::INFO::2011-01-18 20:02:49,947::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19443::INFO::2011-01-18 20:02:49,955::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19443::DEBUG::2011-01-18 20:02:49,956::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: moving from state init -> state preparing Thread-19443::DEBUG::2011-01-18 20:02:49,956::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f2647046-2aa3-4148-b236-4765b2358302 acquire shared (120000) Thread-19443::DEBUG::2011-01-18 20:02:49,956::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19443::DEBUG::2011-01-18 20:02:49,956::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f2647046-2aa3-4148-b236-4765b2358302' Thread-19443::DEBUG::2011-01-18 20:02:49,957::resource::524::irs::Owner f2647046-2aa3-4148-b236-4765b2358302: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19443::DEBUG::2011-01-18 20:02:49,957::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19443::DEBUG::2011-01-18 20:02:49,957::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: ref 1 aborting False Thread-19443::INFO::2011-01-18 20:02:49,958::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19443::DEBUG::2011-01-18 20:02:49,958::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19443::DEBUG::2011-01-18 20:02:49,959::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: moving from state preparing -> state finished Thread-19443::DEBUG::2011-01-18 20:02:49,959::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19443::DEBUG::2011-01-18 20:02:49,959::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f2647046-2aa3-4148-b236-4765b2358302 releasing Thread-19443::DEBUG::2011-01-18 20:02:49,960::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19443::DEBUG::2011-01-18 20:02:49,960::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19443::DEBUG::2011-01-18 20:02:49,960::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19443::DEBUG::2011-01-18 20:02:49,960::resource::503::irs::Owner f2647046-2aa3-4148-b236-4765b2358302: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19443::DEBUG::2011-01-18 20:02:49,961::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19443::DEBUG::2011-01-18 20:02:49,961::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19443::DEBUG::2011-01-18 20:02:49,961::task::577::irs::Task f2647046-2aa3-4148-b236-4765b2358302: ref 0 aborting False Thread-19443::INFO::2011-01-18 20:02:49,962::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:02:50,768::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:51,301::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500945 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:53,313::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::INFO::2011-01-18 20:02:53,358::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:02:53,359::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:02:53,365::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:02:53,366::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:02:53,374::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:02:53,375::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:02:53,382::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:02:53,383::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:02:53,395::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:02:53,397::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:02:53,404::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:02:53,414::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:02:53,425::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:02:53,426::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:02:53,440::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:53,880::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.535794 seconds, 1.9 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:02:55,893::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:56,435::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510461 seconds, 2.0 MB/s\n'; = 0 Thread-19447::INFO::2011-01-18 20:02:56,784::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19447::DEBUG::2011-01-18 20:02:56,785::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: moving from state init -> state preparing Thread-19447::DEBUG::2011-01-18 20:02:56,785::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6cabc5de-7b8d-4aa1-afd9-e32125735bae acquire shared (120000) Thread-19447::DEBUG::2011-01-18 20:02:56,785::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19447::DEBUG::2011-01-18 20:02:56,785::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6cabc5de-7b8d-4aa1-afd9-e32125735bae' Thread-19447::DEBUG::2011-01-18 20:02:56,786::resource::524::irs::Owner 6cabc5de-7b8d-4aa1-afd9-e32125735bae: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19447::DEBUG::2011-01-18 20:02:56,786::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19447::DEBUG::2011-01-18 20:02:56,786::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: ref 1 aborting False Thread-19447::DEBUG::2011-01-18 20:02:56,787::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0479779243469', 'lastCheck': 1295373773.4298589, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0568890571594', 'lastCheck': 1295373773.430779, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0531160831451', 'lastCheck': 1295373773.410974, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.049544095993', 'lastCheck': 1295373773.444427, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0538289546967', 'lastCheck': 1295373773.4187019, 'valid': True, 'code': 0}} Thread-19447::DEBUG::2011-01-18 20:02:56,787::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: moving from state preparing -> state finished Thread-19447::DEBUG::2011-01-18 20:02:56,787::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19447::DEBUG::2011-01-18 20:02:56,788::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6cabc5de-7b8d-4aa1-afd9-e32125735bae releasing Thread-19447::DEBUG::2011-01-18 20:02:56,788::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19447::DEBUG::2011-01-18 20:02:56,788::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19447::DEBUG::2011-01-18 20:02:56,788::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19447::DEBUG::2011-01-18 20:02:56,789::resource::503::irs::Owner 6cabc5de-7b8d-4aa1-afd9-e32125735bae: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19447::DEBUG::2011-01-18 20:02:56,789::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19447::DEBUG::2011-01-18 20:02:56,789::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19447::DEBUG::2011-01-18 20:02:56,790::task::577::irs::Task 6cabc5de-7b8d-4aa1-afd9-e32125735bae: ref 0 aborting False Thread-19447::INFO::2011-01-18 20:02:56,790::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0479779243469', 'lastCheck': 1295373773.4298589, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0531160831451', 'lastCheck': 1295373773.410974, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0538289546967', 'lastCheck': 1295373773.4187019, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.049544095993', 'lastCheck': 1295373773.444427, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0568890571594', 'lastCheck': 1295373773.430779, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:02:58,450::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:02:58,985::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50356 seconds, 2.0 MB/s\n'; = 0 Thread-19450::INFO::2011-01-18 20:03:00,024::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19450::DEBUG::2011-01-18 20:03:00,025::task::577::irs::Task 28e585dc-22ad-4762-8ebc-1ea8b0cbab04: moving from state init -> state preparing Thread-19450::DEBUG::2011-01-18 20:03:00,025::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19450::DEBUG::2011-01-18 20:03:00,057::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000441 seconds, 4.6 MB/s\n'; = 0 Thread-19450::DEBUG::2011-01-18 20:03:00,058::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000441 seconds, 4.6 MB/s'], size: 2048 Thread-19450::DEBUG::2011-01-18 20:03:00,058::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19450::DEBUG::2011-01-18 20:03:00,059::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19450::DEBUG::2011-01-18 20:03:00,059::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19450::DEBUG::2011-01-18 20:03:00,060::task::577::irs::Task 28e585dc-22ad-4762-8ebc-1ea8b0cbab04: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19450::DEBUG::2011-01-18 20:03:00,060::task::577::irs::Task 28e585dc-22ad-4762-8ebc-1ea8b0cbab04: moving from state preparing -> state finished Thread-19450::DEBUG::2011-01-18 20:03:00,060::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19450::DEBUG::2011-01-18 20:03:00,060::task::577::irs::Task 28e585dc-22ad-4762-8ebc-1ea8b0cbab04: ref 0 aborting False Thread-19450::INFO::2011-01-18 20:03:00,061::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19451::INFO::2011-01-18 20:03:00,069::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19451::DEBUG::2011-01-18 20:03:00,069::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: moving from state init -> state preparing Thread-19451::DEBUG::2011-01-18 20:03:00,070::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 830bf8c1-9b13-4f08-9cf1-1dc4309d5897 acquire shared (120000) Thread-19451::DEBUG::2011-01-18 20:03:00,070::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19451::DEBUG::2011-01-18 20:03:00,070::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '830bf8c1-9b13-4f08-9cf1-1dc4309d5897' Thread-19451::DEBUG::2011-01-18 20:03:00,071::resource::524::irs::Owner 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19451::DEBUG::2011-01-18 20:03:00,071::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19451::DEBUG::2011-01-18 20:03:00,071::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: ref 1 aborting False Thread-19451::INFO::2011-01-18 20:03:00,072::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19451::DEBUG::2011-01-18 20:03:00,072::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19451::DEBUG::2011-01-18 20:03:00,073::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: moving from state preparing -> state finished Thread-19451::DEBUG::2011-01-18 20:03:00,073::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19451::DEBUG::2011-01-18 20:03:00,073::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 830bf8c1-9b13-4f08-9cf1-1dc4309d5897 releasing Thread-19451::DEBUG::2011-01-18 20:03:00,073::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19451::DEBUG::2011-01-18 20:03:00,074::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19451::DEBUG::2011-01-18 20:03:00,074::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19451::DEBUG::2011-01-18 20:03:00,074::resource::503::irs::Owner 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19451::DEBUG::2011-01-18 20:03:00,075::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19451::DEBUG::2011-01-18 20:03:00,075::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19451::DEBUG::2011-01-18 20:03:00,075::task::577::irs::Task 830bf8c1-9b13-4f08-9cf1-1dc4309d5897: ref 0 aborting False Thread-19451::INFO::2011-01-18 20:03:00,075::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:03:01,000::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:01,535::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50407 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:03:03,410::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:03:03,411::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:03:03,418::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:03:03,419::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:03:03,430::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18494::INFO::2011-01-18 20:03:03,430::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::DEBUG::2011-01-18 20:03:03,431::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:03:03,432::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:03:03,450::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:03:03,451::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:03:03,454::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:03:03,458::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:03:03,473::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:03:03,479::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:03:03,492::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:03,549::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:04,085::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504633 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:06,098::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:06,643::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512514 seconds, 2.0 MB/s\n'; = 0 Thread-19455::INFO::2011-01-18 20:03:06,955::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19455::DEBUG::2011-01-18 20:03:06,956::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: moving from state init -> state preparing Thread-19455::DEBUG::2011-01-18 20:03:06,956::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9db6155e-c64c-4f17-b644-2a8fb12e52d7 acquire shared (120000) Thread-19455::DEBUG::2011-01-18 20:03:06,956::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19455::DEBUG::2011-01-18 20:03:06,957::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9db6155e-c64c-4f17-b644-2a8fb12e52d7' Thread-19455::DEBUG::2011-01-18 20:03:06,957::resource::524::irs::Owner 9db6155e-c64c-4f17-b644-2a8fb12e52d7: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19455::DEBUG::2011-01-18 20:03:06,957::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19455::DEBUG::2011-01-18 20:03:06,958::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: ref 1 aborting False Thread-19455::DEBUG::2011-01-18 20:03:06,958::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0467891693115', 'lastCheck': 1295373783.4766631, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0537171363831', 'lastCheck': 1295373783.4842861, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.051549911499', 'lastCheck': 1295373783.462404, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466768741608', 'lastCheck': 1295373783.4965479, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455071926117', 'lastCheck': 1295373783.4633751, 'valid': True, 'code': 0}} Thread-19455::DEBUG::2011-01-18 20:03:06,958::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: moving from state preparing -> state finished Thread-19455::DEBUG::2011-01-18 20:03:06,959::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19455::DEBUG::2011-01-18 20:03:06,959::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9db6155e-c64c-4f17-b644-2a8fb12e52d7 releasing Thread-19455::DEBUG::2011-01-18 20:03:06,959::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19455::DEBUG::2011-01-18 20:03:06,959::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19455::DEBUG::2011-01-18 20:03:06,960::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19455::DEBUG::2011-01-18 20:03:06,960::resource::503::irs::Owner 9db6155e-c64c-4f17-b644-2a8fb12e52d7: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19455::DEBUG::2011-01-18 20:03:06,960::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19455::DEBUG::2011-01-18 20:03:06,961::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19455::DEBUG::2011-01-18 20:03:06,961::task::577::irs::Task 9db6155e-c64c-4f17-b644-2a8fb12e52d7: ref 0 aborting False Thread-19455::INFO::2011-01-18 20:03:06,961::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0467891693115', 'lastCheck': 1295373783.4766631, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.051549911499', 'lastCheck': 1295373783.462404, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455071926117', 'lastCheck': 1295373783.4633751, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0466768741608', 'lastCheck': 1295373783.4965479, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0537171363831', 'lastCheck': 1295373783.4842861, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:03:08,656::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:09,192::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503854 seconds, 2.0 MB/s\n'; = 0 Thread-19458::INFO::2011-01-18 20:03:10,131::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19458::DEBUG::2011-01-18 20:03:10,132::task::577::irs::Task eaba2353-b0cc-4040-a6d3-af8bb8edc0d8: moving from state init -> state preparing Thread-19458::DEBUG::2011-01-18 20:03:10,132::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19458::DEBUG::2011-01-18 20:03:10,164::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000471 seconds, 4.3 MB/s\n'; = 0 Thread-19458::DEBUG::2011-01-18 20:03:10,165::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000471 seconds, 4.3 MB/s'], size: 2048 Thread-19458::DEBUG::2011-01-18 20:03:10,165::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19458::DEBUG::2011-01-18 20:03:10,166::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19458::DEBUG::2011-01-18 20:03:10,166::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19458::DEBUG::2011-01-18 20:03:10,166::task::577::irs::Task eaba2353-b0cc-4040-a6d3-af8bb8edc0d8: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19458::DEBUG::2011-01-18 20:03:10,167::task::577::irs::Task eaba2353-b0cc-4040-a6d3-af8bb8edc0d8: moving from state preparing -> state finished Thread-19458::DEBUG::2011-01-18 20:03:10,167::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19458::DEBUG::2011-01-18 20:03:10,167::task::577::irs::Task eaba2353-b0cc-4040-a6d3-af8bb8edc0d8: ref 0 aborting False Thread-19458::INFO::2011-01-18 20:03:10,168::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19459::INFO::2011-01-18 20:03:10,176::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19459::DEBUG::2011-01-18 20:03:10,176::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: moving from state init -> state preparing Thread-19459::DEBUG::2011-01-18 20:03:10,176::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d27956cf-4060-46ab-ba44-865de6fdd6a5 acquire shared (120000) Thread-19459::DEBUG::2011-01-18 20:03:10,177::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19459::DEBUG::2011-01-18 20:03:10,177::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd27956cf-4060-46ab-ba44-865de6fdd6a5' Thread-19459::DEBUG::2011-01-18 20:03:10,177::resource::524::irs::Owner d27956cf-4060-46ab-ba44-865de6fdd6a5: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19459::DEBUG::2011-01-18 20:03:10,178::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19459::DEBUG::2011-01-18 20:03:10,178::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: ref 1 aborting False Thread-19459::INFO::2011-01-18 20:03:10,178::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19459::DEBUG::2011-01-18 20:03:10,179::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19459::DEBUG::2011-01-18 20:03:10,179::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: moving from state preparing -> state finished Thread-19459::DEBUG::2011-01-18 20:03:10,180::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19459::DEBUG::2011-01-18 20:03:10,180::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d27956cf-4060-46ab-ba44-865de6fdd6a5 releasing Thread-19459::DEBUG::2011-01-18 20:03:10,180::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19459::DEBUG::2011-01-18 20:03:10,180::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19459::DEBUG::2011-01-18 20:03:10,181::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19459::DEBUG::2011-01-18 20:03:10,181::resource::503::irs::Owner d27956cf-4060-46ab-ba44-865de6fdd6a5: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19459::DEBUG::2011-01-18 20:03:10,181::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19459::DEBUG::2011-01-18 20:03:10,182::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19459::DEBUG::2011-01-18 20:03:10,182::task::577::irs::Task d27956cf-4060-46ab-ba44-865de6fdd6a5: ref 0 aborting False Thread-19459::INFO::2011-01-18 20:03:10,182::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:03:11,205::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:11,738::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501927 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:03:13,461::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:03:13,462::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:03:13,462::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:03:13,465::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:03:13,476::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:03:13,477::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:03:13,484::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:03:13,485::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:03:13,496::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:03:13,497::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:03:13,503::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:03:13,510::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:03:13,518::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:03:13,531::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:03:13,539::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:13,753::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:14,286::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502061 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:16,301::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:16,843::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51098 seconds, 2.0 MB/s\n'; = 0 Thread-19463::INFO::2011-01-18 20:03:17,147::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19463::DEBUG::2011-01-18 20:03:17,148::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: moving from state init -> state preparing Thread-19463::DEBUG::2011-01-18 20:03:17,148::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4ad1466f-84cb-4853-b4f8-7d021488a3fd acquire shared (120000) Thread-19463::DEBUG::2011-01-18 20:03:17,148::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19463::DEBUG::2011-01-18 20:03:17,149::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4ad1466f-84cb-4853-b4f8-7d021488a3fd' Thread-19463::DEBUG::2011-01-18 20:03:17,149::resource::524::irs::Owner 4ad1466f-84cb-4853-b4f8-7d021488a3fd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19463::DEBUG::2011-01-18 20:03:17,149::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19463::DEBUG::2011-01-18 20:03:17,150::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: ref 1 aborting False Thread-19463::DEBUG::2011-01-18 20:03:17,150::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0463790893555', 'lastCheck': 1295373793.5222421, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0511729717255', 'lastCheck': 1295373793.5350809, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0480470657349', 'lastCheck': 1295373793.5098851, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0483751296997', 'lastCheck': 1295373793.5442901, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0521137714386', 'lastCheck': 1295373793.5150149, 'valid': True, 'code': 0}} Thread-19463::DEBUG::2011-01-18 20:03:17,150::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: moving from state preparing -> state finished Thread-19463::DEBUG::2011-01-18 20:03:17,151::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19463::DEBUG::2011-01-18 20:03:17,151::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4ad1466f-84cb-4853-b4f8-7d021488a3fd releasing Thread-19463::DEBUG::2011-01-18 20:03:17,151::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19463::DEBUG::2011-01-18 20:03:17,152::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19463::DEBUG::2011-01-18 20:03:17,152::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19463::DEBUG::2011-01-18 20:03:17,152::resource::503::irs::Owner 4ad1466f-84cb-4853-b4f8-7d021488a3fd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19463::DEBUG::2011-01-18 20:03:17,152::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19463::DEBUG::2011-01-18 20:03:17,153::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19463::DEBUG::2011-01-18 20:03:17,153::task::577::irs::Task 4ad1466f-84cb-4853-b4f8-7d021488a3fd: ref 0 aborting False Thread-19463::INFO::2011-01-18 20:03:17,153::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0463790893555', 'lastCheck': 1295373793.5222421, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0480470657349', 'lastCheck': 1295373793.5098851, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0521137714386', 'lastCheck': 1295373793.5150149, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0483751296997', 'lastCheck': 1295373793.5442901, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0511729717255', 'lastCheck': 1295373793.5350809, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:03:18,856::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:19,389::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501627 seconds, 2.0 MB/s\n'; = 0 Thread-19466::INFO::2011-01-18 20:03:20,234::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19466::DEBUG::2011-01-18 20:03:20,235::task::577::irs::Task fe9b7052-3ba1-4324-abf0-17d3b6adb06d: moving from state init -> state preparing Thread-19466::DEBUG::2011-01-18 20:03:20,235::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19466::DEBUG::2011-01-18 20:03:20,267::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000462 seconds, 4.4 MB/s\n'; = 0 Thread-19466::DEBUG::2011-01-18 20:03:20,267::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000462 seconds, 4.4 MB/s'], size: 2048 Thread-19466::DEBUG::2011-01-18 20:03:20,268::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19466::DEBUG::2011-01-18 20:03:20,268::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19466::DEBUG::2011-01-18 20:03:20,269::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19466::DEBUG::2011-01-18 20:03:20,269::task::577::irs::Task fe9b7052-3ba1-4324-abf0-17d3b6adb06d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19466::DEBUG::2011-01-18 20:03:20,269::task::577::irs::Task fe9b7052-3ba1-4324-abf0-17d3b6adb06d: moving from state preparing -> state finished Thread-19466::DEBUG::2011-01-18 20:03:20,270::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19466::DEBUG::2011-01-18 20:03:20,270::task::577::irs::Task fe9b7052-3ba1-4324-abf0-17d3b6adb06d: ref 0 aborting False Thread-19466::INFO::2011-01-18 20:03:20,270::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19467::INFO::2011-01-18 20:03:20,278::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19467::DEBUG::2011-01-18 20:03:20,279::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: moving from state init -> state preparing Thread-19467::DEBUG::2011-01-18 20:03:20,279::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fdf9552d-ee47-44b4-bfda-1bc6669f0b0f acquire shared (120000) Thread-19467::DEBUG::2011-01-18 20:03:20,279::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19467::DEBUG::2011-01-18 20:03:20,280::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'fdf9552d-ee47-44b4-bfda-1bc6669f0b0f' Thread-19467::DEBUG::2011-01-18 20:03:20,280::resource::524::irs::Owner fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19467::DEBUG::2011-01-18 20:03:20,280::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19467::DEBUG::2011-01-18 20:03:20,280::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: ref 1 aborting False Thread-19467::INFO::2011-01-18 20:03:20,281::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19467::DEBUG::2011-01-18 20:03:20,281::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19467::DEBUG::2011-01-18 20:03:20,282::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: moving from state preparing -> state finished Thread-19467::DEBUG::2011-01-18 20:03:20,282::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19467::DEBUG::2011-01-18 20:03:20,282::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: fdf9552d-ee47-44b4-bfda-1bc6669f0b0f releasing Thread-19467::DEBUG::2011-01-18 20:03:20,283::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19467::DEBUG::2011-01-18 20:03:20,283::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19467::DEBUG::2011-01-18 20:03:20,283::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19467::DEBUG::2011-01-18 20:03:20,283::resource::503::irs::Owner fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19467::DEBUG::2011-01-18 20:03:20,284::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19467::DEBUG::2011-01-18 20:03:20,284::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19467::DEBUG::2011-01-18 20:03:20,284::task::577::irs::Task fdf9552d-ee47-44b4-bfda-1bc6669f0b0f: ref 0 aborting False Thread-19467::INFO::2011-01-18 20:03:20,285::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:03:21,402::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:21,935::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501104 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:03:23,509::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:03:23,510::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:03:23,515::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:03:23,516::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:03:23,522::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:03:23,523::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:03:23,535::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:03:23,536::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:03:23,544::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:03:23,545::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:03:23,550::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:03:23,557::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:03:23,565::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:03:23,578::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:03:23,586::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:23,948::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:24,482::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502105 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:26,495::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:27,066::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.538883 seconds, 1.9 MB/s\n'; = 0 Thread-19471::INFO::2011-01-18 20:03:27,314::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19471::DEBUG::2011-01-18 20:03:27,315::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: moving from state init -> state preparing Thread-19471::DEBUG::2011-01-18 20:03:27,315::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 683d5ccb-3694-4c42-842b-ec20050044ff acquire shared (120000) Thread-19471::DEBUG::2011-01-18 20:03:27,315::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19471::DEBUG::2011-01-18 20:03:27,316::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '683d5ccb-3694-4c42-842b-ec20050044ff' Thread-19471::DEBUG::2011-01-18 20:03:27,316::resource::524::irs::Owner 683d5ccb-3694-4c42-842b-ec20050044ff: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19471::DEBUG::2011-01-18 20:03:27,316::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19471::DEBUG::2011-01-18 20:03:27,316::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: ref 1 aborting False Thread-19471::DEBUG::2011-01-18 20:03:27,317::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0471220016479', 'lastCheck': 1295373803.568989, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473051071167', 'lastCheck': 1295373803.5822761, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476169586182', 'lastCheck': 1295373803.5574939, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471358299255', 'lastCheck': 1295373803.5910089, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0473630428314', 'lastCheck': 1295373803.5622351, 'valid': True, 'code': 0}} Thread-19471::DEBUG::2011-01-18 20:03:27,317::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: moving from state preparing -> state finished Thread-19471::DEBUG::2011-01-18 20:03:27,318::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19471::DEBUG::2011-01-18 20:03:27,318::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 683d5ccb-3694-4c42-842b-ec20050044ff releasing Thread-19471::DEBUG::2011-01-18 20:03:27,318::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19471::DEBUG::2011-01-18 20:03:27,318::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19471::DEBUG::2011-01-18 20:03:27,319::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19471::DEBUG::2011-01-18 20:03:27,319::resource::503::irs::Owner 683d5ccb-3694-4c42-842b-ec20050044ff: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19471::DEBUG::2011-01-18 20:03:27,319::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19471::DEBUG::2011-01-18 20:03:27,319::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19471::DEBUG::2011-01-18 20:03:27,320::task::577::irs::Task 683d5ccb-3694-4c42-842b-ec20050044ff: ref 0 aborting False Thread-19471::INFO::2011-01-18 20:03:27,320::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0471220016479', 'lastCheck': 1295373803.568989, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0476169586182', 'lastCheck': 1295373803.5574939, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0473630428314', 'lastCheck': 1295373803.5622351, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471358299255', 'lastCheck': 1295373803.5910089, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473051071167', 'lastCheck': 1295373803.5822761, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:03:29,077::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:29,612::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502249 seconds, 2.0 MB/s\n'; = 0 Thread-19474::INFO::2011-01-18 20:03:30,337::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19474::DEBUG::2011-01-18 20:03:30,338::task::577::irs::Task 1a079562-fd13-46ea-a90b-00e142d2ded1: moving from state init -> state preparing Thread-19474::DEBUG::2011-01-18 20:03:30,338::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19474::DEBUG::2011-01-18 20:03:30,370::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000403 seconds, 5.1 MB/s\n'; = 0 Thread-19474::DEBUG::2011-01-18 20:03:30,370::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000403 seconds, 5.1 MB/s'], size: 2048 Thread-19474::DEBUG::2011-01-18 20:03:30,371::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19474::DEBUG::2011-01-18 20:03:30,371::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19474::DEBUG::2011-01-18 20:03:30,372::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19474::DEBUG::2011-01-18 20:03:30,372::task::577::irs::Task 1a079562-fd13-46ea-a90b-00e142d2ded1: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19474::DEBUG::2011-01-18 20:03:30,372::task::577::irs::Task 1a079562-fd13-46ea-a90b-00e142d2ded1: moving from state preparing -> state finished Thread-19474::DEBUG::2011-01-18 20:03:30,372::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19474::DEBUG::2011-01-18 20:03:30,373::task::577::irs::Task 1a079562-fd13-46ea-a90b-00e142d2ded1: ref 0 aborting False Thread-19474::INFO::2011-01-18 20:03:30,373::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19475::INFO::2011-01-18 20:03:30,383::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19475::DEBUG::2011-01-18 20:03:30,384::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: moving from state init -> state preparing Thread-19475::DEBUG::2011-01-18 20:03:30,384::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2efb90ea-539a-4424-a96d-10d0e716460d acquire shared (120000) Thread-19475::DEBUG::2011-01-18 20:03:30,384::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19475::DEBUG::2011-01-18 20:03:30,385::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2efb90ea-539a-4424-a96d-10d0e716460d' Thread-19475::DEBUG::2011-01-18 20:03:30,385::resource::524::irs::Owner 2efb90ea-539a-4424-a96d-10d0e716460d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19475::DEBUG::2011-01-18 20:03:30,385::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19475::DEBUG::2011-01-18 20:03:30,386::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: ref 1 aborting False Thread-19475::INFO::2011-01-18 20:03:30,386::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19475::DEBUG::2011-01-18 20:03:30,387::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19475::DEBUG::2011-01-18 20:03:30,387::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: moving from state preparing -> state finished Thread-19475::DEBUG::2011-01-18 20:03:30,387::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19475::DEBUG::2011-01-18 20:03:30,388::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2efb90ea-539a-4424-a96d-10d0e716460d releasing Thread-19475::DEBUG::2011-01-18 20:03:30,388::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19475::DEBUG::2011-01-18 20:03:30,388::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19475::DEBUG::2011-01-18 20:03:30,389::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19475::DEBUG::2011-01-18 20:03:30,389::resource::503::irs::Owner 2efb90ea-539a-4424-a96d-10d0e716460d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19475::DEBUG::2011-01-18 20:03:30,389::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19475::DEBUG::2011-01-18 20:03:30,390::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19475::DEBUG::2011-01-18 20:03:30,390::task::577::irs::Task 2efb90ea-539a-4424-a96d-10d0e716460d: ref 0 aborting False Thread-19475::INFO::2011-01-18 20:03:30,390::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:03:31,625::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:32,159::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501944 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:03:33,556::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:03:33,557::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:03:33,562::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:03:33,563::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:03:33,569::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:03:33,570::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:03:33,582::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:03:33,583::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:03:33,591::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:03:33,592::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:03:33,597::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:03:33,603::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:03:33,616::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:03:33,624::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:03:33,634::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:34,171::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:34,705::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502729 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:36,717::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:37,259::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51071 seconds, 2.0 MB/s\n'; = 0 Thread-19479::INFO::2011-01-18 20:03:37,484::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19479::DEBUG::2011-01-18 20:03:37,484::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: moving from state init -> state preparing Thread-19479::DEBUG::2011-01-18 20:03:37,484::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4 acquire shared (120000) Thread-19479::DEBUG::2011-01-18 20:03:37,485::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19479::DEBUG::2011-01-18 20:03:37,485::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4' Thread-19479::DEBUG::2011-01-18 20:03:37,485::resource::524::irs::Owner 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19479::DEBUG::2011-01-18 20:03:37,485::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19479::DEBUG::2011-01-18 20:03:37,486::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: ref 1 aborting False Thread-19479::DEBUG::2011-01-18 20:03:37,486::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0508370399475', 'lastCheck': 1295373813.6197021, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0458688735962', 'lastCheck': 1295373813.6277499, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0486700534821', 'lastCheck': 1295373813.605511, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0485870838165', 'lastCheck': 1295373813.6394861, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0481650829315', 'lastCheck': 1295373813.610043, 'valid': True, 'code': 0}} Thread-19479::DEBUG::2011-01-18 20:03:37,486::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: moving from state preparing -> state finished Thread-19479::DEBUG::2011-01-18 20:03:37,487::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19479::DEBUG::2011-01-18 20:03:37,487::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4 releasing Thread-19479::DEBUG::2011-01-18 20:03:37,487::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19479::DEBUG::2011-01-18 20:03:37,488::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19479::DEBUG::2011-01-18 20:03:37,488::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19479::DEBUG::2011-01-18 20:03:37,488::resource::503::irs::Owner 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19479::DEBUG::2011-01-18 20:03:37,488::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19479::DEBUG::2011-01-18 20:03:37,489::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19479::DEBUG::2011-01-18 20:03:37,489::task::577::irs::Task 130ef40a-8148-4e9c-8c6f-a8b8e46a0ba4: ref 0 aborting False Thread-19479::INFO::2011-01-18 20:03:37,489::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0508370399475', 'lastCheck': 1295373813.6197021, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0486700534821', 'lastCheck': 1295373813.605511, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0481650829315', 'lastCheck': 1295373813.610043, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0485870838165', 'lastCheck': 1295373813.6394861, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0458688735962', 'lastCheck': 1295373813.6277499, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:03:39,271::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:39,805::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502581 seconds, 2.0 MB/s\n'; = 0 Thread-19482::INFO::2011-01-18 20:03:40,442::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19482::DEBUG::2011-01-18 20:03:40,443::task::577::irs::Task 2c6cf149-da9f-4e03-aa01-3983318f9a39: moving from state init -> state preparing Thread-19482::DEBUG::2011-01-18 20:03:40,443::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19482::DEBUG::2011-01-18 20:03:40,475::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000459 seconds, 4.5 MB/s\n'; = 0 Thread-19482::DEBUG::2011-01-18 20:03:40,476::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000459 seconds, 4.5 MB/s'], size: 2048 Thread-19482::DEBUG::2011-01-18 20:03:40,476::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19482::DEBUG::2011-01-18 20:03:40,476::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19482::DEBUG::2011-01-18 20:03:40,477::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19482::DEBUG::2011-01-18 20:03:40,477::task::577::irs::Task 2c6cf149-da9f-4e03-aa01-3983318f9a39: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19482::DEBUG::2011-01-18 20:03:40,478::task::577::irs::Task 2c6cf149-da9f-4e03-aa01-3983318f9a39: moving from state preparing -> state finished Thread-19482::DEBUG::2011-01-18 20:03:40,478::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19482::DEBUG::2011-01-18 20:03:40,478::task::577::irs::Task 2c6cf149-da9f-4e03-aa01-3983318f9a39: ref 0 aborting False Thread-19482::INFO::2011-01-18 20:03:40,479::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19483::INFO::2011-01-18 20:03:40,487::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19483::DEBUG::2011-01-18 20:03:40,487::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: moving from state init -> state preparing Thread-19483::DEBUG::2011-01-18 20:03:40,487::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 62b06446-cf19-4942-a7ab-71b8d5d3d904 acquire shared (120000) Thread-19483::DEBUG::2011-01-18 20:03:40,488::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19483::DEBUG::2011-01-18 20:03:40,488::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '62b06446-cf19-4942-a7ab-71b8d5d3d904' Thread-19483::DEBUG::2011-01-18 20:03:40,488::resource::524::irs::Owner 62b06446-cf19-4942-a7ab-71b8d5d3d904: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19483::DEBUG::2011-01-18 20:03:40,488::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19483::DEBUG::2011-01-18 20:03:40,489::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: ref 1 aborting False Thread-19483::INFO::2011-01-18 20:03:40,489::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19483::DEBUG::2011-01-18 20:03:40,490::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19483::DEBUG::2011-01-18 20:03:40,490::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: moving from state preparing -> state finished Thread-19483::DEBUG::2011-01-18 20:03:40,491::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19483::DEBUG::2011-01-18 20:03:40,491::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 62b06446-cf19-4942-a7ab-71b8d5d3d904 releasing Thread-19483::DEBUG::2011-01-18 20:03:40,491::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19483::DEBUG::2011-01-18 20:03:40,491::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19483::DEBUG::2011-01-18 20:03:40,492::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19483::DEBUG::2011-01-18 20:03:40,492::resource::503::irs::Owner 62b06446-cf19-4942-a7ab-71b8d5d3d904: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19483::DEBUG::2011-01-18 20:03:40,492::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19483::DEBUG::2011-01-18 20:03:40,493::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19483::DEBUG::2011-01-18 20:03:40,493::task::577::irs::Task 62b06446-cf19-4942-a7ab-71b8d5d3d904: ref 0 aborting False Thread-19483::INFO::2011-01-18 20:03:40,493::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:03:41,818::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:42,350::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500938 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:03:43,604::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:03:43,605::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:03:43,610::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:03:43,612::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:03:43,619::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:03:43,620::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:03:43,627::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:03:43,628::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:03:43,639::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:03:43,640::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:03:43,647::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:03:43,661::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:03:43,661::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:03:43,671::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:03:43,683::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:44,364::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:44,897::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501758 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:46,909::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:47,451::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510381 seconds, 2.0 MB/s\n'; = 0 Thread-19487::INFO::2011-01-18 20:03:47,651::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19487::DEBUG::2011-01-18 20:03:47,651::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: moving from state init -> state preparing Thread-19487::DEBUG::2011-01-18 20:03:47,652::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1ab7a098-987e-4238-90c3-62cc803a309c acquire shared (120000) Thread-19487::DEBUG::2011-01-18 20:03:47,652::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19487::DEBUG::2011-01-18 20:03:47,652::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '1ab7a098-987e-4238-90c3-62cc803a309c' Thread-19487::DEBUG::2011-01-18 20:03:47,653::resource::524::irs::Owner 1ab7a098-987e-4238-90c3-62cc803a309c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19487::DEBUG::2011-01-18 20:03:47,653::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19487::DEBUG::2011-01-18 20:03:47,653::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: ref 1 aborting False Thread-19487::DEBUG::2011-01-18 20:03:47,654::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0491950511932', 'lastCheck': 1295373823.6680641, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0479311943054', 'lastCheck': 1295373823.6748581, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0492329597473', 'lastCheck': 1295373823.654073, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.049026966095', 'lastCheck': 1295373823.6879311, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0556740760803', 'lastCheck': 1295373823.6655431, 'valid': True, 'code': 0}} Thread-19487::DEBUG::2011-01-18 20:03:47,654::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: moving from state preparing -> state finished Thread-19487::DEBUG::2011-01-18 20:03:47,654::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19487::DEBUG::2011-01-18 20:03:47,655::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 1ab7a098-987e-4238-90c3-62cc803a309c releasing Thread-19487::DEBUG::2011-01-18 20:03:47,655::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19487::DEBUG::2011-01-18 20:03:47,655::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19487::DEBUG::2011-01-18 20:03:47,655::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19487::DEBUG::2011-01-18 20:03:47,656::resource::503::irs::Owner 1ab7a098-987e-4238-90c3-62cc803a309c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19487::DEBUG::2011-01-18 20:03:47,656::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19487::DEBUG::2011-01-18 20:03:47,656::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19487::DEBUG::2011-01-18 20:03:47,657::task::577::irs::Task 1ab7a098-987e-4238-90c3-62cc803a309c: ref 0 aborting False Thread-19487::INFO::2011-01-18 20:03:47,657::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0491950511932', 'lastCheck': 1295373823.6680641, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0492329597473', 'lastCheck': 1295373823.654073, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0556740760803', 'lastCheck': 1295373823.6655431, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.049026966095', 'lastCheck': 1295373823.6879311, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0479311943054', 'lastCheck': 1295373823.6748581, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:03:49,465::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:50,001::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504776 seconds, 2.0 MB/s\n'; = 0 Thread-19490::INFO::2011-01-18 20:03:50,549::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19490::DEBUG::2011-01-18 20:03:50,549::task::577::irs::Task 90b100aa-0424-40d8-a6de-12a6f3c02012: moving from state init -> state preparing Thread-19490::DEBUG::2011-01-18 20:03:50,550::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19490::DEBUG::2011-01-18 20:03:50,582::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000463 seconds, 4.4 MB/s\n'; = 0 Thread-19490::DEBUG::2011-01-18 20:03:50,583::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000463 seconds, 4.4 MB/s'], size: 2048 Thread-19490::DEBUG::2011-01-18 20:03:50,583::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19490::DEBUG::2011-01-18 20:03:50,583::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19490::DEBUG::2011-01-18 20:03:50,584::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19490::DEBUG::2011-01-18 20:03:50,584::task::577::irs::Task 90b100aa-0424-40d8-a6de-12a6f3c02012: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19490::DEBUG::2011-01-18 20:03:50,585::task::577::irs::Task 90b100aa-0424-40d8-a6de-12a6f3c02012: moving from state preparing -> state finished Thread-19490::DEBUG::2011-01-18 20:03:50,585::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19490::DEBUG::2011-01-18 20:03:50,585::task::577::irs::Task 90b100aa-0424-40d8-a6de-12a6f3c02012: ref 0 aborting False Thread-19490::INFO::2011-01-18 20:03:50,586::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19491::INFO::2011-01-18 20:03:50,594::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19491::DEBUG::2011-01-18 20:03:50,594::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: moving from state init -> state preparing Thread-19491::DEBUG::2011-01-18 20:03:50,595::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e8fc622b-6fe6-4110-b694-8afd5a90395d acquire shared (120000) Thread-19491::DEBUG::2011-01-18 20:03:50,595::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19491::DEBUG::2011-01-18 20:03:50,595::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e8fc622b-6fe6-4110-b694-8afd5a90395d' Thread-19491::DEBUG::2011-01-18 20:03:50,596::resource::524::irs::Owner e8fc622b-6fe6-4110-b694-8afd5a90395d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19491::DEBUG::2011-01-18 20:03:50,596::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19491::DEBUG::2011-01-18 20:03:50,596::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: ref 1 aborting False Thread-19491::INFO::2011-01-18 20:03:50,597::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19491::DEBUG::2011-01-18 20:03:50,597::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19491::DEBUG::2011-01-18 20:03:50,598::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: moving from state preparing -> state finished Thread-19491::DEBUG::2011-01-18 20:03:50,598::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19491::DEBUG::2011-01-18 20:03:50,598::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e8fc622b-6fe6-4110-b694-8afd5a90395d releasing Thread-19491::DEBUG::2011-01-18 20:03:50,599::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19491::DEBUG::2011-01-18 20:03:50,599::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19491::DEBUG::2011-01-18 20:03:50,599::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19491::DEBUG::2011-01-18 20:03:50,599::resource::503::irs::Owner e8fc622b-6fe6-4110-b694-8afd5a90395d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19491::DEBUG::2011-01-18 20:03:50,600::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19491::DEBUG::2011-01-18 20:03:50,600::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19491::DEBUG::2011-01-18 20:03:50,600::task::577::irs::Task e8fc622b-6fe6-4110-b694-8afd5a90395d: ref 0 aborting False Thread-19491::INFO::2011-01-18 20:03:50,601::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:03:52,015::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:52,547::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500907 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:03:53,653::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:03:53,654::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:03:53,665::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:03:53,666::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:03:53,668::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:03:53,670::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:03:53,675::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:03:53,676::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:03:53,688::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:03:53,689::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:03:53,694::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:03:53,710::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:03:53,712::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:03:53,718::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:03:53,730::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:54,561::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:55,094::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501987 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:03:57,108::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:03:57,650::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510697 seconds, 2.0 MB/s\n'; = 0 Thread-19495::INFO::2011-01-18 20:03:57,816::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19495::DEBUG::2011-01-18 20:03:57,816::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: moving from state init -> state preparing Thread-19495::DEBUG::2011-01-18 20:03:57,817::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 53827efc-b010-4964-b650-26c1d52ea09c acquire shared (120000) Thread-19495::DEBUG::2011-01-18 20:03:57,817::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19495::DEBUG::2011-01-18 20:03:57,817::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '53827efc-b010-4964-b650-26c1d52ea09c' Thread-19495::DEBUG::2011-01-18 20:03:57,817::resource::524::irs::Owner 53827efc-b010-4964-b650-26c1d52ea09c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19495::DEBUG::2011-01-18 20:03:57,818::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19495::DEBUG::2011-01-18 20:03:57,818::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: ref 1 aborting False Thread-19495::DEBUG::2011-01-18 20:03:57,818::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.047208070755', 'lastCheck': 1295373833.715332, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473051071167', 'lastCheck': 1295373833.722223, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0473530292511', 'lastCheck': 1295373833.701194, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471770763397', 'lastCheck': 1295373833.7351091, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0502569675446', 'lastCheck': 1295373833.715116, 'valid': True, 'code': 0}} Thread-19495::DEBUG::2011-01-18 20:03:57,819::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: moving from state preparing -> state finished Thread-19495::DEBUG::2011-01-18 20:03:57,819::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19495::DEBUG::2011-01-18 20:03:57,819::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 53827efc-b010-4964-b650-26c1d52ea09c releasing Thread-19495::DEBUG::2011-01-18 20:03:57,819::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19495::DEBUG::2011-01-18 20:03:57,820::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19495::DEBUG::2011-01-18 20:03:57,820::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19495::DEBUG::2011-01-18 20:03:57,820::resource::503::irs::Owner 53827efc-b010-4964-b650-26c1d52ea09c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19495::DEBUG::2011-01-18 20:03:57,821::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19495::DEBUG::2011-01-18 20:03:57,821::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19495::DEBUG::2011-01-18 20:03:57,821::task::577::irs::Task 53827efc-b010-4964-b650-26c1d52ea09c: ref 0 aborting False Thread-19495::INFO::2011-01-18 20:03:57,821::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.047208070755', 'lastCheck': 1295373833.715332, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0473530292511', 'lastCheck': 1295373833.701194, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0502569675446', 'lastCheck': 1295373833.715116, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0471770763397', 'lastCheck': 1295373833.7351091, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473051071167', 'lastCheck': 1295373833.722223, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:03:59,664::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:00,202::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50626 seconds, 2.0 MB/s\n'; = 0 Thread-19498::INFO::2011-01-18 20:04:00,656::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19498::DEBUG::2011-01-18 20:04:00,657::task::577::irs::Task e41d1e93-baa9-4b41-aa2a-86cd8e0ce091: moving from state init -> state preparing Thread-19498::DEBUG::2011-01-18 20:04:00,657::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19498::DEBUG::2011-01-18 20:04:00,689::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000449 seconds, 4.6 MB/s\n'; = 0 Thread-19498::DEBUG::2011-01-18 20:04:00,690::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000449 seconds, 4.6 MB/s'], size: 2048 Thread-19498::DEBUG::2011-01-18 20:04:00,690::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19498::DEBUG::2011-01-18 20:04:00,691::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19498::DEBUG::2011-01-18 20:04:00,691::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19498::DEBUG::2011-01-18 20:04:00,691::task::577::irs::Task e41d1e93-baa9-4b41-aa2a-86cd8e0ce091: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19498::DEBUG::2011-01-18 20:04:00,692::task::577::irs::Task e41d1e93-baa9-4b41-aa2a-86cd8e0ce091: moving from state preparing -> state finished Thread-19498::DEBUG::2011-01-18 20:04:00,692::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19498::DEBUG::2011-01-18 20:04:00,692::task::577::irs::Task e41d1e93-baa9-4b41-aa2a-86cd8e0ce091: ref 0 aborting False Thread-19498::INFO::2011-01-18 20:04:00,693::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19499::INFO::2011-01-18 20:04:00,702::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19499::DEBUG::2011-01-18 20:04:00,702::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: moving from state init -> state preparing Thread-19499::DEBUG::2011-01-18 20:04:00,702::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e624d006-b13c-4125-843c-f82d60240294 acquire shared (120000) Thread-19499::DEBUG::2011-01-18 20:04:00,703::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19499::DEBUG::2011-01-18 20:04:00,703::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e624d006-b13c-4125-843c-f82d60240294' Thread-19499::DEBUG::2011-01-18 20:04:00,703::resource::524::irs::Owner e624d006-b13c-4125-843c-f82d60240294: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19499::DEBUG::2011-01-18 20:04:00,703::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19499::DEBUG::2011-01-18 20:04:00,704::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: ref 1 aborting False Thread-19499::INFO::2011-01-18 20:04:00,704::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19499::DEBUG::2011-01-18 20:04:00,705::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19499::DEBUG::2011-01-18 20:04:00,705::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: moving from state preparing -> state finished Thread-19499::DEBUG::2011-01-18 20:04:00,705::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19499::DEBUG::2011-01-18 20:04:00,706::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e624d006-b13c-4125-843c-f82d60240294 releasing Thread-19499::DEBUG::2011-01-18 20:04:00,706::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19499::DEBUG::2011-01-18 20:04:00,706::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19499::DEBUG::2011-01-18 20:04:00,707::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19499::DEBUG::2011-01-18 20:04:00,707::resource::503::irs::Owner e624d006-b13c-4125-843c-f82d60240294: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19499::DEBUG::2011-01-18 20:04:00,707::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19499::DEBUG::2011-01-18 20:04:00,707::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19499::DEBUG::2011-01-18 20:04:00,708::task::577::irs::Task e624d006-b13c-4125-843c-f82d60240294: ref 0 aborting False Thread-19499::INFO::2011-01-18 20:04:00,708::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:04:02,217::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:02,749::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500086 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:04:03,700::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:04:03,701::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:04:03,715::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18497::INFO::2011-01-18 20:04:03,715::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18493::DEBUG::2011-01-18 20:04:03,716::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:04:03,717::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:04:03,722::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:04:03,724::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:04:03,735::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:04:03,736::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:04:03,763::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:04:03,764::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:03,765::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:04:03,765::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:04:03,776::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:04,762::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:05,296::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502769 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:07,310::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:07,854::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512489 seconds, 2.0 MB/s\n'; = 0 Thread-19503::INFO::2011-01-18 20:04:07,977::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19503::DEBUG::2011-01-18 20:04:07,978::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: moving from state init -> state preparing Thread-19503::DEBUG::2011-01-18 20:04:07,978::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c4ce5e88-42c2-4646-919f-ae91aa1689ed acquire shared (120000) Thread-19503::DEBUG::2011-01-18 20:04:07,979::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19503::DEBUG::2011-01-18 20:04:07,979::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c4ce5e88-42c2-4646-919f-ae91aa1689ed' Thread-19503::DEBUG::2011-01-18 20:04:07,979::resource::524::irs::Owner c4ce5e88-42c2-4646-919f-ae91aa1689ed: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19503::DEBUG::2011-01-18 20:04:07,979::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19503::DEBUG::2011-01-18 20:04:07,980::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: ref 1 aborting False Thread-19503::DEBUG::2011-01-18 20:04:07,980::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.056526184082', 'lastCheck': 1295373843.7714591, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0465970039368', 'lastCheck': 1295373843.7686901, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0701749324799', 'lastCheck': 1295373843.7710149, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0465798377991', 'lastCheck': 1295373843.781498, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0563042163849', 'lastCheck': 1295373843.7719171, 'valid': True, 'code': 0}} Thread-19503::DEBUG::2011-01-18 20:04:07,980::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: moving from state preparing -> state finished Thread-19503::DEBUG::2011-01-18 20:04:07,981::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19503::DEBUG::2011-01-18 20:04:07,981::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c4ce5e88-42c2-4646-919f-ae91aa1689ed releasing Thread-19503::DEBUG::2011-01-18 20:04:07,981::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19503::DEBUG::2011-01-18 20:04:07,982::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19503::DEBUG::2011-01-18 20:04:07,982::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19503::DEBUG::2011-01-18 20:04:07,982::resource::503::irs::Owner c4ce5e88-42c2-4646-919f-ae91aa1689ed: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19503::DEBUG::2011-01-18 20:04:07,982::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19503::DEBUG::2011-01-18 20:04:07,983::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19503::DEBUG::2011-01-18 20:04:07,983::task::577::irs::Task c4ce5e88-42c2-4646-919f-ae91aa1689ed: ref 0 aborting False Thread-19503::INFO::2011-01-18 20:04:07,983::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.056526184082', 'lastCheck': 1295373843.7714591, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0701749324799', 'lastCheck': 1295373843.7710149, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0563042163849', 'lastCheck': 1295373843.7719171, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0465798377991', 'lastCheck': 1295373843.781498, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0465970039368', 'lastCheck': 1295373843.7686901, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:04:09,867::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:10,401::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502185 seconds, 2.0 MB/s\n'; = 0 Thread-19506::INFO::2011-01-18 20:04:10,761::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19506::DEBUG::2011-01-18 20:04:10,761::task::577::irs::Task 92a81620-ad06-4fb2-8560-dfb516418767: moving from state init -> state preparing Thread-19506::DEBUG::2011-01-18 20:04:10,762::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19506::DEBUG::2011-01-18 20:04:10,794::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000458 seconds, 4.5 MB/s\n'; = 0 Thread-19506::DEBUG::2011-01-18 20:04:10,794::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000458 seconds, 4.5 MB/s'], size: 2048 Thread-19506::DEBUG::2011-01-18 20:04:10,795::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19506::DEBUG::2011-01-18 20:04:10,795::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19506::DEBUG::2011-01-18 20:04:10,796::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19506::DEBUG::2011-01-18 20:04:10,796::task::577::irs::Task 92a81620-ad06-4fb2-8560-dfb516418767: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19506::DEBUG::2011-01-18 20:04:10,797::task::577::irs::Task 92a81620-ad06-4fb2-8560-dfb516418767: moving from state preparing -> state finished Thread-19506::DEBUG::2011-01-18 20:04:10,797::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19506::DEBUG::2011-01-18 20:04:10,797::task::577::irs::Task 92a81620-ad06-4fb2-8560-dfb516418767: ref 0 aborting False Thread-19506::INFO::2011-01-18 20:04:10,797::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19507::INFO::2011-01-18 20:04:10,806::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19507::DEBUG::2011-01-18 20:04:10,806::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: moving from state init -> state preparing Thread-19507::DEBUG::2011-01-18 20:04:10,807::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b27146ef-006f-4945-b595-f1984a1ec272 acquire shared (120000) Thread-19507::DEBUG::2011-01-18 20:04:10,807::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19507::DEBUG::2011-01-18 20:04:10,807::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b27146ef-006f-4945-b595-f1984a1ec272' Thread-19507::DEBUG::2011-01-18 20:04:10,808::resource::524::irs::Owner b27146ef-006f-4945-b595-f1984a1ec272: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19507::DEBUG::2011-01-18 20:04:10,808::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19507::DEBUG::2011-01-18 20:04:10,808::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: ref 1 aborting False Thread-19507::INFO::2011-01-18 20:04:10,809::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19507::DEBUG::2011-01-18 20:04:10,809::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19507::DEBUG::2011-01-18 20:04:10,810::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: moving from state preparing -> state finished Thread-19507::DEBUG::2011-01-18 20:04:10,810::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19507::DEBUG::2011-01-18 20:04:10,810::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b27146ef-006f-4945-b595-f1984a1ec272 releasing Thread-19507::DEBUG::2011-01-18 20:04:10,811::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19507::DEBUG::2011-01-18 20:04:10,811::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19507::DEBUG::2011-01-18 20:04:10,811::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19507::DEBUG::2011-01-18 20:04:10,811::resource::503::irs::Owner b27146ef-006f-4945-b595-f1984a1ec272: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19507::DEBUG::2011-01-18 20:04:10,812::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19507::DEBUG::2011-01-18 20:04:10,812::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19507::DEBUG::2011-01-18 20:04:10,812::task::577::irs::Task b27146ef-006f-4945-b595-f1984a1ec272: ref 0 aborting False Thread-19507::INFO::2011-01-18 20:04:10,813::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:04:12,414::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:12,946::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500642 seconds, 2.0 MB/s\n'; = 0 Thread-18494::INFO::2011-01-18 20:04:13,767::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:04:13,768::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:04:13,771::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::INFO::2011-01-18 20:04:13,772::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::INFO::2011-01-18 20:04:13,772::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18493::DEBUG::2011-01-18 20:04:13,773::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:04:13,774::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:04:13,775::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:04:13,781::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:04:13,783::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:04:13,812::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:04:13,814::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata count=1' (cwd None) Thread-18495::DEBUG::2011-01-18 20:04:13,814::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:04:13,817::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:13,817::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:13,819::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata count=1' (cwd None) Thread-18496::DEBUG::2011-01-18 20:04:13,824::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:04:13,825::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata count=1' (cwd None) Thread-18494::DEBUG::2011-01-18 20:04:13,846::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000906 seconds, 2.3 MB/s\n'; = 0 Thread-18494::DEBUG::2011-01-18 20:04:13,847::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000906 seconds, 2.3 MB/s'], size: 2048 Thread-18494::DEBUG::2011-01-18 20:04:13,847::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=None', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE0,uuid:JhuxXz-oY2f-VTKM-jZw1-vjeb-1yfc-4DEMhe,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE1,uuid:3aUVw3-VXRN-GbIT-jnEQ-RmUc-Kqcf-cj2Q3x,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE2,uuid:OFmc1C-VUM2-UeEr-4PaC-e2G4-YjTo-0aIgd3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE3,uuid:kyzPWM-1lW2-zYaO-2BIR-W66P-XrsG-fpehsp,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE4,uuid:EacnTZ-z822-xe9v-9t6A-1u3S-t96k-bOlSQM,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE5,uuid:N8Yas4-g1Rl-y3qt-Zb1d-t4ty-y8Iv-5LxYUR,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE6,uuid:aAF0AR-v83k-qND9-ZwAN-3p89-o9p0-rAF1zi,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE7,uuid:Qf3LTH-Ai55-3Lp0-FKFJ-zmfX-yyf8-yEyqIf,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=zSkJHd-z2vi-SfdH-OmXK-HHD2-HSSF-I7j139', 'MASTER_VERSION=0', '_SHA_CKSUM=6ac9d8deed2c8198ad87a15fde0e9be690649fe9'] Thread-18494::DEBUG::2011-01-18 20:04:13,848::metadata::89::irs::metadata.__validate() __cksum(md) = 6ac9d8deed2c8198ad87a15fde0e9be690649fe9 Thread-18497::DEBUG::2011-01-18 20:04:13,853::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000904 seconds, 2.3 MB/s\n'; = 0 Thread-18497::DEBUG::2011-01-18 20:04:13,853::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000904 seconds, 2.3 MB/s'], size: 2048 Thread-18497::DEBUG::2011-01-18 20:04:13,854::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_4', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE25,uuid:oT9Njr-43C6-OFn2-Pb1m-OHmv-q1ko-qWVZfU,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE24,uuid:zAhT6X-lhHA-0tpM-y8Ir-qdYz-cToH-QS34Qd,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE26,uuid:iai1Ih-p3aO-aJfa-m0Vu-bbUI-Bzmt-faQpU3,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE27,uuid:Po2nTz-ZVf1-9CUn-XrvV-KFvh-bVc0-0UlRfc,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE28,uuid:7RfWRw-dleE-FJGk-unwH-mCIt-vjvO-cFlwEV,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE29,uuid:o0eNOA-eXTU-lOuo-1pOl-S9Kc-t3SS-qmqoxq,pestart:0,pecount:95,mapoffset:475', 'ROLE=Regular', 'SDUUID=d36e088c-e33f-41c9-9799-60f27d683f24', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=Rg9Ok4-Ts62-7x69-dnoq-vXMJ-1kxr-7V4hzD', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=506390723e870e52d768c8a93509b36b71d536b4'] Thread-18497::DEBUG::2011-01-18 20:04:13,854::metadata::89::irs::metadata.__validate() __cksum(md) = 506390723e870e52d768c8a93509b36b71d536b4 Thread-18496::DEBUG::2011-01-18 20:04:13,857::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000852 seconds, 2.4 MB/s\n'; = 0 Thread-18496::DEBUG::2011-01-18 20:04:13,858::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000852 seconds, 2.4 MB/s'], size: 2048 Thread-18496::DEBUG::2011-01-18 20:04:13,858::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_5', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE30,uuid:6OMUem-Ea8u-ePsj-ZtiI-PS2g-9lar-vDE1yw,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE31,uuid:rp1dI7-UPsb-ZzJX-eptN-usNA-7bhM-O2aeC0,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE32,uuid:REuolt-m2qg-IguX-yQ6Q-a88i-QbOk-KfxuNR,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE33,uuid:auCyUI-Qzi4-nPej-g5ji-3O7c-PNdD-YSr4HX,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE34,uuid:nxQIzE-gINr-2WGk-fBFz-xWdc-VKpc-0AkgEu,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE35,uuid:9rYRaB-6vqa-jeNi-8d70-Olyy-x5FR-Sfd9rm,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE36,uuid:aj40O1-nJLf-RfMK-vPfA-zy3M-CGZP-gFOulR,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE37,uuid:vCUrIv-sXPe-09Ze-EYzV-cj0C-67iG-ukcW5V,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=YlGdeL-gaDB-Es97-ogbJ-3LdW-crm3-jWw9cH', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=f0ac78701aec46eb830881e3c6db5e3fa21ea53c'] Thread-18496::DEBUG::2011-01-18 20:04:13,859::metadata::89::irs::metadata.__validate() __cksum(md) = f0ac78701aec46eb830881e3c6db5e3fa21ea53c Dummy-18546::DEBUG::2011-01-18 20:04:14,959::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:15,492::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501454 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:17,505::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:18,039::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501405 seconds, 2.0 MB/s\n'; = 0 Thread-19511::INFO::2011-01-18 20:04:18,141::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19511::DEBUG::2011-01-18 20:04:18,142::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: moving from state init -> state preparing Thread-19511::DEBUG::2011-01-18 20:04:18,142::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2c326396-0e7b-4301-9bfd-e3614cb0e0cf acquire shared (120000) Thread-19511::DEBUG::2011-01-18 20:04:18,142::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19511::DEBUG::2011-01-18 20:04:18,143::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2c326396-0e7b-4301-9bfd-e3614cb0e0cf' Thread-19511::DEBUG::2011-01-18 20:04:18,143::resource::524::irs::Owner 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19511::DEBUG::2011-01-18 20:04:18,143::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19511::DEBUG::2011-01-18 20:04:18,144::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: ref 1 aborting False Thread-19511::DEBUG::2011-01-18 20:04:18,144::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0566639900208', 'lastCheck': 1295373853.8277421, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0845139026642', 'lastCheck': 1295373853.852386, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0532681941986', 'lastCheck': 1295373853.8251481, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0831708908081', 'lastCheck': 1295373853.864064, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.085077047348', 'lastCheck': 1295373853.8575771, 'valid': True, 'code': 0}} Thread-19511::DEBUG::2011-01-18 20:04:18,144::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: moving from state preparing -> state finished Thread-19511::DEBUG::2011-01-18 20:04:18,145::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19511::DEBUG::2011-01-18 20:04:18,145::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2c326396-0e7b-4301-9bfd-e3614cb0e0cf releasing Thread-19511::DEBUG::2011-01-18 20:04:18,145::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19511::DEBUG::2011-01-18 20:04:18,145::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19511::DEBUG::2011-01-18 20:04:18,146::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19511::DEBUG::2011-01-18 20:04:18,146::resource::503::irs::Owner 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19511::DEBUG::2011-01-18 20:04:18,146::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19511::DEBUG::2011-01-18 20:04:18,147::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19511::DEBUG::2011-01-18 20:04:18,147::task::577::irs::Task 2c326396-0e7b-4301-9bfd-e3614cb0e0cf: ref 0 aborting False Thread-19511::INFO::2011-01-18 20:04:18,147::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0566639900208', 'lastCheck': 1295373853.8277421, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0532681941986', 'lastCheck': 1295373853.8251481, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.085077047348', 'lastCheck': 1295373853.8575771, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0831708908081', 'lastCheck': 1295373853.864064, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0845139026642', 'lastCheck': 1295373853.852386, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:04:20,049::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:20,594::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512279 seconds, 2.0 MB/s\n'; = 0 Thread-19514::INFO::2011-01-18 20:04:20,866::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19514::DEBUG::2011-01-18 20:04:20,866::task::577::irs::Task 3ba8afb9-0087-4c84-8320-a5685cd83ca6: moving from state init -> state preparing Thread-19514::DEBUG::2011-01-18 20:04:20,867::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19514::DEBUG::2011-01-18 20:04:20,899::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000437 seconds, 4.7 MB/s\n'; = 0 Thread-19514::DEBUG::2011-01-18 20:04:20,899::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000437 seconds, 4.7 MB/s'], size: 2048 Thread-19514::DEBUG::2011-01-18 20:04:20,899::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19514::DEBUG::2011-01-18 20:04:20,900::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19514::DEBUG::2011-01-18 20:04:20,900::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19514::DEBUG::2011-01-18 20:04:20,901::task::577::irs::Task 3ba8afb9-0087-4c84-8320-a5685cd83ca6: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19514::DEBUG::2011-01-18 20:04:20,901::task::577::irs::Task 3ba8afb9-0087-4c84-8320-a5685cd83ca6: moving from state preparing -> state finished Thread-19514::DEBUG::2011-01-18 20:04:20,901::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19514::DEBUG::2011-01-18 20:04:20,902::task::577::irs::Task 3ba8afb9-0087-4c84-8320-a5685cd83ca6: ref 0 aborting False Thread-19514::INFO::2011-01-18 20:04:20,902::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19515::INFO::2011-01-18 20:04:20,910::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19515::DEBUG::2011-01-18 20:04:20,910::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: moving from state init -> state preparing Thread-19515::DEBUG::2011-01-18 20:04:20,910::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b99eb4e0-ac34-40f5-ba7c-5e13639f0318 acquire shared (120000) Thread-19515::DEBUG::2011-01-18 20:04:20,911::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19515::DEBUG::2011-01-18 20:04:20,911::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'b99eb4e0-ac34-40f5-ba7c-5e13639f0318' Thread-19515::DEBUG::2011-01-18 20:04:20,911::resource::524::irs::Owner b99eb4e0-ac34-40f5-ba7c-5e13639f0318: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19515::DEBUG::2011-01-18 20:04:20,912::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19515::DEBUG::2011-01-18 20:04:20,912::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: ref 1 aborting False Thread-19515::INFO::2011-01-18 20:04:20,912::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19515::DEBUG::2011-01-18 20:04:20,913::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19515::DEBUG::2011-01-18 20:04:20,913::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: moving from state preparing -> state finished Thread-19515::DEBUG::2011-01-18 20:04:20,914::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19515::DEBUG::2011-01-18 20:04:20,914::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: b99eb4e0-ac34-40f5-ba7c-5e13639f0318 releasing Thread-19515::DEBUG::2011-01-18 20:04:20,914::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19515::DEBUG::2011-01-18 20:04:20,915::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19515::DEBUG::2011-01-18 20:04:20,915::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19515::DEBUG::2011-01-18 20:04:20,915::resource::503::irs::Owner b99eb4e0-ac34-40f5-ba7c-5e13639f0318: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19515::DEBUG::2011-01-18 20:04:20,915::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19515::DEBUG::2011-01-18 20:04:20,916::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19515::DEBUG::2011-01-18 20:04:20,916::task::577::irs::Task b99eb4e0-ac34-40f5-ba7c-5e13639f0318: ref 0 aborting False Thread-19515::INFO::2011-01-18 20:04:20,916::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:04:22,607::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:23,140::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500903 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:04:23,824::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:04:23,825::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:04:23,827::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:04:23,828::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:04:23,852::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:04:23,853::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:04:23,857::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:04:23,858::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:04:23,864::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:04:23,865::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:04:23,868::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:04:23,868::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:04:23,892::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:23,901::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:04:23,907::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:25,153::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:25,688::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503269 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:27,700::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:28,233::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500256 seconds, 2.0 MB/s\n'; = 0 Thread-19519::INFO::2011-01-18 20:04:28,314::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19519::DEBUG::2011-01-18 20:04:28,314::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: moving from state init -> state preparing Thread-19519::DEBUG::2011-01-18 20:04:28,314::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9f46c0c7-de55-4e83-918a-f11614519628 acquire shared (120000) Thread-19519::DEBUG::2011-01-18 20:04:28,315::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19519::DEBUG::2011-01-18 20:04:28,315::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '9f46c0c7-de55-4e83-918a-f11614519628' Thread-19519::DEBUG::2011-01-18 20:04:28,315::resource::524::irs::Owner 9f46c0c7-de55-4e83-918a-f11614519628: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19519::DEBUG::2011-01-18 20:04:28,316::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19519::DEBUG::2011-01-18 20:04:28,316::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: ref 1 aborting False Thread-19519::DEBUG::2011-01-18 20:04:28,316::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0474820137024', 'lastCheck': 1295373863.8748679, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0459229946136', 'lastCheck': 1295373863.8977921, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0508139133453', 'lastCheck': 1295373863.875649, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487780570984', 'lastCheck': 1295373863.912694, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0472178459167', 'lastCheck': 1295373863.9040959, 'valid': True, 'code': 0}} Thread-19519::DEBUG::2011-01-18 20:04:28,317::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: moving from state preparing -> state finished Thread-19519::DEBUG::2011-01-18 20:04:28,317::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19519::DEBUG::2011-01-18 20:04:28,317::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 9f46c0c7-de55-4e83-918a-f11614519628 releasing Thread-19519::DEBUG::2011-01-18 20:04:28,318::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19519::DEBUG::2011-01-18 20:04:28,318::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19519::DEBUG::2011-01-18 20:04:28,318::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19519::DEBUG::2011-01-18 20:04:28,318::resource::503::irs::Owner 9f46c0c7-de55-4e83-918a-f11614519628: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19519::DEBUG::2011-01-18 20:04:28,319::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19519::DEBUG::2011-01-18 20:04:28,319::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19519::DEBUG::2011-01-18 20:04:28,319::task::577::irs::Task 9f46c0c7-de55-4e83-918a-f11614519628: ref 0 aborting False Thread-19519::INFO::2011-01-18 20:04:28,320::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0474820137024', 'lastCheck': 1295373863.8748679, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0508139133453', 'lastCheck': 1295373863.875649, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0472178459167', 'lastCheck': 1295373863.9040959, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487780570984', 'lastCheck': 1295373863.912694, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0459229946136', 'lastCheck': 1295373863.8977921, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:04:30,245::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:30,789::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511784 seconds, 2.0 MB/s\n'; = 0 Thread-19522::INFO::2011-01-18 20:04:30,968::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19522::DEBUG::2011-01-18 20:04:30,969::task::577::irs::Task 2ff21738-a71e-4da9-bf8d-9a065ea6a8c2: moving from state init -> state preparing Thread-19522::DEBUG::2011-01-18 20:04:30,969::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19522::DEBUG::2011-01-18 20:04:31,001::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000394 seconds, 5.2 MB/s\n'; = 0 Thread-19522::DEBUG::2011-01-18 20:04:31,002::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000394 seconds, 5.2 MB/s'], size: 2048 Thread-19522::DEBUG::2011-01-18 20:04:31,002::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19522::DEBUG::2011-01-18 20:04:31,003::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19522::DEBUG::2011-01-18 20:04:31,003::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19522::DEBUG::2011-01-18 20:04:31,004::task::577::irs::Task 2ff21738-a71e-4da9-bf8d-9a065ea6a8c2: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19522::DEBUG::2011-01-18 20:04:31,004::task::577::irs::Task 2ff21738-a71e-4da9-bf8d-9a065ea6a8c2: moving from state preparing -> state finished Thread-19522::DEBUG::2011-01-18 20:04:31,004::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19522::DEBUG::2011-01-18 20:04:31,005::task::577::irs::Task 2ff21738-a71e-4da9-bf8d-9a065ea6a8c2: ref 0 aborting False Thread-19522::INFO::2011-01-18 20:04:31,005::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19523::INFO::2011-01-18 20:04:31,013::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19523::DEBUG::2011-01-18 20:04:31,013::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: moving from state init -> state preparing Thread-19523::DEBUG::2011-01-18 20:04:31,014::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6c706912-179b-45fe-bf8a-94c131956465 acquire shared (120000) Thread-19523::DEBUG::2011-01-18 20:04:31,014::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19523::DEBUG::2011-01-18 20:04:31,014::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6c706912-179b-45fe-bf8a-94c131956465' Thread-19523::DEBUG::2011-01-18 20:04:31,015::resource::524::irs::Owner 6c706912-179b-45fe-bf8a-94c131956465: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19523::DEBUG::2011-01-18 20:04:31,015::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19523::DEBUG::2011-01-18 20:04:31,015::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: ref 1 aborting False Thread-19523::INFO::2011-01-18 20:04:31,016::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19523::DEBUG::2011-01-18 20:04:31,016::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19523::DEBUG::2011-01-18 20:04:31,017::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: moving from state preparing -> state finished Thread-19523::DEBUG::2011-01-18 20:04:31,017::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19523::DEBUG::2011-01-18 20:04:31,017::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6c706912-179b-45fe-bf8a-94c131956465 releasing Thread-19523::DEBUG::2011-01-18 20:04:31,018::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19523::DEBUG::2011-01-18 20:04:31,018::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19523::DEBUG::2011-01-18 20:04:31,018::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19523::DEBUG::2011-01-18 20:04:31,019::resource::503::irs::Owner 6c706912-179b-45fe-bf8a-94c131956465: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19523::DEBUG::2011-01-18 20:04:31,019::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19523::DEBUG::2011-01-18 20:04:31,019::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19523::DEBUG::2011-01-18 20:04:31,019::task::577::irs::Task 6c706912-179b-45fe-bf8a-94c131956465: ref 0 aborting False Thread-19523::INFO::2011-01-18 20:04:31,020::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:04:32,802::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:33,334::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500804 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:04:33,874::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::INFO::2011-01-18 20:04:33,875::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18493::DEBUG::2011-01-18 20:04:33,876::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:04:33,876::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:04:33,897::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:04:33,898::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:04:33,904::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:04:33,905::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:04:33,912::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:04:33,914::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:04:33,917::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:04:33,918::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:04:33,937::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:33,945::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:04:33,955::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:35,346::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:35,885::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505152 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:37,898::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:38,431::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500819 seconds, 2.0 MB/s\n'; = 0 Thread-19527::INFO::2011-01-18 20:04:38,482::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19527::DEBUG::2011-01-18 20:04:38,482::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: moving from state init -> state preparing Thread-19527::DEBUG::2011-01-18 20:04:38,483::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c581a5ef-25fa-495c-b855-0cd367cba016 acquire shared (120000) Thread-19527::DEBUG::2011-01-18 20:04:38,483::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19527::DEBUG::2011-01-18 20:04:38,483::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'c581a5ef-25fa-495c-b855-0cd367cba016' Thread-19527::DEBUG::2011-01-18 20:04:38,483::resource::524::irs::Owner c581a5ef-25fa-495c-b855-0cd367cba016: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19527::DEBUG::2011-01-18 20:04:38,484::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19527::DEBUG::2011-01-18 20:04:38,484::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: ref 1 aborting False Thread-19527::DEBUG::2011-01-18 20:04:38,484::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490190982819', 'lastCheck': 1295373873.9238911, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0457310676575', 'lastCheck': 1295373873.9426651, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0512080192566', 'lastCheck': 1295373873.9263129, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0481650829315', 'lastCheck': 1295373873.960103, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0450241565704', 'lastCheck': 1295373873.9488981, 'valid': True, 'code': 0}} Thread-19527::DEBUG::2011-01-18 20:04:38,485::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: moving from state preparing -> state finished Thread-19527::DEBUG::2011-01-18 20:04:38,485::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19527::DEBUG::2011-01-18 20:04:38,485::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: c581a5ef-25fa-495c-b855-0cd367cba016 releasing Thread-19527::DEBUG::2011-01-18 20:04:38,486::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19527::DEBUG::2011-01-18 20:04:38,486::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19527::DEBUG::2011-01-18 20:04:38,486::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19527::DEBUG::2011-01-18 20:04:38,486::resource::503::irs::Owner c581a5ef-25fa-495c-b855-0cd367cba016: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19527::DEBUG::2011-01-18 20:04:38,487::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19527::DEBUG::2011-01-18 20:04:38,487::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19527::DEBUG::2011-01-18 20:04:38,487::task::577::irs::Task c581a5ef-25fa-495c-b855-0cd367cba016: ref 0 aborting False Thread-19527::INFO::2011-01-18 20:04:38,488::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490190982819', 'lastCheck': 1295373873.9238911, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0512080192566', 'lastCheck': 1295373873.9263129, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0450241565704', 'lastCheck': 1295373873.9488981, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0481650829315', 'lastCheck': 1295373873.960103, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0457310676575', 'lastCheck': 1295373873.9426651, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:04:40,442::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:40,987::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511854 seconds, 2.0 MB/s\n'; = 0 Thread-19530::INFO::2011-01-18 20:04:41,071::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19530::DEBUG::2011-01-18 20:04:41,071::task::577::irs::Task 64ee9959-bf3d-47d3-b37f-fe01e63bad05: moving from state init -> state preparing Thread-19530::DEBUG::2011-01-18 20:04:41,072::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19530::DEBUG::2011-01-18 20:04:41,104::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000428 seconds, 4.8 MB/s\n'; = 0 Thread-19530::DEBUG::2011-01-18 20:04:41,104::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000428 seconds, 4.8 MB/s'], size: 2048 Thread-19530::DEBUG::2011-01-18 20:04:41,104::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19530::DEBUG::2011-01-18 20:04:41,105::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19530::DEBUG::2011-01-18 20:04:41,105::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19530::DEBUG::2011-01-18 20:04:41,106::task::577::irs::Task 64ee9959-bf3d-47d3-b37f-fe01e63bad05: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19530::DEBUG::2011-01-18 20:04:41,106::task::577::irs::Task 64ee9959-bf3d-47d3-b37f-fe01e63bad05: moving from state preparing -> state finished Thread-19530::DEBUG::2011-01-18 20:04:41,106::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19530::DEBUG::2011-01-18 20:04:41,107::task::577::irs::Task 64ee9959-bf3d-47d3-b37f-fe01e63bad05: ref 0 aborting False Thread-19530::INFO::2011-01-18 20:04:41,107::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19531::INFO::2011-01-18 20:04:41,115::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19531::DEBUG::2011-01-18 20:04:41,115::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: moving from state init -> state preparing Thread-19531::DEBUG::2011-01-18 20:04:41,116::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 03dbc5ce-4116-4ea8-8bf7-9771f00885ae acquire shared (120000) Thread-19531::DEBUG::2011-01-18 20:04:41,116::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19531::DEBUG::2011-01-18 20:04:41,116::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '03dbc5ce-4116-4ea8-8bf7-9771f00885ae' Thread-19531::DEBUG::2011-01-18 20:04:41,117::resource::524::irs::Owner 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19531::DEBUG::2011-01-18 20:04:41,117::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19531::DEBUG::2011-01-18 20:04:41,117::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: ref 1 aborting False Thread-19531::INFO::2011-01-18 20:04:41,118::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19531::DEBUG::2011-01-18 20:04:41,118::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19531::DEBUG::2011-01-18 20:04:41,119::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: moving from state preparing -> state finished Thread-19531::DEBUG::2011-01-18 20:04:41,119::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19531::DEBUG::2011-01-18 20:04:41,119::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 03dbc5ce-4116-4ea8-8bf7-9771f00885ae releasing Thread-19531::DEBUG::2011-01-18 20:04:41,120::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19531::DEBUG::2011-01-18 20:04:41,120::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19531::DEBUG::2011-01-18 20:04:41,120::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19531::DEBUG::2011-01-18 20:04:41,120::resource::503::irs::Owner 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19531::DEBUG::2011-01-18 20:04:41,121::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19531::DEBUG::2011-01-18 20:04:41,121::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19531::DEBUG::2011-01-18 20:04:41,121::task::577::irs::Task 03dbc5ce-4116-4ea8-8bf7-9771f00885ae: ref 0 aborting False Thread-19531::INFO::2011-01-18 20:04:41,122::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:04:42,999::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:43,533::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50171 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:04:43,923::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:04:43,924::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:04:43,926::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:04:43,927::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:04:43,942::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:04:43,943::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:04:43,949::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:04:43,950::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:04:43,960::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:04:43,962::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:04:43,965::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:04:43,966::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:04:43,987::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:43,993::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:04:44,002::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:45,545::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:46,089::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511826 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:48,101::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:48,635::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501595 seconds, 2.0 MB/s\n'; = 0 Thread-19535::INFO::2011-01-18 20:04:48,650::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19535::DEBUG::2011-01-18 20:04:48,651::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: moving from state init -> state preparing Thread-19535::DEBUG::2011-01-18 20:04:48,651::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2b6c7d0c-e78e-476b-9385-5c573acfa818 acquire shared (120000) Thread-19535::DEBUG::2011-01-18 20:04:48,651::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19535::DEBUG::2011-01-18 20:04:48,651::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2b6c7d0c-e78e-476b-9385-5c573acfa818' Thread-19535::DEBUG::2011-01-18 20:04:48,652::resource::524::irs::Owner 2b6c7d0c-e78e-476b-9385-5c573acfa818: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19535::DEBUG::2011-01-18 20:04:48,652::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19535::DEBUG::2011-01-18 20:04:48,652::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: ref 1 aborting False Thread-19535::DEBUG::2011-01-18 20:04:48,653::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0476379394531', 'lastCheck': 1295373883.971487, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0490050315857', 'lastCheck': 1295373883.9909151, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0475449562073', 'lastCheck': 1295373883.9739029, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0473649501801', 'lastCheck': 1295373884.007277, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0474119186401', 'lastCheck': 1295373883.99629, 'valid': True, 'code': 0}} Thread-19535::DEBUG::2011-01-18 20:04:48,653::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: moving from state preparing -> state finished Thread-19535::DEBUG::2011-01-18 20:04:48,653::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19535::DEBUG::2011-01-18 20:04:48,654::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2b6c7d0c-e78e-476b-9385-5c573acfa818 releasing Thread-19535::DEBUG::2011-01-18 20:04:48,654::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19535::DEBUG::2011-01-18 20:04:48,654::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19535::DEBUG::2011-01-18 20:04:48,654::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19535::DEBUG::2011-01-18 20:04:48,655::resource::503::irs::Owner 2b6c7d0c-e78e-476b-9385-5c573acfa818: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19535::DEBUG::2011-01-18 20:04:48,655::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19535::DEBUG::2011-01-18 20:04:48,655::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19535::DEBUG::2011-01-18 20:04:48,656::task::577::irs::Task 2b6c7d0c-e78e-476b-9385-5c573acfa818: ref 0 aborting False Thread-19535::INFO::2011-01-18 20:04:48,656::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0476379394531', 'lastCheck': 1295373883.971487, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0475449562073', 'lastCheck': 1295373883.9739029, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0474119186401', 'lastCheck': 1295373883.99629, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0473649501801', 'lastCheck': 1295373884.007277, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0490050315857', 'lastCheck': 1295373883.9909151, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:04:50,648::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19538::INFO::2011-01-18 20:04:51,174::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19538::DEBUG::2011-01-18 20:04:51,174::task::577::irs::Task fda42dac-63bc-4752-8903-cb2f3abf791b: moving from state init -> state preparing Thread-19538::DEBUG::2011-01-18 20:04:51,175::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:51,193::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510476 seconds, 2.0 MB/s\n'; = 0 Thread-19538::DEBUG::2011-01-18 20:04:51,210::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s\n'; = 0 Thread-19538::DEBUG::2011-01-18 20:04:51,210::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000397 seconds, 5.2 MB/s'], size: 2048 Thread-19538::DEBUG::2011-01-18 20:04:51,210::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19538::DEBUG::2011-01-18 20:04:51,211::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19538::DEBUG::2011-01-18 20:04:51,211::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19538::DEBUG::2011-01-18 20:04:51,212::task::577::irs::Task fda42dac-63bc-4752-8903-cb2f3abf791b: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19538::DEBUG::2011-01-18 20:04:51,212::task::577::irs::Task fda42dac-63bc-4752-8903-cb2f3abf791b: moving from state preparing -> state finished Thread-19538::DEBUG::2011-01-18 20:04:51,212::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19538::DEBUG::2011-01-18 20:04:51,213::task::577::irs::Task fda42dac-63bc-4752-8903-cb2f3abf791b: ref 0 aborting False Thread-19538::INFO::2011-01-18 20:04:51,213::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19539::INFO::2011-01-18 20:04:51,222::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19539::DEBUG::2011-01-18 20:04:51,222::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: moving from state init -> state preparing Thread-19539::DEBUG::2011-01-18 20:04:51,223::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: cfd5cddb-0441-4822-87e1-a5b4b90cf323 acquire shared (120000) Thread-19539::DEBUG::2011-01-18 20:04:51,223::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19539::DEBUG::2011-01-18 20:04:51,223::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'cfd5cddb-0441-4822-87e1-a5b4b90cf323' Thread-19539::DEBUG::2011-01-18 20:04:51,224::resource::524::irs::Owner cfd5cddb-0441-4822-87e1-a5b4b90cf323: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19539::DEBUG::2011-01-18 20:04:51,224::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19539::DEBUG::2011-01-18 20:04:51,224::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: ref 1 aborting False Thread-19539::INFO::2011-01-18 20:04:51,225::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19539::DEBUG::2011-01-18 20:04:51,225::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19539::DEBUG::2011-01-18 20:04:51,226::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: moving from state preparing -> state finished Thread-19539::DEBUG::2011-01-18 20:04:51,226::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19539::DEBUG::2011-01-18 20:04:51,226::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: cfd5cddb-0441-4822-87e1-a5b4b90cf323 releasing Thread-19539::DEBUG::2011-01-18 20:04:51,227::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19539::DEBUG::2011-01-18 20:04:51,227::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19539::DEBUG::2011-01-18 20:04:51,227::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19539::DEBUG::2011-01-18 20:04:51,227::resource::503::irs::Owner cfd5cddb-0441-4822-87e1-a5b4b90cf323: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19539::DEBUG::2011-01-18 20:04:51,228::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19539::DEBUG::2011-01-18 20:04:51,228::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19539::DEBUG::2011-01-18 20:04:51,228::task::577::irs::Task cfd5cddb-0441-4822-87e1-a5b4b90cf323: ref 0 aborting False Thread-19539::INFO::2011-01-18 20:04:51,229::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:04:53,207::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:53,742::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502177 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:04:53,970::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:04:53,971::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:04:53,974::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:04:53,975::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:04:53,991::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:04:53,992::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:04:53,996::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:04:53,997::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:04:54,007::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:04:54,008::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:04:54,015::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:04:54,016::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:04:54,032::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:04:54,039::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:04:54,047::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:55,755::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:04:56,303::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501653 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:04:58,317::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19543::INFO::2011-01-18 20:04:58,814::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19543::DEBUG::2011-01-18 20:04:58,815::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: moving from state init -> state preparing Thread-19543::DEBUG::2011-01-18 20:04:58,815::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: da33f2c8-4e75-4add-937d-bff0b2edb410 acquire shared (120000) Thread-19543::DEBUG::2011-01-18 20:04:58,815::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19543::DEBUG::2011-01-18 20:04:58,816::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'da33f2c8-4e75-4add-937d-bff0b2edb410' Thread-19543::DEBUG::2011-01-18 20:04:58,816::resource::524::irs::Owner da33f2c8-4e75-4add-937d-bff0b2edb410: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19543::DEBUG::2011-01-18 20:04:58,816::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19543::DEBUG::2011-01-18 20:04:58,817::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: ref 1 aborting False Thread-19543::DEBUG::2011-01-18 20:04:58,817::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.051577091217', 'lastCheck': 1295373894.022428, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0445749759674', 'lastCheck': 1295373894.0354559, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0489571094513', 'lastCheck': 1295373894.0230491, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0458149909973', 'lastCheck': 1295373894.0527201, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0468239784241', 'lastCheck': 1295373894.042716, 'valid': True, 'code': 0}} Thread-19543::DEBUG::2011-01-18 20:04:58,818::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: moving from state preparing -> state finished Thread-19543::DEBUG::2011-01-18 20:04:58,818::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19543::DEBUG::2011-01-18 20:04:58,818::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: da33f2c8-4e75-4add-937d-bff0b2edb410 releasing Thread-19543::DEBUG::2011-01-18 20:04:58,819::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19543::DEBUG::2011-01-18 20:04:58,819::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19543::DEBUG::2011-01-18 20:04:58,820::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19543::DEBUG::2011-01-18 20:04:58,820::resource::503::irs::Owner da33f2c8-4e75-4add-937d-bff0b2edb410: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19543::DEBUG::2011-01-18 20:04:58,820::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19543::DEBUG::2011-01-18 20:04:58,821::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19543::DEBUG::2011-01-18 20:04:58,821::task::577::irs::Task da33f2c8-4e75-4add-937d-bff0b2edb410: ref 0 aborting False Thread-19543::INFO::2011-01-18 20:04:58,821::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.051577091217', 'lastCheck': 1295373894.022428, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0489571094513', 'lastCheck': 1295373894.0230491, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0468239784241', 'lastCheck': 1295373894.042716, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0458149909973', 'lastCheck': 1295373894.0527201, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0445749759674', 'lastCheck': 1295373894.0354559, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:04:58,854::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504677 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:00,868::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19546::INFO::2011-01-18 20:05:01,284::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19546::DEBUG::2011-01-18 20:05:01,285::task::577::irs::Task 64a6225c-2bdc-44fd-98ff-eec0ed93720d: moving from state init -> state preparing Thread-19546::DEBUG::2011-01-18 20:05:01,286::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19546::DEBUG::2011-01-18 20:05:01,320::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s\n'; = 0 Thread-19546::DEBUG::2011-01-18 20:05:01,320::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000445 seconds, 4.6 MB/s'], size: 2048 Thread-19546::DEBUG::2011-01-18 20:05:01,321::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19546::DEBUG::2011-01-18 20:05:01,321::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19546::DEBUG::2011-01-18 20:05:01,322::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19546::DEBUG::2011-01-18 20:05:01,322::task::577::irs::Task 64a6225c-2bdc-44fd-98ff-eec0ed93720d: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19546::DEBUG::2011-01-18 20:05:01,323::task::577::irs::Task 64a6225c-2bdc-44fd-98ff-eec0ed93720d: moving from state preparing -> state finished Thread-19546::DEBUG::2011-01-18 20:05:01,323::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19546::DEBUG::2011-01-18 20:05:01,323::task::577::irs::Task 64a6225c-2bdc-44fd-98ff-eec0ed93720d: ref 0 aborting False Thread-19546::INFO::2011-01-18 20:05:01,324::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19547::INFO::2011-01-18 20:05:01,332::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19547::DEBUG::2011-01-18 20:05:01,332::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: moving from state init -> state preparing Thread-19547::DEBUG::2011-01-18 20:05:01,333::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: eb4c0984-ad13-4102-a47d-f93a9dd7cdb6 acquire shared (120000) Thread-19547::DEBUG::2011-01-18 20:05:01,333::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19547::DEBUG::2011-01-18 20:05:01,333::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'eb4c0984-ad13-4102-a47d-f93a9dd7cdb6' Thread-19547::DEBUG::2011-01-18 20:05:01,334::resource::524::irs::Owner eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19547::DEBUG::2011-01-18 20:05:01,334::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19547::DEBUG::2011-01-18 20:05:01,335::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: ref 1 aborting False Thread-19547::INFO::2011-01-18 20:05:01,335::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19547::DEBUG::2011-01-18 20:05:01,336::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19547::DEBUG::2011-01-18 20:05:01,336::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: moving from state preparing -> state finished Thread-19547::DEBUG::2011-01-18 20:05:01,337::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19547::DEBUG::2011-01-18 20:05:01,337::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: eb4c0984-ad13-4102-a47d-f93a9dd7cdb6 releasing Thread-19547::DEBUG::2011-01-18 20:05:01,337::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19547::DEBUG::2011-01-18 20:05:01,338::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19547::DEBUG::2011-01-18 20:05:01,338::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19547::DEBUG::2011-01-18 20:05:01,338::resource::503::irs::Owner eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19547::DEBUG::2011-01-18 20:05:01,339::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19547::DEBUG::2011-01-18 20:05:01,339::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19547::DEBUG::2011-01-18 20:05:01,339::task::577::irs::Task eb4c0984-ad13-4102-a47d-f93a9dd7cdb6: ref 0 aborting False Thread-19547::INFO::2011-01-18 20:05:01,340::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:05:01,417::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.516196 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:03,431::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:03,964::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50136 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:05:04,021::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:05:04,022::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:05:04,023::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:05:04,023::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:05:04,035::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:05:04,037::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:05:04,042::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:05:04,043::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:05:04,052::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:05:04,053::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:05:04,063::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:05:04,073::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:05:04,076::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:05:04,090::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:05:04,095::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:05,977::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:06,511::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501406 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:08,524::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19551::INFO::2011-01-18 20:05:08,979::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19551::DEBUG::2011-01-18 20:05:08,979::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: moving from state init -> state preparing Thread-19551::DEBUG::2011-01-18 20:05:08,980::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 40483624-7265-4d9c-bc91-4072eaaffdcc acquire shared (120000) Thread-19551::DEBUG::2011-01-18 20:05:08,980::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19551::DEBUG::2011-01-18 20:05:08,981::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '40483624-7265-4d9c-bc91-4072eaaffdcc' Thread-19551::DEBUG::2011-01-18 20:05:08,981::resource::524::irs::Owner 40483624-7265-4d9c-bc91-4072eaaffdcc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19551::DEBUG::2011-01-18 20:05:08,981::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19551::DEBUG::2011-01-18 20:05:08,982::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: ref 1 aborting False Thread-19551::DEBUG::2011-01-18 20:05:08,982::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0474989414215', 'lastCheck': 1295373904.069351, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0472049713135', 'lastCheck': 1295373904.082201, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0555329322815', 'lastCheck': 1295373904.0784769, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0481100082397', 'lastCheck': 1295373904.1000259, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0511341094971', 'lastCheck': 1295373904.093009, 'valid': True, 'code': 0}} Thread-19551::DEBUG::2011-01-18 20:05:08,982::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: moving from state preparing -> state finished Thread-19551::DEBUG::2011-01-18 20:05:08,983::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19551::DEBUG::2011-01-18 20:05:08,983::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 40483624-7265-4d9c-bc91-4072eaaffdcc releasing Thread-19551::DEBUG::2011-01-18 20:05:08,983::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19551::DEBUG::2011-01-18 20:05:08,984::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19551::DEBUG::2011-01-18 20:05:08,984::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19551::DEBUG::2011-01-18 20:05:08,984::resource::503::irs::Owner 40483624-7265-4d9c-bc91-4072eaaffdcc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19551::DEBUG::2011-01-18 20:05:08,985::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19551::DEBUG::2011-01-18 20:05:08,985::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19551::DEBUG::2011-01-18 20:05:08,985::task::577::irs::Task 40483624-7265-4d9c-bc91-4072eaaffdcc: ref 0 aborting False Thread-19551::INFO::2011-01-18 20:05:08,986::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0474989414215', 'lastCheck': 1295373904.069351, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0555329322815', 'lastCheck': 1295373904.0784769, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0511341094971', 'lastCheck': 1295373904.093009, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0481100082397', 'lastCheck': 1295373904.1000259, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0472049713135', 'lastCheck': 1295373904.082201, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:05:09,059::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503257 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:11,071::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19554::INFO::2011-01-18 20:05:11,393::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19554::DEBUG::2011-01-18 20:05:11,394::task::577::irs::Task 665c7fba-7ba1-4cd5-a0f5-c5b030f0c91c: moving from state init -> state preparing Thread-19554::DEBUG::2011-01-18 20:05:11,394::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19554::DEBUG::2011-01-18 20:05:11,427::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000919 seconds, 2.2 MB/s\n'; = 0 Thread-19554::DEBUG::2011-01-18 20:05:11,428::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000919 seconds, 2.2 MB/s'], size: 2048 Thread-19554::DEBUG::2011-01-18 20:05:11,428::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19554::DEBUG::2011-01-18 20:05:11,429::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19554::DEBUG::2011-01-18 20:05:11,429::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19554::DEBUG::2011-01-18 20:05:11,430::task::577::irs::Task 665c7fba-7ba1-4cd5-a0f5-c5b030f0c91c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19554::DEBUG::2011-01-18 20:05:11,430::task::577::irs::Task 665c7fba-7ba1-4cd5-a0f5-c5b030f0c91c: moving from state preparing -> state finished Thread-19554::DEBUG::2011-01-18 20:05:11,431::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19554::DEBUG::2011-01-18 20:05:11,431::task::577::irs::Task 665c7fba-7ba1-4cd5-a0f5-c5b030f0c91c: ref 0 aborting False Thread-19554::INFO::2011-01-18 20:05:11,431::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19555::INFO::2011-01-18 20:05:11,439::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19555::DEBUG::2011-01-18 20:05:11,440::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: moving from state init -> state preparing Thread-19555::DEBUG::2011-01-18 20:05:11,440::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d412798d-ddba-4064-9f05-34574bf9b75c acquire shared (120000) Thread-19555::DEBUG::2011-01-18 20:05:11,440::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19555::DEBUG::2011-01-18 20:05:11,441::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'd412798d-ddba-4064-9f05-34574bf9b75c' Thread-19555::DEBUG::2011-01-18 20:05:11,441::resource::524::irs::Owner d412798d-ddba-4064-9f05-34574bf9b75c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19555::DEBUG::2011-01-18 20:05:11,441::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19555::DEBUG::2011-01-18 20:05:11,441::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: ref 1 aborting False Thread-19555::INFO::2011-01-18 20:05:11,442::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19555::DEBUG::2011-01-18 20:05:11,443::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19555::DEBUG::2011-01-18 20:05:11,443::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: moving from state preparing -> state finished Thread-19555::DEBUG::2011-01-18 20:05:11,443::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19555::DEBUG::2011-01-18 20:05:11,444::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: d412798d-ddba-4064-9f05-34574bf9b75c releasing Thread-19555::DEBUG::2011-01-18 20:05:11,444::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19555::DEBUG::2011-01-18 20:05:11,444::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19555::DEBUG::2011-01-18 20:05:11,445::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19555::DEBUG::2011-01-18 20:05:11,445::resource::503::irs::Owner d412798d-ddba-4064-9f05-34574bf9b75c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19555::DEBUG::2011-01-18 20:05:11,445::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19555::DEBUG::2011-01-18 20:05:11,446::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19555::DEBUG::2011-01-18 20:05:11,446::task::577::irs::Task d412798d-ddba-4064-9f05-34574bf9b75c: ref 0 aborting False Thread-19555::INFO::2011-01-18 20:05:11,446::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:05:11,614::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510979 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:13,626::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 20:05:14,074::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:05:14,074::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:05:14,078::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:05:14,079::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:05:14,082::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:05:14,084::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:05:14,093::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:05:14,094::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:05:14,100::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:05:14,102::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:05:14,120::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:05:14,128::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:05:14,130::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:05:14,140::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:05:14,143::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:14,183::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.524906 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:16,196::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:16,728::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500245 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:18,741::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19559::INFO::2011-01-18 20:05:19,155::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19559::DEBUG::2011-01-18 20:05:19,156::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: moving from state init -> state preparing Thread-19559::DEBUG::2011-01-18 20:05:19,156::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dc9016b5-56f4-4882-98b1-fcad485f735b acquire shared (120000) Thread-19559::DEBUG::2011-01-18 20:05:19,157::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19559::DEBUG::2011-01-18 20:05:19,157::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'dc9016b5-56f4-4882-98b1-fcad485f735b' Thread-19559::DEBUG::2011-01-18 20:05:19,157::resource::524::irs::Owner dc9016b5-56f4-4882-98b1-fcad485f735b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19559::DEBUG::2011-01-18 20:05:19,158::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19559::DEBUG::2011-01-18 20:05:19,158::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: ref 1 aborting False Thread-19559::DEBUG::2011-01-18 20:05:19,159::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0514979362488', 'lastCheck': 1295373914.1253519, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0523068904877', 'lastCheck': 1295373914.1345279, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0567240715027', 'lastCheck': 1295373914.134675, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0485260486603', 'lastCheck': 1295373914.1484301, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0507378578186', 'lastCheck': 1295373914.143611, 'valid': True, 'code': 0}} Thread-19559::DEBUG::2011-01-18 20:05:19,159::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: moving from state preparing -> state finished Thread-19559::DEBUG::2011-01-18 20:05:19,159::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19559::DEBUG::2011-01-18 20:05:19,160::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: dc9016b5-56f4-4882-98b1-fcad485f735b releasing Thread-19559::DEBUG::2011-01-18 20:05:19,160::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19559::DEBUG::2011-01-18 20:05:19,160::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19559::DEBUG::2011-01-18 20:05:19,161::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19559::DEBUG::2011-01-18 20:05:19,161::resource::503::irs::Owner dc9016b5-56f4-4882-98b1-fcad485f735b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19559::DEBUG::2011-01-18 20:05:19,162::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19559::DEBUG::2011-01-18 20:05:19,162::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19559::DEBUG::2011-01-18 20:05:19,162::task::577::irs::Task dc9016b5-56f4-4882-98b1-fcad485f735b: ref 0 aborting False Thread-19559::INFO::2011-01-18 20:05:19,163::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0514979362488', 'lastCheck': 1295373914.1253519, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0567240715027', 'lastCheck': 1295373914.134675, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0507378578186', 'lastCheck': 1295373914.143611, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0485260486603', 'lastCheck': 1295373914.1484301, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0523068904877', 'lastCheck': 1295373914.1345279, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:05:19,280::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.507903 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:21,294::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19562::INFO::2011-01-18 20:05:21,500::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19562::DEBUG::2011-01-18 20:05:21,501::task::577::irs::Task 54e8325e-90b7-4331-bd67-aa336361db04: moving from state init -> state preparing Thread-19562::DEBUG::2011-01-18 20:05:21,502::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19562::DEBUG::2011-01-18 20:05:21,535::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000391 seconds, 5.2 MB/s\n'; = 0 Thread-19562::DEBUG::2011-01-18 20:05:21,536::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000391 seconds, 5.2 MB/s'], size: 2048 Thread-19562::DEBUG::2011-01-18 20:05:21,536::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19562::DEBUG::2011-01-18 20:05:21,537::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19562::DEBUG::2011-01-18 20:05:21,537::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19562::DEBUG::2011-01-18 20:05:21,538::task::577::irs::Task 54e8325e-90b7-4331-bd67-aa336361db04: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19562::DEBUG::2011-01-18 20:05:21,538::task::577::irs::Task 54e8325e-90b7-4331-bd67-aa336361db04: moving from state preparing -> state finished Thread-19562::DEBUG::2011-01-18 20:05:21,539::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19562::DEBUG::2011-01-18 20:05:21,539::task::577::irs::Task 54e8325e-90b7-4331-bd67-aa336361db04: ref 0 aborting False Thread-19562::INFO::2011-01-18 20:05:21,539::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19563::INFO::2011-01-18 20:05:21,548::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19563::DEBUG::2011-01-18 20:05:21,549::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: moving from state init -> state preparing Thread-19563::DEBUG::2011-01-18 20:05:21,549::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2 acquire shared (120000) Thread-19563::DEBUG::2011-01-18 20:05:21,549::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19563::DEBUG::2011-01-18 20:05:21,550::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4e8802be-8ac2-425e-aab4-b45bfbc0ccd2' Thread-19563::DEBUG::2011-01-18 20:05:21,550::resource::524::irs::Owner 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19563::DEBUG::2011-01-18 20:05:21,551::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19563::DEBUG::2011-01-18 20:05:21,551::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: ref 1 aborting False Thread-19563::INFO::2011-01-18 20:05:21,551::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19563::DEBUG::2011-01-18 20:05:21,552::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19563::DEBUG::2011-01-18 20:05:21,553::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: moving from state preparing -> state finished Thread-19563::DEBUG::2011-01-18 20:05:21,553::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19563::DEBUG::2011-01-18 20:05:21,553::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2 releasing Thread-19563::DEBUG::2011-01-18 20:05:21,554::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19563::DEBUG::2011-01-18 20:05:21,554::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19563::DEBUG::2011-01-18 20:05:21,555::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19563::DEBUG::2011-01-18 20:05:21,555::resource::503::irs::Owner 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19563::DEBUG::2011-01-18 20:05:21,555::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19563::DEBUG::2011-01-18 20:05:21,556::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19563::DEBUG::2011-01-18 20:05:21,556::task::577::irs::Task 4e8802be-8ac2-425e-aab4-b45bfbc0ccd2: ref 0 aborting False Thread-19563::INFO::2011-01-18 20:05:21,556::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:05:21,840::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514399 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:23,853::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 20:05:24,125::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:05:24,125::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:05:24,134::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::INFO::2011-01-18 20:05:24,134::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::DEBUG::2011-01-18 20:05:24,135::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:05:24,136::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:05:24,143::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:05:24,144::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:05:24,148::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:05:24,149::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:05:24,168::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:05:24,182::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:05:24,182::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:05:24,191::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:05:24,193::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:24,409::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.524361 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:26,421::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:26,954::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501207 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:28,966::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19567::INFO::2011-01-18 20:05:29,345::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19567::DEBUG::2011-01-18 20:05:29,353::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: moving from state init -> state preparing Thread-19567::DEBUG::2011-01-18 20:05:29,353::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: eba348d3-a5d8-4644-bf51-2908e7f2b33d acquire shared (120000) Thread-19567::DEBUG::2011-01-18 20:05:29,353::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19567::DEBUG::2011-01-18 20:05:29,354::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'eba348d3-a5d8-4644-bf51-2908e7f2b33d' Thread-19567::DEBUG::2011-01-18 20:05:29,354::resource::524::irs::Owner eba348d3-a5d8-4644-bf51-2908e7f2b33d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19567::DEBUG::2011-01-18 20:05:29,354::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19567::DEBUG::2011-01-18 20:05:29,354::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: ref 1 aborting False Thread-19567::DEBUG::2011-01-18 20:05:29,355::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0489039421082', 'lastCheck': 1295373924.173785, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.055083990097', 'lastCheck': 1295373924.1889911, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0528690814972', 'lastCheck': 1295373924.187582, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0496079921722', 'lastCheck': 1295373924.19754, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0520529747009', 'lastCheck': 1295373924.1950071, 'valid': True, 'code': 0}} Thread-19567::DEBUG::2011-01-18 20:05:29,355::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: moving from state preparing -> state finished Thread-19567::DEBUG::2011-01-18 20:05:29,356::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19567::DEBUG::2011-01-18 20:05:29,356::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: eba348d3-a5d8-4644-bf51-2908e7f2b33d releasing Thread-19567::DEBUG::2011-01-18 20:05:29,356::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19567::DEBUG::2011-01-18 20:05:29,357::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19567::DEBUG::2011-01-18 20:05:29,357::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19567::DEBUG::2011-01-18 20:05:29,357::resource::503::irs::Owner eba348d3-a5d8-4644-bf51-2908e7f2b33d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19567::DEBUG::2011-01-18 20:05:29,357::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19567::DEBUG::2011-01-18 20:05:29,358::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19567::DEBUG::2011-01-18 20:05:29,358::task::577::irs::Task eba348d3-a5d8-4644-bf51-2908e7f2b33d: ref 0 aborting False Thread-19567::INFO::2011-01-18 20:05:29,358::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0489039421082', 'lastCheck': 1295373924.173785, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0528690814972', 'lastCheck': 1295373924.187582, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0520529747009', 'lastCheck': 1295373924.1950071, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0496079921722', 'lastCheck': 1295373924.19754, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.055083990097', 'lastCheck': 1295373924.1889911, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:05:29,502::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504488 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:31,513::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19570::INFO::2011-01-18 20:05:31,618::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19570::DEBUG::2011-01-18 20:05:31,619::task::577::irs::Task 21e26725-6419-42aa-ab4b-a97a62c39572: moving from state init -> state preparing Thread-19570::DEBUG::2011-01-18 20:05:31,619::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19570::DEBUG::2011-01-18 20:05:31,652::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000842 seconds, 2.4 MB/s\n'; = 0 Thread-19570::DEBUG::2011-01-18 20:05:31,652::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000842 seconds, 2.4 MB/s'], size: 2048 Thread-19570::DEBUG::2011-01-18 20:05:31,653::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19570::DEBUG::2011-01-18 20:05:31,653::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19570::DEBUG::2011-01-18 20:05:31,654::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19570::DEBUG::2011-01-18 20:05:31,655::task::577::irs::Task 21e26725-6419-42aa-ab4b-a97a62c39572: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19570::DEBUG::2011-01-18 20:05:31,655::task::577::irs::Task 21e26725-6419-42aa-ab4b-a97a62c39572: moving from state preparing -> state finished Thread-19570::DEBUG::2011-01-18 20:05:31,655::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19570::DEBUG::2011-01-18 20:05:31,656::task::577::irs::Task 21e26725-6419-42aa-ab4b-a97a62c39572: ref 0 aborting False Thread-19570::INFO::2011-01-18 20:05:31,656::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19571::INFO::2011-01-18 20:05:31,665::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19571::DEBUG::2011-01-18 20:05:31,665::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: moving from state init -> state preparing Thread-19571::DEBUG::2011-01-18 20:05:31,666::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e1284d55-4924-42c9-a00c-22600bc3aa6f acquire shared (120000) Thread-19571::DEBUG::2011-01-18 20:05:31,666::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19571::DEBUG::2011-01-18 20:05:31,667::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e1284d55-4924-42c9-a00c-22600bc3aa6f' Thread-19571::DEBUG::2011-01-18 20:05:31,667::resource::524::irs::Owner e1284d55-4924-42c9-a00c-22600bc3aa6f: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19571::DEBUG::2011-01-18 20:05:31,667::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19571::DEBUG::2011-01-18 20:05:31,668::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: ref 1 aborting False Thread-19571::INFO::2011-01-18 20:05:31,668::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19571::DEBUG::2011-01-18 20:05:31,669::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19571::DEBUG::2011-01-18 20:05:31,670::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: moving from state preparing -> state finished Thread-19571::DEBUG::2011-01-18 20:05:31,670::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19571::DEBUG::2011-01-18 20:05:31,670::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e1284d55-4924-42c9-a00c-22600bc3aa6f releasing Thread-19571::DEBUG::2011-01-18 20:05:31,671::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19571::DEBUG::2011-01-18 20:05:31,671::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19571::DEBUG::2011-01-18 20:05:31,671::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19571::DEBUG::2011-01-18 20:05:31,672::resource::503::irs::Owner e1284d55-4924-42c9-a00c-22600bc3aa6f: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19571::DEBUG::2011-01-18 20:05:31,672::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19571::DEBUG::2011-01-18 20:05:31,672::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19571::DEBUG::2011-01-18 20:05:31,673::task::577::irs::Task e1284d55-4924-42c9-a00c-22600bc3aa6f: ref 0 aborting False Thread-19571::INFO::2011-01-18 20:05:31,673::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:05:32,061::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.515306 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:34,072::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18493::INFO::2011-01-18 20:05:34,174::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:05:34,175::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:05:34,187::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:05:34,188::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:05:34,188::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:05:34,193::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:05:34,196::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18496::INFO::2011-01-18 20:05:34,197::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18497::DEBUG::2011-01-18 20:05:34,198::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 20:05:34,200::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:05:34,220::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:05:34,232::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:05:34,241::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:05:34,243::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:05:34,246::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:34,629::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.524374 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:36,643::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:37,175::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500952 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:39,188::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19575::INFO::2011-01-18 20:05:39,522::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19575::DEBUG::2011-01-18 20:05:39,522::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: moving from state init -> state preparing Thread-19575::DEBUG::2011-01-18 20:05:39,523::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: aee42d46-d7f3-40d6-a8a0-777616d73549 acquire shared (120000) Thread-19575::DEBUG::2011-01-18 20:05:39,523::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19575::DEBUG::2011-01-18 20:05:39,523::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'aee42d46-d7f3-40d6-a8a0-777616d73549' Thread-19575::DEBUG::2011-01-18 20:05:39,524::resource::524::irs::Owner aee42d46-d7f3-40d6-a8a0-777616d73549: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19575::DEBUG::2011-01-18 20:05:39,524::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19575::DEBUG::2011-01-18 20:05:39,524::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: ref 1 aborting False Thread-19575::DEBUG::2011-01-18 20:05:39,525::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0517210960388', 'lastCheck': 1295373934.2256081, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0594611167908', 'lastCheck': 1295373934.2483721, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0496618747711', 'lastCheck': 1295373934.236609, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0532920360565', 'lastCheck': 1295373934.2508581, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0488440990448', 'lastCheck': 1295373934.2452421, 'valid': True, 'code': 0}} Thread-19575::DEBUG::2011-01-18 20:05:39,525::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: moving from state preparing -> state finished Thread-19575::DEBUG::2011-01-18 20:05:39,525::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19575::DEBUG::2011-01-18 20:05:39,526::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: aee42d46-d7f3-40d6-a8a0-777616d73549 releasing Thread-19575::DEBUG::2011-01-18 20:05:39,526::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19575::DEBUG::2011-01-18 20:05:39,526::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19575::DEBUG::2011-01-18 20:05:39,527::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19575::DEBUG::2011-01-18 20:05:39,527::resource::503::irs::Owner aee42d46-d7f3-40d6-a8a0-777616d73549: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19575::DEBUG::2011-01-18 20:05:39,527::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19575::DEBUG::2011-01-18 20:05:39,527::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19575::DEBUG::2011-01-18 20:05:39,528::task::577::irs::Task aee42d46-d7f3-40d6-a8a0-777616d73549: ref 0 aborting False Thread-19575::INFO::2011-01-18 20:05:39,528::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0517210960388', 'lastCheck': 1295373934.2256081, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0496618747711', 'lastCheck': 1295373934.236609, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0488440990448', 'lastCheck': 1295373934.2452421, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0532920360565', 'lastCheck': 1295373934.2508581, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0594611167908', 'lastCheck': 1295373934.2483721, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:05:39,722::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502492 seconds, 2.0 MB/s\n'; = 0 Thread-19578::INFO::2011-01-18 20:05:41,726::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19578::DEBUG::2011-01-18 20:05:41,726::task::577::irs::Task 0d015b2d-14e5-496c-82b7-4b0838f56e0a: moving from state init -> state preparing Thread-19578::DEBUG::2011-01-18 20:05:41,727::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:41,735::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19578::DEBUG::2011-01-18 20:05:41,761::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000457 seconds, 4.5 MB/s\n'; = 0 Thread-19578::DEBUG::2011-01-18 20:05:41,762::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000457 seconds, 4.5 MB/s'], size: 2048 Thread-19578::DEBUG::2011-01-18 20:05:41,762::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19578::DEBUG::2011-01-18 20:05:41,763::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19578::DEBUG::2011-01-18 20:05:41,763::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19578::DEBUG::2011-01-18 20:05:41,764::task::577::irs::Task 0d015b2d-14e5-496c-82b7-4b0838f56e0a: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19578::DEBUG::2011-01-18 20:05:41,764::task::577::irs::Task 0d015b2d-14e5-496c-82b7-4b0838f56e0a: moving from state preparing -> state finished Thread-19578::DEBUG::2011-01-18 20:05:41,765::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19578::DEBUG::2011-01-18 20:05:41,765::task::577::irs::Task 0d015b2d-14e5-496c-82b7-4b0838f56e0a: ref 0 aborting False Thread-19578::INFO::2011-01-18 20:05:41,765::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19579::INFO::2011-01-18 20:05:41,773::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19579::DEBUG::2011-01-18 20:05:41,773::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: moving from state init -> state preparing Thread-19579::DEBUG::2011-01-18 20:05:41,774::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 24777ab8-dd67-4ff8-b830-b5c9e13fd09a acquire shared (120000) Thread-19579::DEBUG::2011-01-18 20:05:41,774::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19579::DEBUG::2011-01-18 20:05:41,774::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '24777ab8-dd67-4ff8-b830-b5c9e13fd09a' Thread-19579::DEBUG::2011-01-18 20:05:41,775::resource::524::irs::Owner 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19579::DEBUG::2011-01-18 20:05:41,775::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19579::DEBUG::2011-01-18 20:05:41,775::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: ref 1 aborting False Thread-19579::INFO::2011-01-18 20:05:41,776::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19579::DEBUG::2011-01-18 20:05:41,777::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19579::DEBUG::2011-01-18 20:05:41,777::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: moving from state preparing -> state finished Thread-19579::DEBUG::2011-01-18 20:05:41,777::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19579::DEBUG::2011-01-18 20:05:41,778::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 24777ab8-dd67-4ff8-b830-b5c9e13fd09a releasing Thread-19579::DEBUG::2011-01-18 20:05:41,778::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19579::DEBUG::2011-01-18 20:05:41,778::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19579::DEBUG::2011-01-18 20:05:41,779::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19579::DEBUG::2011-01-18 20:05:41,779::resource::503::irs::Owner 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19579::DEBUG::2011-01-18 20:05:41,779::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19579::DEBUG::2011-01-18 20:05:41,780::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19579::DEBUG::2011-01-18 20:05:41,780::task::577::irs::Task 24777ab8-dd67-4ff8-b830-b5c9e13fd09a: ref 0 aborting False Thread-19579::INFO::2011-01-18 20:05:41,780::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:05:42,281::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511365 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:05:44,224::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:05:44,225::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:05:44,236::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:05:44,237::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:05:44,245::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:05:44,246::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:05:44,251::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18494::INFO::2011-01-18 20:05:44,250::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18496::DEBUG::2011-01-18 20:05:44,252::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:05:44,253::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:05:44,265::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:05:44,283::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:05:44,286::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:44,294::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18496::DEBUG::2011-01-18 20:05:44,294::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:05:44,297::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:44,839::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501923 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:46,852::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:47,386::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502362 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:49,398::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19583::INFO::2011-01-18 20:05:49,686::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19583::DEBUG::2011-01-18 20:05:49,687::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: moving from state init -> state preparing Thread-19583::DEBUG::2011-01-18 20:05:49,687::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5546ff5c-c695-44b4-8121-b4a26ea75031 acquire shared (120000) Thread-19583::DEBUG::2011-01-18 20:05:49,688::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19583::DEBUG::2011-01-18 20:05:49,688::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5546ff5c-c695-44b4-8121-b4a26ea75031' Thread-19583::DEBUG::2011-01-18 20:05:49,689::resource::524::irs::Owner 5546ff5c-c695-44b4-8121-b4a26ea75031: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19583::DEBUG::2011-01-18 20:05:49,689::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19583::DEBUG::2011-01-18 20:05:49,690::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: ref 1 aborting False Thread-19583::DEBUG::2011-01-18 20:05:49,690::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0469360351562', 'lastCheck': 1295373944.271776, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0532279014587', 'lastCheck': 1295373944.303139, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0535068511963', 'lastCheck': 1295373944.2893679, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0517680644989', 'lastCheck': 1295373944.302685, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0453190803528', 'lastCheck': 1295373944.2901981, 'valid': True, 'code': 0}} Thread-19583::DEBUG::2011-01-18 20:05:49,691::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: moving from state preparing -> state finished Thread-19583::DEBUG::2011-01-18 20:05:49,691::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19583::DEBUG::2011-01-18 20:05:49,691::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5546ff5c-c695-44b4-8121-b4a26ea75031 releasing Thread-19583::DEBUG::2011-01-18 20:05:49,692::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19583::DEBUG::2011-01-18 20:05:49,692::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19583::DEBUG::2011-01-18 20:05:49,693::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19583::DEBUG::2011-01-18 20:05:49,693::resource::503::irs::Owner 5546ff5c-c695-44b4-8121-b4a26ea75031: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19583::DEBUG::2011-01-18 20:05:49,693::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19583::DEBUG::2011-01-18 20:05:49,694::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19583::DEBUG::2011-01-18 20:05:49,694::task::577::irs::Task 5546ff5c-c695-44b4-8121-b4a26ea75031: ref 0 aborting False Thread-19583::INFO::2011-01-18 20:05:49,694::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0469360351562', 'lastCheck': 1295373944.271776, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0535068511963', 'lastCheck': 1295373944.2893679, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0453190803528', 'lastCheck': 1295373944.2901981, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0517680644989', 'lastCheck': 1295373944.302685, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0532279014587', 'lastCheck': 1295373944.303139, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:05:49,936::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506448 seconds, 2.0 MB/s\n'; = 0 Thread-19586::INFO::2011-01-18 20:05:51,837::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19586::DEBUG::2011-01-18 20:05:51,838::task::577::irs::Task 9dad470a-0b97-4d71-a076-56b38b18a4c1: moving from state init -> state preparing Thread-19586::DEBUG::2011-01-18 20:05:51,838::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19586::DEBUG::2011-01-18 20:05:51,870::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s\n'; = 0 Thread-19586::DEBUG::2011-01-18 20:05:51,871::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s'], size: 2048 Thread-19586::DEBUG::2011-01-18 20:05:51,871::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19586::DEBUG::2011-01-18 20:05:51,871::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19586::DEBUG::2011-01-18 20:05:51,872::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19586::DEBUG::2011-01-18 20:05:51,872::task::577::irs::Task 9dad470a-0b97-4d71-a076-56b38b18a4c1: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19586::DEBUG::2011-01-18 20:05:51,873::task::577::irs::Task 9dad470a-0b97-4d71-a076-56b38b18a4c1: moving from state preparing -> state finished Thread-19586::DEBUG::2011-01-18 20:05:51,873::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19586::DEBUG::2011-01-18 20:05:51,873::task::577::irs::Task 9dad470a-0b97-4d71-a076-56b38b18a4c1: ref 0 aborting False Thread-19586::INFO::2011-01-18 20:05:51,873::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19587::INFO::2011-01-18 20:05:51,882::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19587::DEBUG::2011-01-18 20:05:51,882::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: moving from state init -> state preparing Thread-19587::DEBUG::2011-01-18 20:05:51,882::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: faef3318-ce0d-4627-988b-c5e8a0e6e7c0 acquire shared (120000) Thread-19587::DEBUG::2011-01-18 20:05:51,883::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19587::DEBUG::2011-01-18 20:05:51,883::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'faef3318-ce0d-4627-988b-c5e8a0e6e7c0' Thread-19587::DEBUG::2011-01-18 20:05:51,883::resource::524::irs::Owner faef3318-ce0d-4627-988b-c5e8a0e6e7c0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19587::DEBUG::2011-01-18 20:05:51,883::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19587::DEBUG::2011-01-18 20:05:51,884::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: ref 1 aborting False Thread-19587::INFO::2011-01-18 20:05:51,884::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19587::DEBUG::2011-01-18 20:05:51,885::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19587::DEBUG::2011-01-18 20:05:51,885::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: moving from state preparing -> state finished Thread-19587::DEBUG::2011-01-18 20:05:51,886::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19587::DEBUG::2011-01-18 20:05:51,886::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: faef3318-ce0d-4627-988b-c5e8a0e6e7c0 releasing Thread-19587::DEBUG::2011-01-18 20:05:51,886::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19587::DEBUG::2011-01-18 20:05:51,886::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19587::DEBUG::2011-01-18 20:05:51,887::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19587::DEBUG::2011-01-18 20:05:51,887::resource::503::irs::Owner faef3318-ce0d-4627-988b-c5e8a0e6e7c0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19587::DEBUG::2011-01-18 20:05:51,887::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19587::DEBUG::2011-01-18 20:05:51,888::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19587::DEBUG::2011-01-18 20:05:51,888::task::577::irs::Task faef3318-ce0d-4627-988b-c5e8a0e6e7c0: ref 0 aborting False Thread-19587::INFO::2011-01-18 20:05:51,888::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:05:51,950::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:52,493::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.51105 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:05:54,271::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:05:54,272::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:05:54,289::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:05:54,290::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:05:54,290::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:05:54,291::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:05:54,302::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18494::INFO::2011-01-18 20:05:54,303::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18496::DEBUG::2011-01-18 20:05:54,304::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:05:54,304::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:05:54,315::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:05:54,331::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:05:54,335::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:05:54,348::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:05:54,349::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:54,507::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:55,040::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501835 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:57,054::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:05:57,586::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500789 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:05:59,599::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19591::INFO::2011-01-18 20:05:59,855::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19591::DEBUG::2011-01-18 20:05:59,855::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: moving from state init -> state preparing Thread-19591::DEBUG::2011-01-18 20:05:59,856::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f80abd4e-3658-47ac-95b9-f517582fdbc6 acquire shared (120000) Thread-19591::DEBUG::2011-01-18 20:05:59,856::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19591::DEBUG::2011-01-18 20:05:59,856::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f80abd4e-3658-47ac-95b9-f517582fdbc6' Thread-19591::DEBUG::2011-01-18 20:05:59,856::resource::524::irs::Owner f80abd4e-3658-47ac-95b9-f517582fdbc6: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19591::DEBUG::2011-01-18 20:05:59,857::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19591::DEBUG::2011-01-18 20:05:59,857::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: ref 1 aborting False Thread-19591::DEBUG::2011-01-18 20:05:59,857::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490901470184', 'lastCheck': 1295373954.3209291, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0501990318298', 'lastCheck': 1295373954.353158, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0473201274872', 'lastCheck': 1295373954.336184, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0525560379028', 'lastCheck': 1295373954.3544991, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0488219261169', 'lastCheck': 1295373954.3392069, 'valid': True, 'code': 0}} Thread-19591::DEBUG::2011-01-18 20:05:59,858::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: moving from state preparing -> state finished Thread-19591::DEBUG::2011-01-18 20:05:59,858::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19591::DEBUG::2011-01-18 20:05:59,858::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f80abd4e-3658-47ac-95b9-f517582fdbc6 releasing Thread-19591::DEBUG::2011-01-18 20:05:59,859::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19591::DEBUG::2011-01-18 20:05:59,859::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19591::DEBUG::2011-01-18 20:05:59,859::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19591::DEBUG::2011-01-18 20:05:59,860::resource::503::irs::Owner f80abd4e-3658-47ac-95b9-f517582fdbc6: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19591::DEBUG::2011-01-18 20:05:59,860::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19591::DEBUG::2011-01-18 20:05:59,860::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19591::DEBUG::2011-01-18 20:05:59,861::task::577::irs::Task f80abd4e-3658-47ac-95b9-f517582fdbc6: ref 0 aborting False Thread-19591::INFO::2011-01-18 20:05:59,861::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0490901470184', 'lastCheck': 1295373954.3209291, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0473201274872', 'lastCheck': 1295373954.336184, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0488219261169', 'lastCheck': 1295373954.3392069, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0525560379028', 'lastCheck': 1295373954.3544991, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0501990318298', 'lastCheck': 1295373954.353158, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:06:00,132::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501562 seconds, 2.0 MB/s\n'; = 0 Thread-19594::INFO::2011-01-18 20:06:01,954::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19594::DEBUG::2011-01-18 20:06:01,954::task::577::irs::Task e1b083b8-7f06-4018-aa8f-76091caff75e: moving from state init -> state preparing Thread-19594::DEBUG::2011-01-18 20:06:01,955::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19594::DEBUG::2011-01-18 20:06:01,986::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000478 seconds, 4.3 MB/s\n'; = 0 Thread-19594::DEBUG::2011-01-18 20:06:01,987::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000478 seconds, 4.3 MB/s'], size: 2048 Thread-19594::DEBUG::2011-01-18 20:06:01,987::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19594::DEBUG::2011-01-18 20:06:01,988::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19594::DEBUG::2011-01-18 20:06:01,988::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19594::DEBUG::2011-01-18 20:06:01,989::task::577::irs::Task e1b083b8-7f06-4018-aa8f-76091caff75e: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19594::DEBUG::2011-01-18 20:06:01,989::task::577::irs::Task e1b083b8-7f06-4018-aa8f-76091caff75e: moving from state preparing -> state finished Thread-19594::DEBUG::2011-01-18 20:06:01,989::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19594::DEBUG::2011-01-18 20:06:01,990::task::577::irs::Task e1b083b8-7f06-4018-aa8f-76091caff75e: ref 0 aborting False Thread-19594::INFO::2011-01-18 20:06:01,990::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19595::INFO::2011-01-18 20:06:01,998::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19595::DEBUG::2011-01-18 20:06:01,998::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: moving from state init -> state preparing Thread-19595::DEBUG::2011-01-18 20:06:01,998::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7ec3aea1-43f9-40d3-8dea-85a6cfc64462 acquire shared (120000) Thread-19595::DEBUG::2011-01-18 20:06:01,999::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19595::DEBUG::2011-01-18 20:06:01,999::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '7ec3aea1-43f9-40d3-8dea-85a6cfc64462' Thread-19595::DEBUG::2011-01-18 20:06:01,999::resource::524::irs::Owner 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19595::DEBUG::2011-01-18 20:06:01,999::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19595::DEBUG::2011-01-18 20:06:02,000::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: ref 1 aborting False Thread-19595::INFO::2011-01-18 20:06:02,000::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19595::DEBUG::2011-01-18 20:06:02,001::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19595::DEBUG::2011-01-18 20:06:02,001::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: moving from state preparing -> state finished Thread-19595::DEBUG::2011-01-18 20:06:02,002::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19595::DEBUG::2011-01-18 20:06:02,002::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7ec3aea1-43f9-40d3-8dea-85a6cfc64462 releasing Thread-19595::DEBUG::2011-01-18 20:06:02,002::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19595::DEBUG::2011-01-18 20:06:02,003::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19595::DEBUG::2011-01-18 20:06:02,003::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19595::DEBUG::2011-01-18 20:06:02,003::resource::503::irs::Owner 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19595::DEBUG::2011-01-18 20:06:02,003::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19595::DEBUG::2011-01-18 20:06:02,004::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19595::DEBUG::2011-01-18 20:06:02,004::task::577::irs::Task 7ec3aea1-43f9-40d3-8dea-85a6cfc64462: ref 0 aborting False Thread-19595::INFO::2011-01-18 20:06:02,004::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:06:02,144::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:02,686::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510327 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:06:04,320::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:06:04,321::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:06:04,336::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:06:04,337::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::INFO::2011-01-18 20:06:04,339::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:06:04,340::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:06:04,353::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:06:04,354::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:06:04,355::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:06:04,359::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:06:04,360::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:06:04,379::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:06:04,380::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:06:04,397::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:06:04,399::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:04,698::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:05,233::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503285 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:07,246::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:07,778::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500419 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:09,792::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19599::INFO::2011-01-18 20:06:10,027::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19599::DEBUG::2011-01-18 20:06:10,028::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: moving from state init -> state preparing Thread-19599::DEBUG::2011-01-18 20:06:10,028::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2757b111-6a0d-49fe-986c-e56bf60c56bc acquire shared (120000) Thread-19599::DEBUG::2011-01-18 20:06:10,029::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19599::DEBUG::2011-01-18 20:06:10,029::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2757b111-6a0d-49fe-986c-e56bf60c56bc' Thread-19599::DEBUG::2011-01-18 20:06:10,029::resource::524::irs::Owner 2757b111-6a0d-49fe-986c-e56bf60c56bc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19599::DEBUG::2011-01-18 20:06:10,030::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19599::DEBUG::2011-01-18 20:06:10,030::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: ref 1 aborting False Thread-19599::DEBUG::2011-01-18 20:06:10,030::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0473239421844', 'lastCheck': 1295373964.368161, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048721075058', 'lastCheck': 1295373964.401634, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0498521327972', 'lastCheck': 1295373964.3857181, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484049320221', 'lastCheck': 1295373964.40362, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.046355009079', 'lastCheck': 1295373964.385304, 'valid': True, 'code': 0}} Thread-19599::DEBUG::2011-01-18 20:06:10,031::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: moving from state preparing -> state finished Thread-19599::DEBUG::2011-01-18 20:06:10,031::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19599::DEBUG::2011-01-18 20:06:10,031::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2757b111-6a0d-49fe-986c-e56bf60c56bc releasing Thread-19599::DEBUG::2011-01-18 20:06:10,032::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19599::DEBUG::2011-01-18 20:06:10,032::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19599::DEBUG::2011-01-18 20:06:10,032::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19599::DEBUG::2011-01-18 20:06:10,033::resource::503::irs::Owner 2757b111-6a0d-49fe-986c-e56bf60c56bc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19599::DEBUG::2011-01-18 20:06:10,033::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19599::DEBUG::2011-01-18 20:06:10,033::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19599::DEBUG::2011-01-18 20:06:10,034::task::577::irs::Task 2757b111-6a0d-49fe-986c-e56bf60c56bc: ref 0 aborting False Thread-19599::INFO::2011-01-18 20:06:10,034::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0473239421844', 'lastCheck': 1295373964.368161, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0498521327972', 'lastCheck': 1295373964.3857181, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.046355009079', 'lastCheck': 1295373964.385304, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0484049320221', 'lastCheck': 1295373964.40362, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.048721075058', 'lastCheck': 1295373964.401634, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:06:10,327::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.502472 seconds, 2.0 MB/s\n'; = 0 Thread-19601::INFO::2011-01-18 20:06:12,060::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19601::DEBUG::2011-01-18 20:06:12,061::task::577::irs::Task 2a233e3f-e94f-4397-8a07-de3d8a7a9f79: moving from state init -> state preparing Thread-19601::DEBUG::2011-01-18 20:06:12,061::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19601::DEBUG::2011-01-18 20:06:12,093::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000442 seconds, 4.6 MB/s\n'; = 0 Thread-19601::DEBUG::2011-01-18 20:06:12,093::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000442 seconds, 4.6 MB/s'], size: 2048 Thread-19601::DEBUG::2011-01-18 20:06:12,094::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19601::DEBUG::2011-01-18 20:06:12,094::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19601::DEBUG::2011-01-18 20:06:12,095::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19601::DEBUG::2011-01-18 20:06:12,095::task::577::irs::Task 2a233e3f-e94f-4397-8a07-de3d8a7a9f79: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19601::DEBUG::2011-01-18 20:06:12,096::task::577::irs::Task 2a233e3f-e94f-4397-8a07-de3d8a7a9f79: moving from state preparing -> state finished Thread-19601::DEBUG::2011-01-18 20:06:12,096::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19601::DEBUG::2011-01-18 20:06:12,096::task::577::irs::Task 2a233e3f-e94f-4397-8a07-de3d8a7a9f79: ref 0 aborting False Thread-19601::INFO::2011-01-18 20:06:12,096::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19602::INFO::2011-01-18 20:06:12,105::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19602::DEBUG::2011-01-18 20:06:12,106::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: moving from state init -> state preparing Thread-19602::DEBUG::2011-01-18 20:06:12,106::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8f28e80-d87e-4c8d-8a2e-1401a0ed122e acquire shared (120000) Thread-19602::DEBUG::2011-01-18 20:06:12,106::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19602::DEBUG::2011-01-18 20:06:12,107::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f8f28e80-d87e-4c8d-8a2e-1401a0ed122e' Thread-19602::DEBUG::2011-01-18 20:06:12,107::resource::524::irs::Owner f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19602::DEBUG::2011-01-18 20:06:12,107::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19602::DEBUG::2011-01-18 20:06:12,108::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: ref 1 aborting False Thread-19602::INFO::2011-01-18 20:06:12,108::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19602::DEBUG::2011-01-18 20:06:12,109::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19602::DEBUG::2011-01-18 20:06:12,109::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: moving from state preparing -> state finished Thread-19602::DEBUG::2011-01-18 20:06:12,110::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19602::DEBUG::2011-01-18 20:06:12,110::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8f28e80-d87e-4c8d-8a2e-1401a0ed122e releasing Thread-19602::DEBUG::2011-01-18 20:06:12,110::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19602::DEBUG::2011-01-18 20:06:12,111::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19602::DEBUG::2011-01-18 20:06:12,112::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19602::DEBUG::2011-01-18 20:06:12,112::resource::503::irs::Owner f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19602::DEBUG::2011-01-18 20:06:12,112::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19602::DEBUG::2011-01-18 20:06:12,113::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19602::DEBUG::2011-01-18 20:06:12,113::task::577::irs::Task f8f28e80-d87e-4c8d-8a2e-1401a0ed122e: ref 0 aborting False Thread-19602::INFO::2011-01-18 20:06:12,113::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:06:12,338::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:12,871::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500575 seconds, 2.0 MB/s\n'; = 0 Thread-18493::INFO::2011-01-18 20:06:14,367::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:06:14,368::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:06:14,385::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::INFO::2011-01-18 20:06:14,386::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18495::DEBUG::2011-01-18 20:06:14,387::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:06:14,388::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:06:14,401::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:06:14,402::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:06:14,403::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:06:14,406::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:06:14,411::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:06:14,412::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata count=1' (cwd None) Thread-18495::DEBUG::2011-01-18 20:06:14,428::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:06:14,429::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:06:14,445::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:06:14,446::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000546 seconds, 3.8 MB/s\n'; = 0 Thread-18493::DEBUG::2011-01-18 20:06:14,446::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000546 seconds, 3.8 MB/s'], size: 2048 Thread-18493::DEBUG::2011-01-18 20:06:14,446::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_3', 'IOOPTIMEOUTSEC=', 'LEASERETRIES=', 'LEASETIMESEC=', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=', 'MASTER_VERSION=0', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'PV0=pv:1REDHAT_SCALE18,uuid:Qgf46A-WY12-2WRV-PrRt-wlBf-dG5l-Y0CiR2,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE19,uuid:I9Af7U-Xs1p-25wD-eipC-Fidg-XxVv-g51Ql4,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE16,uuid:Nvl4M2-De3J-JsKJ-JkBe-GZ6s-AjKD-lcInZA,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE17,uuid:bLZC8w-2nd6-mSQL-l7bf-qTMV-V0zG-2AjV5E,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE23,uuid:6a4K6m-i3eH-fMq3-o87l-7Vrd-u85A-gukoFD,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE22,uuid:Bq8FkT-8D7Z-QeDV-eZzx-RGR3-UzBm-xdyAgL,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE21,uuid:Vnwbgp-85vv-DFdc-LxUu-kPBu-pkQ3-jsIHqv,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE20,uuid:WqzA8s-xBVm-fjUO-1mxU-s8GQ-BTji-sWHK8S,pestart:0,pecount:95,mapoffset:665', 'ROLE=Regular', 'SDUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=u7udFg-03KL-F8eg-BQhY-TAJA-bV0h-ylO1p8', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', '_SHA_CKSUM=8fd1c0112168759eac1d4afe75228b2ee79efc2f'] Thread-18493::DEBUG::2011-01-18 20:06:14,447::metadata::89::irs::metadata.__validate() __cksum(md) = 8fd1c0112168759eac1d4afe75228b2ee79efc2f Thread-18496::DEBUG::2011-01-18 20:06:14,454::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:14,883::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:15,426::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511823 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:17,438::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:17,970::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500192 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:19,983::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19607::INFO::2011-01-18 20:06:20,194::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19607::DEBUG::2011-01-18 20:06:20,194::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: moving from state init -> state preparing Thread-19607::DEBUG::2011-01-18 20:06:20,195::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf acquire shared (120000) Thread-19607::DEBUG::2011-01-18 20:06:20,195::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19607::DEBUG::2011-01-18 20:06:20,195::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf' Thread-19607::DEBUG::2011-01-18 20:06:20,196::resource::524::irs::Owner a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19607::DEBUG::2011-01-18 20:06:20,196::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19607::DEBUG::2011-01-18 20:06:20,196::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: ref 1 aborting False Thread-19607::DEBUG::2011-01-18 20:06:20,197::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0831129550934', 'lastCheck': 1295373974.4509749, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0480270385742', 'lastCheck': 1295373974.448935, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0513229370117', 'lastCheck': 1295373974.4361899, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0566229820251', 'lastCheck': 1295373974.4595981, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0493760108948', 'lastCheck': 1295373974.4352939, 'valid': True, 'code': 0}} Thread-19607::DEBUG::2011-01-18 20:06:20,197::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: moving from state preparing -> state finished Thread-19607::DEBUG::2011-01-18 20:06:20,198::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19607::DEBUG::2011-01-18 20:06:20,198::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf releasing Thread-19607::DEBUG::2011-01-18 20:06:20,198::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19607::DEBUG::2011-01-18 20:06:20,199::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19607::DEBUG::2011-01-18 20:06:20,199::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19607::DEBUG::2011-01-18 20:06:20,199::resource::503::irs::Owner a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19607::DEBUG::2011-01-18 20:06:20,200::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19607::DEBUG::2011-01-18 20:06:20,200::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19607::DEBUG::2011-01-18 20:06:20,200::task::577::irs::Task a000152f-bf1b-4c34-aa8b-b3b7cb3d7dbf: ref 0 aborting False Thread-19607::INFO::2011-01-18 20:06:20,201::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0831129550934', 'lastCheck': 1295373974.4509749, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0513229370117', 'lastCheck': 1295373974.4361899, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0493760108948', 'lastCheck': 1295373974.4352939, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0566229820251', 'lastCheck': 1295373974.4595981, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0480270385742', 'lastCheck': 1295373974.448935, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:06:20,520::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505392 seconds, 2.0 MB/s\n'; = 0 Thread-19609::INFO::2011-01-18 20:06:22,167::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19609::DEBUG::2011-01-18 20:06:22,168::task::577::irs::Task eb030d79-66c0-42e5-a1f7-c3341d5398b6: moving from state init -> state preparing Thread-19609::DEBUG::2011-01-18 20:06:22,168::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19609::DEBUG::2011-01-18 20:06:22,200::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000426 seconds, 4.8 MB/s\n'; = 0 Thread-19609::DEBUG::2011-01-18 20:06:22,201::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000426 seconds, 4.8 MB/s'], size: 2048 Thread-19609::DEBUG::2011-01-18 20:06:22,201::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19609::DEBUG::2011-01-18 20:06:22,202::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19609::DEBUG::2011-01-18 20:06:22,202::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19609::DEBUG::2011-01-18 20:06:22,203::task::577::irs::Task eb030d79-66c0-42e5-a1f7-c3341d5398b6: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19609::DEBUG::2011-01-18 20:06:22,203::task::577::irs::Task eb030d79-66c0-42e5-a1f7-c3341d5398b6: moving from state preparing -> state finished Thread-19609::DEBUG::2011-01-18 20:06:22,203::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19609::DEBUG::2011-01-18 20:06:22,204::task::577::irs::Task eb030d79-66c0-42e5-a1f7-c3341d5398b6: ref 0 aborting False Thread-19609::INFO::2011-01-18 20:06:22,204::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19610::INFO::2011-01-18 20:06:22,212::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19610::DEBUG::2011-01-18 20:06:22,213::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: moving from state init -> state preparing Thread-19610::DEBUG::2011-01-18 20:06:22,213::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4f50a490-82c9-41be-a880-1da554678c64 acquire shared (120000) Thread-19610::DEBUG::2011-01-18 20:06:22,213::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19610::DEBUG::2011-01-18 20:06:22,214::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '4f50a490-82c9-41be-a880-1da554678c64' Thread-19610::DEBUG::2011-01-18 20:06:22,214::resource::524::irs::Owner 4f50a490-82c9-41be-a880-1da554678c64: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19610::DEBUG::2011-01-18 20:06:22,214::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19610::DEBUG::2011-01-18 20:06:22,214::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: ref 1 aborting False Thread-19610::INFO::2011-01-18 20:06:22,215::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19610::DEBUG::2011-01-18 20:06:22,216::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19610::DEBUG::2011-01-18 20:06:22,216::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: moving from state preparing -> state finished Thread-19610::DEBUG::2011-01-18 20:06:22,216::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19610::DEBUG::2011-01-18 20:06:22,217::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 4f50a490-82c9-41be-a880-1da554678c64 releasing Thread-19610::DEBUG::2011-01-18 20:06:22,217::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19610::DEBUG::2011-01-18 20:06:22,217::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19610::DEBUG::2011-01-18 20:06:22,217::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19610::DEBUG::2011-01-18 20:06:22,218::resource::503::irs::Owner 4f50a490-82c9-41be-a880-1da554678c64: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19610::DEBUG::2011-01-18 20:06:22,218::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19610::DEBUG::2011-01-18 20:06:22,218::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19610::DEBUG::2011-01-18 20:06:22,219::task::577::irs::Task 4f50a490-82c9-41be-a880-1da554678c64: ref 0 aborting False Thread-19610::INFO::2011-01-18 20:06:22,219::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:06:22,533::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:23,064::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500437 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:06:24,437::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::INFO::2011-01-18 20:06:24,438::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18495::DEBUG::2011-01-18 20:06:24,439::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:06:24,439::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:06:24,449::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:06:24,450::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:06:24,453::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:06:24,455::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:06:24,459::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:06:24,460::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18495::DEBUG::2011-01-18 20:06:24,480::misc::122::irs::SUCCESS: = ''; = 0 Thread-18497::DEBUG::2011-01-18 20:06:24,483::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:06:24,493::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:06:24,501::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:06:24,501::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:25,077::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:25,620::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.511597 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:27,633::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:28,165::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500212 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:30,177::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19615::INFO::2011-01-18 20:06:30,362::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19615::DEBUG::2011-01-18 20:06:30,363::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: moving from state init -> state preparing Thread-19615::DEBUG::2011-01-18 20:06:30,363::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 18fb37f9-dba4-4bea-8a0a-04c05c20c393 acquire shared (120000) Thread-19615::DEBUG::2011-01-18 20:06:30,364::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19615::DEBUG::2011-01-18 20:06:30,364::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '18fb37f9-dba4-4bea-8a0a-04c05c20c393' Thread-19615::DEBUG::2011-01-18 20:06:30,364::resource::524::irs::Owner 18fb37f9-dba4-4bea-8a0a-04c05c20c393: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19615::DEBUG::2011-01-18 20:06:30,365::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19615::DEBUG::2011-01-18 20:06:30,365::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: ref 1 aborting False Thread-19615::DEBUG::2011-01-18 20:06:30,365::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0516920089722', 'lastCheck': 1295373984.5046799, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473279953003', 'lastCheck': 1295373984.4962399, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0505809783936', 'lastCheck': 1295373984.488421, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0483720302582', 'lastCheck': 1295373984.507282, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0505888462067', 'lastCheck': 1295373984.4887519, 'valid': True, 'code': 0}} Thread-19615::DEBUG::2011-01-18 20:06:30,366::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: moving from state preparing -> state finished Thread-19615::DEBUG::2011-01-18 20:06:30,366::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19615::DEBUG::2011-01-18 20:06:30,366::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 18fb37f9-dba4-4bea-8a0a-04c05c20c393 releasing Thread-19615::DEBUG::2011-01-18 20:06:30,367::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19615::DEBUG::2011-01-18 20:06:30,367::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19615::DEBUG::2011-01-18 20:06:30,367::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19615::DEBUG::2011-01-18 20:06:30,367::resource::503::irs::Owner 18fb37f9-dba4-4bea-8a0a-04c05c20c393: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19615::DEBUG::2011-01-18 20:06:30,368::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19615::DEBUG::2011-01-18 20:06:30,368::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19615::DEBUG::2011-01-18 20:06:30,368::task::577::irs::Task 18fb37f9-dba4-4bea-8a0a-04c05c20c393: ref 0 aborting False Thread-19615::INFO::2011-01-18 20:06:30,369::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0516920089722', 'lastCheck': 1295373984.5046799, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0505809783936', 'lastCheck': 1295373984.488421, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0505888462067', 'lastCheck': 1295373984.4887519, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0483720302582', 'lastCheck': 1295373984.507282, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0473279953003', 'lastCheck': 1295373984.4962399, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:06:30,713::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.504382 seconds, 2.0 MB/s\n'; = 0 Thread-19617::INFO::2011-01-18 20:06:32,271::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19617::DEBUG::2011-01-18 20:06:32,271::task::577::irs::Task 539eb4fb-ddc6-4db7-88a5-4d99bec5fb7a: moving from state init -> state preparing Thread-19617::DEBUG::2011-01-18 20:06:32,272::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19617::DEBUG::2011-01-18 20:06:32,303::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000405 seconds, 5.1 MB/s\n'; = 0 Thread-19617::DEBUG::2011-01-18 20:06:32,304::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000405 seconds, 5.1 MB/s'], size: 2048 Thread-19617::DEBUG::2011-01-18 20:06:32,304::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19617::DEBUG::2011-01-18 20:06:32,305::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19617::DEBUG::2011-01-18 20:06:32,305::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19617::DEBUG::2011-01-18 20:06:32,306::task::577::irs::Task 539eb4fb-ddc6-4db7-88a5-4d99bec5fb7a: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19617::DEBUG::2011-01-18 20:06:32,306::task::577::irs::Task 539eb4fb-ddc6-4db7-88a5-4d99bec5fb7a: moving from state preparing -> state finished Thread-19617::DEBUG::2011-01-18 20:06:32,306::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19617::DEBUG::2011-01-18 20:06:32,306::task::577::irs::Task 539eb4fb-ddc6-4db7-88a5-4d99bec5fb7a: ref 0 aborting False Thread-19617::INFO::2011-01-18 20:06:32,307::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19618::INFO::2011-01-18 20:06:32,315::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19618::DEBUG::2011-01-18 20:06:32,316::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: moving from state init -> state preparing Thread-19618::DEBUG::2011-01-18 20:06:32,316::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6f30f9cd-db4e-4673-86ea-7755bddd5172 acquire shared (120000) Thread-19618::DEBUG::2011-01-18 20:06:32,316::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19618::DEBUG::2011-01-18 20:06:32,317::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '6f30f9cd-db4e-4673-86ea-7755bddd5172' Thread-19618::DEBUG::2011-01-18 20:06:32,317::resource::524::irs::Owner 6f30f9cd-db4e-4673-86ea-7755bddd5172: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19618::DEBUG::2011-01-18 20:06:32,317::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19618::DEBUG::2011-01-18 20:06:32,318::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: ref 1 aborting False Thread-19618::INFO::2011-01-18 20:06:32,318::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19618::DEBUG::2011-01-18 20:06:32,319::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19618::DEBUG::2011-01-18 20:06:32,319::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: moving from state preparing -> state finished Thread-19618::DEBUG::2011-01-18 20:06:32,319::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19618::DEBUG::2011-01-18 20:06:32,320::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 6f30f9cd-db4e-4673-86ea-7755bddd5172 releasing Thread-19618::DEBUG::2011-01-18 20:06:32,320::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19618::DEBUG::2011-01-18 20:06:32,320::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19618::DEBUG::2011-01-18 20:06:32,320::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19618::DEBUG::2011-01-18 20:06:32,321::resource::503::irs::Owner 6f30f9cd-db4e-4673-86ea-7755bddd5172: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19618::DEBUG::2011-01-18 20:06:32,321::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19618::DEBUG::2011-01-18 20:06:32,321::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19618::DEBUG::2011-01-18 20:06:32,322::task::577::irs::Task 6f30f9cd-db4e-4673-86ea-7755bddd5172: ref 0 aborting False Thread-19618::INFO::2011-01-18 20:06:32,322::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:06:32,726::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:33,258::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500189 seconds, 2.0 MB/s\n'; = 0 Thread-18495::INFO::2011-01-18 20:06:34,487::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18497::INFO::2011-01-18 20:06:34,488::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18495::DEBUG::2011-01-18 20:06:34,489::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:06:34,489::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:06:34,496::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:06:34,497::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:06:34,504::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:06:34,505::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:06:34,508::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:06:34,509::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:06:34,532::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:06:34,535::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:06:34,543::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:06:34,545::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:06:34,552::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:35,272::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:35,814::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510756 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:37,828::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:38,360::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500331 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:40,373::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19623::INFO::2011-01-18 20:06:40,577::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19623::DEBUG::2011-01-18 20:06:40,577::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: moving from state init -> state preparing Thread-19623::DEBUG::2011-01-18 20:06:40,578::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ff6cb49a-d0db-4b00-8847-35ec75158259 acquire shared (120000) Thread-19623::DEBUG::2011-01-18 20:06:40,578::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19623::DEBUG::2011-01-18 20:06:40,578::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ff6cb49a-d0db-4b00-8847-35ec75158259' Thread-19623::DEBUG::2011-01-18 20:06:40,579::resource::524::irs::Owner ff6cb49a-d0db-4b00-8847-35ec75158259: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19623::DEBUG::2011-01-18 20:06:40,579::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19623::DEBUG::2011-01-18 20:06:40,579::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: ref 1 aborting False Thread-19623::DEBUG::2011-01-18 20:06:40,580::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450809001923', 'lastCheck': 1295373994.54895, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0505130290985', 'lastCheck': 1295373994.5463979, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0537168979645', 'lastCheck': 1295373994.541559, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0482590198517', 'lastCheck': 1295373994.5564401, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0492241382599', 'lastCheck': 1295373994.537425, 'valid': True, 'code': 0}} Thread-19623::DEBUG::2011-01-18 20:06:40,580::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: moving from state preparing -> state finished Thread-19623::DEBUG::2011-01-18 20:06:40,581::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19623::DEBUG::2011-01-18 20:06:40,581::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ff6cb49a-d0db-4b00-8847-35ec75158259 releasing Thread-19623::DEBUG::2011-01-18 20:06:40,581::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19623::DEBUG::2011-01-18 20:06:40,581::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19623::DEBUG::2011-01-18 20:06:40,582::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19623::DEBUG::2011-01-18 20:06:40,582::resource::503::irs::Owner ff6cb49a-d0db-4b00-8847-35ec75158259: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19623::DEBUG::2011-01-18 20:06:40,582::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19623::DEBUG::2011-01-18 20:06:40,583::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19623::DEBUG::2011-01-18 20:06:40,637::task::577::irs::Task ff6cb49a-d0db-4b00-8847-35ec75158259: ref 0 aborting False Thread-19623::INFO::2011-01-18 20:06:40,638::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0450809001923', 'lastCheck': 1295373994.54895, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0537168979645', 'lastCheck': 1295373994.541559, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0492241382599', 'lastCheck': 1295373994.537425, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0482590198517', 'lastCheck': 1295373994.5564401, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0505130290985', 'lastCheck': 1295373994.5463979, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:06:40,908::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.503644 seconds, 2.0 MB/s\n'; = 0 Thread-19625::INFO::2011-01-18 20:06:42,375::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19625::DEBUG::2011-01-18 20:06:42,375::task::577::irs::Task 46f202c7-7e95-462c-a030-464bde3a83e6: moving from state init -> state preparing Thread-19625::DEBUG::2011-01-18 20:06:42,375::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19625::DEBUG::2011-01-18 20:06:42,407::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000413 seconds, 5.0 MB/s\n'; = 0 Thread-19625::DEBUG::2011-01-18 20:06:42,407::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000413 seconds, 5.0 MB/s'], size: 2048 Thread-19625::DEBUG::2011-01-18 20:06:42,408::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19625::DEBUG::2011-01-18 20:06:42,408::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19625::DEBUG::2011-01-18 20:06:42,409::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19625::DEBUG::2011-01-18 20:06:42,409::task::577::irs::Task 46f202c7-7e95-462c-a030-464bde3a83e6: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19625::DEBUG::2011-01-18 20:06:42,409::task::577::irs::Task 46f202c7-7e95-462c-a030-464bde3a83e6: moving from state preparing -> state finished Thread-19625::DEBUG::2011-01-18 20:06:42,410::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19625::DEBUG::2011-01-18 20:06:42,410::task::577::irs::Task 46f202c7-7e95-462c-a030-464bde3a83e6: ref 0 aborting False Thread-19625::INFO::2011-01-18 20:06:42,410::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19626::INFO::2011-01-18 20:06:42,418::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19626::DEBUG::2011-01-18 20:06:42,419::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: moving from state init -> state preparing Thread-19626::DEBUG::2011-01-18 20:06:42,419::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0113e6ec-96c4-43ec-9c11-c47f9a6714cd acquire shared (120000) Thread-19626::DEBUG::2011-01-18 20:06:42,419::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19626::DEBUG::2011-01-18 20:06:42,420::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0113e6ec-96c4-43ec-9c11-c47f9a6714cd' Thread-19626::DEBUG::2011-01-18 20:06:42,420::resource::524::irs::Owner 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19626::DEBUG::2011-01-18 20:06:42,420::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19626::DEBUG::2011-01-18 20:06:42,421::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: ref 1 aborting False Thread-19626::INFO::2011-01-18 20:06:42,421::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19626::DEBUG::2011-01-18 20:06:42,422::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19626::DEBUG::2011-01-18 20:06:42,422::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: moving from state preparing -> state finished Thread-19626::DEBUG::2011-01-18 20:06:42,423::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19626::DEBUG::2011-01-18 20:06:42,423::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0113e6ec-96c4-43ec-9c11-c47f9a6714cd releasing Thread-19626::DEBUG::2011-01-18 20:06:42,423::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19626::DEBUG::2011-01-18 20:06:42,423::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19626::DEBUG::2011-01-18 20:06:42,424::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19626::DEBUG::2011-01-18 20:06:42,424::resource::503::irs::Owner 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19626::DEBUG::2011-01-18 20:06:42,424::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19626::DEBUG::2011-01-18 20:06:42,424::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19626::DEBUG::2011-01-18 20:06:42,425::task::577::irs::Task 0113e6ec-96c4-43ec-9c11-c47f9a6714cd: ref 0 aborting False Thread-19626::INFO::2011-01-18 20:06:42,425::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:06:42,921::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:43,452::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.499961 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:06:44,536::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:06:44,537::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:06:44,541::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:06:44,542::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:06:44,546::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:06:44,547::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:06:44,549::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:06:44,550::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:06:44,556::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:06:44,557::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:06:44,577::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:06:44,585::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:06:44,587::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:06:44,592::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:06:44,598::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:45,466::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:46,008::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.510303 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:48,021::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:48,559::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506227 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:50,573::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19631::INFO::2011-01-18 20:06:50,809::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19631::DEBUG::2011-01-18 20:06:50,809::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: moving from state init -> state preparing Thread-19631::DEBUG::2011-01-18 20:06:50,810::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0e5c696a-2c8e-4dce-931f-997a30af79bf acquire shared (120000) Thread-19631::DEBUG::2011-01-18 20:06:50,810::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19631::DEBUG::2011-01-18 20:06:50,810::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0e5c696a-2c8e-4dce-931f-997a30af79bf' Thread-19631::DEBUG::2011-01-18 20:06:50,811::resource::524::irs::Owner 0e5c696a-2c8e-4dce-931f-997a30af79bf: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19631::DEBUG::2011-01-18 20:06:50,811::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19631::DEBUG::2011-01-18 20:06:50,812::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: ref 1 aborting False Thread-19631::DEBUG::2011-01-18 20:06:50,812::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0472338199615', 'lastCheck': 1295374004.5961239, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0454130172729', 'lastCheck': 1295374004.5912809, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0500459671021', 'lastCheck': 1295374004.590924, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477750301361', 'lastCheck': 1295374004.603658, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0460131168365', 'lastCheck': 1295374004.5828531, 'valid': True, 'code': 0}} Thread-19631::DEBUG::2011-01-18 20:06:50,813::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: moving from state preparing -> state finished Thread-19631::DEBUG::2011-01-18 20:06:50,813::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19631::DEBUG::2011-01-18 20:06:50,813::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0e5c696a-2c8e-4dce-931f-997a30af79bf releasing Thread-19631::DEBUG::2011-01-18 20:06:50,814::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19631::DEBUG::2011-01-18 20:06:50,814::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19631::DEBUG::2011-01-18 20:06:50,814::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19631::DEBUG::2011-01-18 20:06:50,815::resource::503::irs::Owner 0e5c696a-2c8e-4dce-931f-997a30af79bf: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19631::DEBUG::2011-01-18 20:06:50,815::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19631::DEBUG::2011-01-18 20:06:50,815::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19631::DEBUG::2011-01-18 20:06:50,816::task::577::irs::Task 0e5c696a-2c8e-4dce-931f-997a30af79bf: ref 0 aborting False Thread-19631::INFO::2011-01-18 20:06:50,816::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0472338199615', 'lastCheck': 1295374004.5961239, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0500459671021', 'lastCheck': 1295374004.590924, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0460131168365', 'lastCheck': 1295374004.5828531, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0477750301361', 'lastCheck': 1295374004.603658, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0454130172729', 'lastCheck': 1295374004.5912809, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:06:51,110::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.505645 seconds, 2.0 MB/s\n'; = 0 Thread-19633::INFO::2011-01-18 20:06:52,479::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19633::DEBUG::2011-01-18 20:06:52,479::task::577::irs::Task 2b3c280e-30e2-4476-83d3-f6dff6827b1f: moving from state init -> state preparing Thread-19633::DEBUG::2011-01-18 20:06:52,480::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19633::DEBUG::2011-01-18 20:06:52,512::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s\n'; = 0 Thread-19633::DEBUG::2011-01-18 20:06:52,512::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s'], size: 2048 Thread-19633::DEBUG::2011-01-18 20:06:52,512::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19633::DEBUG::2011-01-18 20:06:52,513::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19633::DEBUG::2011-01-18 20:06:52,514::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19633::DEBUG::2011-01-18 20:06:52,514::task::577::irs::Task 2b3c280e-30e2-4476-83d3-f6dff6827b1f: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19633::DEBUG::2011-01-18 20:06:52,514::task::577::irs::Task 2b3c280e-30e2-4476-83d3-f6dff6827b1f: moving from state preparing -> state finished Thread-19633::DEBUG::2011-01-18 20:06:52,514::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19633::DEBUG::2011-01-18 20:06:52,515::task::577::irs::Task 2b3c280e-30e2-4476-83d3-f6dff6827b1f: ref 0 aborting False Thread-19633::INFO::2011-01-18 20:06:52,515::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19634::INFO::2011-01-18 20:06:52,524::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19634::DEBUG::2011-01-18 20:06:52,524::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: moving from state init -> state preparing Thread-19634::DEBUG::2011-01-18 20:06:52,524::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 767c5546-b3a3-4582-9d8f-c873b61b9d54 acquire shared (120000) Thread-19634::DEBUG::2011-01-18 20:06:52,525::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19634::DEBUG::2011-01-18 20:06:52,525::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '767c5546-b3a3-4582-9d8f-c873b61b9d54' Thread-19634::DEBUG::2011-01-18 20:06:52,525::resource::524::irs::Owner 767c5546-b3a3-4582-9d8f-c873b61b9d54: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19634::DEBUG::2011-01-18 20:06:52,526::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19634::DEBUG::2011-01-18 20:06:52,526::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: ref 1 aborting False Thread-19634::INFO::2011-01-18 20:06:52,526::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19634::DEBUG::2011-01-18 20:06:52,527::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19634::DEBUG::2011-01-18 20:06:52,527::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: moving from state preparing -> state finished Thread-19634::DEBUG::2011-01-18 20:06:52,528::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19634::DEBUG::2011-01-18 20:06:52,528::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 767c5546-b3a3-4582-9d8f-c873b61b9d54 releasing Thread-19634::DEBUG::2011-01-18 20:06:52,528::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19634::DEBUG::2011-01-18 20:06:52,528::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19634::DEBUG::2011-01-18 20:06:52,529::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19634::DEBUG::2011-01-18 20:06:52,529::resource::503::irs::Owner 767c5546-b3a3-4582-9d8f-c873b61b9d54: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19634::DEBUG::2011-01-18 20:06:52,529::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19634::DEBUG::2011-01-18 20:06:52,530::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19634::DEBUG::2011-01-18 20:06:52,530::task::577::irs::Task 767c5546-b3a3-4582-9d8f-c873b61b9d54: ref 0 aborting False Thread-19634::INFO::2011-01-18 20:06:52,530::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:06:53,124::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:53,656::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500165 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:06:54,582::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:06:54,583::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:06:54,591::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 20:06:54,591::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 20:06:54,592::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:06:54,593::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:06:54,597::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:06:54,598::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:06:54,603::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:06:54,604::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:06:54,627::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:06:54,637::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:06:54,638::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:06:54,639::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:06:54,647::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:55,669::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:56,215::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514935 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:06:58,228::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:06:58,760::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.501045 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:00,774::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19639::INFO::2011-01-18 20:07:00,975::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19639::DEBUG::2011-01-18 20:07:00,976::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: moving from state init -> state preparing Thread-19639::DEBUG::2011-01-18 20:07:00,977::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2ce67021-640f-487f-b0bb-fee06734b45d acquire shared (120000) Thread-19639::DEBUG::2011-01-18 20:07:00,977::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19639::DEBUG::2011-01-18 20:07:00,977::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2ce67021-640f-487f-b0bb-fee06734b45d' Thread-19639::DEBUG::2011-01-18 20:07:00,978::resource::524::irs::Owner 2ce67021-640f-487f-b0bb-fee06734b45d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19639::DEBUG::2011-01-18 20:07:00,978::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19639::DEBUG::2011-01-18 20:07:00,978::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: ref 1 aborting False Thread-19639::DEBUG::2011-01-18 20:07:00,979::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0466299057007', 'lastCheck': 1295374014.643585, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0521149635315', 'lastCheck': 1295374014.6436911, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0518360137939', 'lastCheck': 1295374014.6427021, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0489029884338', 'lastCheck': 1295374014.6517839, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0505859851837', 'lastCheck': 1295374014.6334269, 'valid': True, 'code': 0}} Thread-19639::DEBUG::2011-01-18 20:07:00,979::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: moving from state preparing -> state finished Thread-19639::DEBUG::2011-01-18 20:07:00,979::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19639::DEBUG::2011-01-18 20:07:00,980::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2ce67021-640f-487f-b0bb-fee06734b45d releasing Thread-19639::DEBUG::2011-01-18 20:07:00,980::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19639::DEBUG::2011-01-18 20:07:00,980::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19639::DEBUG::2011-01-18 20:07:00,981::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19639::DEBUG::2011-01-18 20:07:00,981::resource::503::irs::Owner 2ce67021-640f-487f-b0bb-fee06734b45d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19639::DEBUG::2011-01-18 20:07:00,981::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19639::DEBUG::2011-01-18 20:07:00,982::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19639::DEBUG::2011-01-18 20:07:00,982::task::577::irs::Task 2ce67021-640f-487f-b0bb-fee06734b45d: ref 0 aborting False Thread-19639::INFO::2011-01-18 20:07:00,983::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0466299057007', 'lastCheck': 1295374014.643585, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0518360137939', 'lastCheck': 1295374014.6427021, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0505859851837', 'lastCheck': 1295374014.6334269, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0489029884338', 'lastCheck': 1295374014.6517839, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0521149635315', 'lastCheck': 1295374014.6436911, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:07:01,308::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.50194 seconds, 2.0 MB/s\n'; = 0 Thread-19641::INFO::2011-01-18 20:07:02,584::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19641::DEBUG::2011-01-18 20:07:02,584::task::577::irs::Task d5c50193-277d-46b6-a3a6-f7bc82982e33: moving from state init -> state preparing Thread-19641::DEBUG::2011-01-18 20:07:02,585::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19641::DEBUG::2011-01-18 20:07:02,616::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s\n'; = 0 Thread-19641::DEBUG::2011-01-18 20:07:02,617::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00045 seconds, 4.6 MB/s'], size: 2048 Thread-19641::DEBUG::2011-01-18 20:07:02,617::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19641::DEBUG::2011-01-18 20:07:02,618::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19641::DEBUG::2011-01-18 20:07:02,618::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19641::DEBUG::2011-01-18 20:07:02,619::task::577::irs::Task d5c50193-277d-46b6-a3a6-f7bc82982e33: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19641::DEBUG::2011-01-18 20:07:02,619::task::577::irs::Task d5c50193-277d-46b6-a3a6-f7bc82982e33: moving from state preparing -> state finished Thread-19641::DEBUG::2011-01-18 20:07:02,619::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19641::DEBUG::2011-01-18 20:07:02,619::task::577::irs::Task d5c50193-277d-46b6-a3a6-f7bc82982e33: ref 0 aborting False Thread-19641::INFO::2011-01-18 20:07:02,620::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19642::INFO::2011-01-18 20:07:02,628::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19642::DEBUG::2011-01-18 20:07:02,628::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: moving from state init -> state preparing Thread-19642::DEBUG::2011-01-18 20:07:02,629::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3f109149-2708-466b-abbf-0ed96169d748 acquire shared (120000) Thread-19642::DEBUG::2011-01-18 20:07:02,629::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19642::DEBUG::2011-01-18 20:07:02,629::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '3f109149-2708-466b-abbf-0ed96169d748' Thread-19642::DEBUG::2011-01-18 20:07:02,630::resource::524::irs::Owner 3f109149-2708-466b-abbf-0ed96169d748: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19642::DEBUG::2011-01-18 20:07:02,630::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19642::DEBUG::2011-01-18 20:07:02,630::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: ref 1 aborting False Thread-19642::INFO::2011-01-18 20:07:02,631::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19642::DEBUG::2011-01-18 20:07:02,631::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19642::DEBUG::2011-01-18 20:07:02,632::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: moving from state preparing -> state finished Thread-19642::DEBUG::2011-01-18 20:07:02,632::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19642::DEBUG::2011-01-18 20:07:02,632::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3f109149-2708-466b-abbf-0ed96169d748 releasing Thread-19642::DEBUG::2011-01-18 20:07:02,633::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19642::DEBUG::2011-01-18 20:07:02,633::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19642::DEBUG::2011-01-18 20:07:02,633::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19642::DEBUG::2011-01-18 20:07:02,633::resource::503::irs::Owner 3f109149-2708-466b-abbf-0ed96169d748: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19642::DEBUG::2011-01-18 20:07:02,634::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19642::DEBUG::2011-01-18 20:07:02,634::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19642::DEBUG::2011-01-18 20:07:02,634::task::577::irs::Task 3f109149-2708-466b-abbf-0ed96169d748: ref 0 aborting False Thread-19642::INFO::2011-01-18 20:07:02,635::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:07:03,322::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:03,855::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500695 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:07:04,632::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:07:04,633::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:07:04,642::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 20:07:04,643::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::INFO::2011-01-18 20:07:04,643::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::DEBUG::2011-01-18 20:07:04,643::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:07:04,644::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:07:04,645::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:07:04,651::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:07:04,653::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:07:04,673::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:07:04,685::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:07:04,686::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:07:04,693::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:07:04,694::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:05,868::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:06,411::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512097 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:08,425::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:08,965::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.508686 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:10,978::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19647::INFO::2011-01-18 20:07:11,141::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19647::DEBUG::2011-01-18 20:07:11,142::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: moving from state init -> state preparing Thread-19647::DEBUG::2011-01-18 20:07:11,142::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7883d926-214b-4d5e-ab4f-8f4edd92cfe9 acquire shared (120000) Thread-19647::DEBUG::2011-01-18 20:07:11,143::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19647::DEBUG::2011-01-18 20:07:11,143::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '7883d926-214b-4d5e-ab4f-8f4edd92cfe9' Thread-19647::DEBUG::2011-01-18 20:07:11,143::resource::524::irs::Owner 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19647::DEBUG::2011-01-18 20:07:11,143::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19647::DEBUG::2011-01-18 20:07:11,144::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: ref 1 aborting False Thread-19647::DEBUG::2011-01-18 20:07:11,144::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0535640716553', 'lastCheck': 1295374024.6967981, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0482120513916', 'lastCheck': 1295374024.691113, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0493748188019', 'lastCheck': 1295374024.6912799, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487959384918', 'lastCheck': 1295374024.699842, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455420017242', 'lastCheck': 1295374024.678395, 'valid': True, 'code': 0}} Thread-19647::DEBUG::2011-01-18 20:07:11,145::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: moving from state preparing -> state finished Thread-19647::DEBUG::2011-01-18 20:07:11,145::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19647::DEBUG::2011-01-18 20:07:11,145::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 7883d926-214b-4d5e-ab4f-8f4edd92cfe9 releasing Thread-19647::DEBUG::2011-01-18 20:07:11,146::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19647::DEBUG::2011-01-18 20:07:11,146::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19647::DEBUG::2011-01-18 20:07:11,146::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19647::DEBUG::2011-01-18 20:07:11,147::resource::503::irs::Owner 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19647::DEBUG::2011-01-18 20:07:11,147::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19647::DEBUG::2011-01-18 20:07:11,147::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19647::DEBUG::2011-01-18 20:07:11,148::task::577::irs::Task 7883d926-214b-4d5e-ab4f-8f4edd92cfe9: ref 0 aborting False Thread-19647::INFO::2011-01-18 20:07:11,148::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0535640716553', 'lastCheck': 1295374024.6967981, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0493748188019', 'lastCheck': 1295374024.6912799, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0455420017242', 'lastCheck': 1295374024.678395, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0487959384918', 'lastCheck': 1295374024.699842, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0482120513916', 'lastCheck': 1295374024.691113, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:07:11,526::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.516179 seconds, 2.0 MB/s\n'; = 0 Thread-19649::INFO::2011-01-18 20:07:12,687::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19649::DEBUG::2011-01-18 20:07:12,687::task::577::irs::Task 98256d67-59ed-4183-8440-9fa1f93400d4: moving from state init -> state preparing Thread-19649::DEBUG::2011-01-18 20:07:12,687::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19649::DEBUG::2011-01-18 20:07:12,719::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000451 seconds, 4.5 MB/s\n'; = 0 Thread-19649::DEBUG::2011-01-18 20:07:12,719::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000451 seconds, 4.5 MB/s'], size: 2048 Thread-19649::DEBUG::2011-01-18 20:07:12,720::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19649::DEBUG::2011-01-18 20:07:12,720::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19649::DEBUG::2011-01-18 20:07:12,721::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19649::DEBUG::2011-01-18 20:07:12,721::task::577::irs::Task 98256d67-59ed-4183-8440-9fa1f93400d4: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19649::DEBUG::2011-01-18 20:07:12,722::task::577::irs::Task 98256d67-59ed-4183-8440-9fa1f93400d4: moving from state preparing -> state finished Thread-19649::DEBUG::2011-01-18 20:07:12,722::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19649::DEBUG::2011-01-18 20:07:12,722::task::577::irs::Task 98256d67-59ed-4183-8440-9fa1f93400d4: ref 0 aborting False Thread-19649::INFO::2011-01-18 20:07:12,722::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19650::INFO::2011-01-18 20:07:12,730::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19650::DEBUG::2011-01-18 20:07:12,731::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: moving from state init -> state preparing Thread-19650::DEBUG::2011-01-18 20:07:12,731::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 80d6000e-2c3e-4585-8558-38a4c704867d acquire shared (120000) Thread-19650::DEBUG::2011-01-18 20:07:12,731::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19650::DEBUG::2011-01-18 20:07:12,731::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '80d6000e-2c3e-4585-8558-38a4c704867d' Thread-19650::DEBUG::2011-01-18 20:07:12,732::resource::524::irs::Owner 80d6000e-2c3e-4585-8558-38a4c704867d: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19650::DEBUG::2011-01-18 20:07:12,732::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19650::DEBUG::2011-01-18 20:07:12,732::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: ref 1 aborting False Thread-19650::INFO::2011-01-18 20:07:12,733::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19650::DEBUG::2011-01-18 20:07:12,733::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19650::DEBUG::2011-01-18 20:07:12,734::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: moving from state preparing -> state finished Thread-19650::DEBUG::2011-01-18 20:07:12,734::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19650::DEBUG::2011-01-18 20:07:12,734::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 80d6000e-2c3e-4585-8558-38a4c704867d releasing Thread-19650::DEBUG::2011-01-18 20:07:12,735::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19650::DEBUG::2011-01-18 20:07:12,735::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19650::DEBUG::2011-01-18 20:07:12,735::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19650::DEBUG::2011-01-18 20:07:12,735::resource::503::irs::Owner 80d6000e-2c3e-4585-8558-38a4c704867d: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19650::DEBUG::2011-01-18 20:07:12,736::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19650::DEBUG::2011-01-18 20:07:12,736::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19650::DEBUG::2011-01-18 20:07:12,736::task::577::irs::Task 80d6000e-2c3e-4585-8558-38a4c704867d: ref 0 aborting False Thread-19650::INFO::2011-01-18 20:07:12,737::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:07:13,540::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:14,080::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.508195 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:07:14,677::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:07:14,678::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:07:14,691::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 20:07:14,691::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 20:07:14,693::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:07:14,693::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:07:14,696::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:07:14,699::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:07:14,701::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:07:14,703::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:07:14,722::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:07:14,733::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:07:14,735::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:07:14,741::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:07:14,748::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:16,092::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:16,638::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.514942 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:18,650::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:19,183::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.500468 seconds, 2.0 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:21,194::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19655::INFO::2011-01-18 20:07:21,312::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19655::DEBUG::2011-01-18 20:07:21,312::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: moving from state init -> state preparing Thread-19655::DEBUG::2011-01-18 20:07:21,313::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 10eef32b-de6f-4a72-bb93-73853aa8efb0 acquire shared (120000) Thread-19655::DEBUG::2011-01-18 20:07:21,313::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19655::DEBUG::2011-01-18 20:07:21,314::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '10eef32b-de6f-4a72-bb93-73853aa8efb0' Thread-19655::DEBUG::2011-01-18 20:07:21,314::resource::524::irs::Owner 10eef32b-de6f-4a72-bb93-73853aa8efb0: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19655::DEBUG::2011-01-18 20:07:21,314::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19655::DEBUG::2011-01-18 20:07:21,315::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: ref 1 aborting False Thread-19655::DEBUG::2011-01-18 20:07:21,315::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0484991073608', 'lastCheck': 1295374034.744411, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0493400096893', 'lastCheck': 1295374034.7409251, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049241065979', 'lastCheck': 1295374034.7401111, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0527238845825', 'lastCheck': 1295374034.753778, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0508670806885', 'lastCheck': 1295374034.728709, 'valid': True, 'code': 0}} Thread-19655::DEBUG::2011-01-18 20:07:21,316::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: moving from state preparing -> state finished Thread-19655::DEBUG::2011-01-18 20:07:21,316::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19655::DEBUG::2011-01-18 20:07:21,316::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 10eef32b-de6f-4a72-bb93-73853aa8efb0 releasing Thread-19655::DEBUG::2011-01-18 20:07:21,317::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19655::DEBUG::2011-01-18 20:07:21,317::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19655::DEBUG::2011-01-18 20:07:21,317::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19655::DEBUG::2011-01-18 20:07:21,318::resource::503::irs::Owner 10eef32b-de6f-4a72-bb93-73853aa8efb0: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19655::DEBUG::2011-01-18 20:07:21,318::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19655::DEBUG::2011-01-18 20:07:21,319::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19655::DEBUG::2011-01-18 20:07:21,319::task::577::irs::Task 10eef32b-de6f-4a72-bb93-73853aa8efb0: ref 0 aborting False Thread-19655::INFO::2011-01-18 20:07:21,319::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0484991073608', 'lastCheck': 1295374034.744411, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.049241065979', 'lastCheck': 1295374034.7401111, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0508670806885', 'lastCheck': 1295374034.728709, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0527238845825', 'lastCheck': 1295374034.753778, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0493400096893', 'lastCheck': 1295374034.7409251, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:07:21,732::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.506477 seconds, 2.0 MB/s\n'; = 0 Thread-19657::INFO::2011-01-18 20:07:22,789::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19657::DEBUG::2011-01-18 20:07:22,789::task::577::irs::Task b7797f47-5abb-4829-bd75-af49c0827dff: moving from state init -> state preparing Thread-19657::DEBUG::2011-01-18 20:07:22,789::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19657::DEBUG::2011-01-18 20:07:22,821::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00051 seconds, 4.0 MB/s\n'; = 0 Thread-19657::DEBUG::2011-01-18 20:07:22,822::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00051 seconds, 4.0 MB/s'], size: 2048 Thread-19657::DEBUG::2011-01-18 20:07:22,822::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19657::DEBUG::2011-01-18 20:07:22,823::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19657::DEBUG::2011-01-18 20:07:22,823::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19657::DEBUG::2011-01-18 20:07:22,824::task::577::irs::Task b7797f47-5abb-4829-bd75-af49c0827dff: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19657::DEBUG::2011-01-18 20:07:22,824::task::577::irs::Task b7797f47-5abb-4829-bd75-af49c0827dff: moving from state preparing -> state finished Thread-19657::DEBUG::2011-01-18 20:07:22,824::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19657::DEBUG::2011-01-18 20:07:22,825::task::577::irs::Task b7797f47-5abb-4829-bd75-af49c0827dff: ref 0 aborting False Thread-19657::INFO::2011-01-18 20:07:22,825::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19658::INFO::2011-01-18 20:07:22,833::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19658::DEBUG::2011-01-18 20:07:22,834::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: moving from state init -> state preparing Thread-19658::DEBUG::2011-01-18 20:07:22,834::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 34f5637f-34de-40ed-b849-c52357730dcc acquire shared (120000) Thread-19658::DEBUG::2011-01-18 20:07:22,834::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19658::DEBUG::2011-01-18 20:07:22,835::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '34f5637f-34de-40ed-b849-c52357730dcc' Thread-19658::DEBUG::2011-01-18 20:07:22,835::resource::524::irs::Owner 34f5637f-34de-40ed-b849-c52357730dcc: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19658::DEBUG::2011-01-18 20:07:22,835::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19658::DEBUG::2011-01-18 20:07:22,835::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: ref 1 aborting False Thread-19658::INFO::2011-01-18 20:07:22,836::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19658::DEBUG::2011-01-18 20:07:22,836::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19658::DEBUG::2011-01-18 20:07:22,837::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: moving from state preparing -> state finished Thread-19658::DEBUG::2011-01-18 20:07:22,837::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19658::DEBUG::2011-01-18 20:07:22,837::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 34f5637f-34de-40ed-b849-c52357730dcc releasing Thread-19658::DEBUG::2011-01-18 20:07:22,838::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19658::DEBUG::2011-01-18 20:07:22,838::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19658::DEBUG::2011-01-18 20:07:22,838::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19658::DEBUG::2011-01-18 20:07:22,838::resource::503::irs::Owner 34f5637f-34de-40ed-b849-c52357730dcc: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19658::DEBUG::2011-01-18 20:07:22,839::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19658::DEBUG::2011-01-18 20:07:22,839::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19658::DEBUG::2011-01-18 20:07:22,839::task::577::irs::Task 34f5637f-34de-40ed-b849-c52357730dcc: ref 0 aborting False Thread-19658::INFO::2011-01-18 20:07:22,840::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:07:23,744::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:24,287::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.512106 seconds, 2.0 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:07:24,727::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:07:24,728::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:07:24,744::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 20:07:24,744::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18493::INFO::2011-01-18 20:07:24,744::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18495::DEBUG::2011-01-18 20:07:24,745::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:07:24,746::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:07:24,747::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:07:24,753::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:07:24,755::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:07:24,768::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:07:24,787::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:07:24,788::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:07:24,796::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:07:24,799::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:26,300::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:26,903::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.571664 seconds, 1.8 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:28,917::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:29,480::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.531605 seconds, 1.9 MB/s\n'; = 0 Thread-19663::INFO::2011-01-18 20:07:31,478::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19663::DEBUG::2011-01-18 20:07:31,479::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: moving from state init -> state preparing Thread-19663::DEBUG::2011-01-18 20:07:31,479::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ab60951a-6a91-47e9-982d-0633ec7502c5 acquire shared (120000) Thread-19663::DEBUG::2011-01-18 20:07:31,479::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19663::DEBUG::2011-01-18 20:07:31,480::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ab60951a-6a91-47e9-982d-0633ec7502c5' Thread-19663::DEBUG::2011-01-18 20:07:31,480::resource::524::irs::Owner ab60951a-6a91-47e9-982d-0633ec7502c5: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19663::DEBUG::2011-01-18 20:07:31,480::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19663::DEBUG::2011-01-18 20:07:31,480::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: ref 1 aborting False Thread-19663::DEBUG::2011-01-18 20:07:31,481::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0553138256073', 'lastCheck': 1295374044.8002169, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0536048412323', 'lastCheck': 1295374044.7982349, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0541949272156', 'lastCheck': 1295374044.7980659, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0511891841888', 'lastCheck': 1295374044.8042221, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0466778278351', 'lastCheck': 1295374044.7745309, 'valid': True, 'code': 0}} Thread-19663::DEBUG::2011-01-18 20:07:31,481::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: moving from state preparing -> state finished Thread-19663::DEBUG::2011-01-18 20:07:31,481::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19663::DEBUG::2011-01-18 20:07:31,482::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ab60951a-6a91-47e9-982d-0633ec7502c5 releasing Thread-19663::DEBUG::2011-01-18 20:07:31,482::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19663::DEBUG::2011-01-18 20:07:31,482::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19663::DEBUG::2011-01-18 20:07:31,483::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19663::DEBUG::2011-01-18 20:07:31,483::resource::503::irs::Owner ab60951a-6a91-47e9-982d-0633ec7502c5: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19663::DEBUG::2011-01-18 20:07:31,483::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19663::DEBUG::2011-01-18 20:07:31,483::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19663::DEBUG::2011-01-18 20:07:31,484::task::577::irs::Task ab60951a-6a91-47e9-982d-0633ec7502c5: ref 0 aborting False Thread-19663::INFO::2011-01-18 20:07:31,484::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0553138256073', 'lastCheck': 1295374044.8002169, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0541949272156', 'lastCheck': 1295374044.7980659, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0466778278351', 'lastCheck': 1295374044.7745309, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0511891841888', 'lastCheck': 1295374044.8042221, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0536048412323', 'lastCheck': 1295374044.7982349, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:07:31,493::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:32,175::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.647887 seconds, 1.6 MB/s\n'; = 0 Thread-19665::INFO::2011-01-18 20:07:32,895::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19665::DEBUG::2011-01-18 20:07:32,895::task::577::irs::Task ffd0e3a1-5108-42ab-a3a9-e3e24624995c: moving from state init -> state preparing Thread-19665::DEBUG::2011-01-18 20:07:32,896::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19665::DEBUG::2011-01-18 20:07:32,927::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000471 seconds, 4.3 MB/s\n'; = 0 Thread-19665::DEBUG::2011-01-18 20:07:32,927::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000471 seconds, 4.3 MB/s'], size: 2048 Thread-19665::DEBUG::2011-01-18 20:07:32,928::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19665::DEBUG::2011-01-18 20:07:32,928::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19665::DEBUG::2011-01-18 20:07:32,929::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19665::DEBUG::2011-01-18 20:07:32,929::task::577::irs::Task ffd0e3a1-5108-42ab-a3a9-e3e24624995c: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19665::DEBUG::2011-01-18 20:07:32,929::task::577::irs::Task ffd0e3a1-5108-42ab-a3a9-e3e24624995c: moving from state preparing -> state finished Thread-19665::DEBUG::2011-01-18 20:07:32,930::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19665::DEBUG::2011-01-18 20:07:32,930::task::577::irs::Task ffd0e3a1-5108-42ab-a3a9-e3e24624995c: ref 0 aborting False Thread-19665::INFO::2011-01-18 20:07:32,930::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19666::INFO::2011-01-18 20:07:32,939::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19666::DEBUG::2011-01-18 20:07:32,940::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: moving from state init -> state preparing Thread-19666::DEBUG::2011-01-18 20:07:32,940::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8a42593-9cc9-41c3-a150-14303b838e9e acquire shared (120000) Thread-19666::DEBUG::2011-01-18 20:07:32,940::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19666::DEBUG::2011-01-18 20:07:32,941::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f8a42593-9cc9-41c3-a150-14303b838e9e' Thread-19666::DEBUG::2011-01-18 20:07:32,941::resource::524::irs::Owner f8a42593-9cc9-41c3-a150-14303b838e9e: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19666::DEBUG::2011-01-18 20:07:32,941::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19666::DEBUG::2011-01-18 20:07:32,942::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: ref 1 aborting False Thread-19666::INFO::2011-01-18 20:07:32,942::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19666::DEBUG::2011-01-18 20:07:32,943::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19666::DEBUG::2011-01-18 20:07:32,943::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: moving from state preparing -> state finished Thread-19666::DEBUG::2011-01-18 20:07:32,943::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19666::DEBUG::2011-01-18 20:07:32,944::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f8a42593-9cc9-41c3-a150-14303b838e9e releasing Thread-19666::DEBUG::2011-01-18 20:07:32,944::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19666::DEBUG::2011-01-18 20:07:32,944::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19666::DEBUG::2011-01-18 20:07:32,944::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19666::DEBUG::2011-01-18 20:07:32,945::resource::503::irs::Owner f8a42593-9cc9-41c3-a150-14303b838e9e: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19666::DEBUG::2011-01-18 20:07:32,945::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19666::DEBUG::2011-01-18 20:07:32,945::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19666::DEBUG::2011-01-18 20:07:32,946::task::577::irs::Task f8a42593-9cc9-41c3-a150-14303b838e9e: ref 0 aborting False Thread-19666::INFO::2011-01-18 20:07:32,946::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:07:34,190::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:34,765::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.54276 seconds, 1.9 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:07:34,778::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:07:34,778::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:07:34,798::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18494::INFO::2011-01-18 20:07:34,798::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18495::DEBUG::2011-01-18 20:07:34,799::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:07:34,800::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18494::DEBUG::2011-01-18 20:07:34,800::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::DEBUG::2011-01-18 20:07:34,801::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:07:34,804::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:07:34,808::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:07:34,819::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:07:34,842::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:07:34,845::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:07:34,852::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:07:34,853::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:36,778::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:37,463::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.652972 seconds, 1.6 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:39,474::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:40,236::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.730627 seconds, 1.4 MB/s\n'; = 0 Thread-19671::INFO::2011-01-18 20:07:41,661::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19671::DEBUG::2011-01-18 20:07:41,661::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: moving from state init -> state preparing Thread-19671::DEBUG::2011-01-18 20:07:41,661::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3bdb9063-362c-400e-8200-9dfbd3481c90 acquire shared (120000) Thread-19671::DEBUG::2011-01-18 20:07:41,662::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19671::DEBUG::2011-01-18 20:07:41,662::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '3bdb9063-362c-400e-8200-9dfbd3481c90' Thread-19671::DEBUG::2011-01-18 20:07:41,662::resource::524::irs::Owner 3bdb9063-362c-400e-8200-9dfbd3481c90: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19671::DEBUG::2011-01-18 20:07:41,662::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19671::DEBUG::2011-01-18 20:07:41,663::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: ref 1 aborting False Thread-19671::DEBUG::2011-01-18 20:07:41,663::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0567359924316', 'lastCheck': 1295374054.856679, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0499188899994', 'lastCheck': 1295374054.8485229, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0490860939026', 'lastCheck': 1295374054.8469441, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0528399944305', 'lastCheck': 1295374054.8568311, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0475699901581', 'lastCheck': 1295374054.825557, 'valid': True, 'code': 0}} Thread-19671::DEBUG::2011-01-18 20:07:41,663::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: moving from state preparing -> state finished Thread-19671::DEBUG::2011-01-18 20:07:41,664::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19671::DEBUG::2011-01-18 20:07:41,664::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 3bdb9063-362c-400e-8200-9dfbd3481c90 releasing Thread-19671::DEBUG::2011-01-18 20:07:41,664::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19671::DEBUG::2011-01-18 20:07:41,665::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19671::DEBUG::2011-01-18 20:07:41,665::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19671::DEBUG::2011-01-18 20:07:41,665::resource::503::irs::Owner 3bdb9063-362c-400e-8200-9dfbd3481c90: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19671::DEBUG::2011-01-18 20:07:41,665::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19671::DEBUG::2011-01-18 20:07:41,666::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19671::DEBUG::2011-01-18 20:07:41,666::task::577::irs::Task 3bdb9063-362c-400e-8200-9dfbd3481c90: ref 0 aborting False Thread-19671::INFO::2011-01-18 20:07:41,666::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0567359924316', 'lastCheck': 1295374054.856679, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0490860939026', 'lastCheck': 1295374054.8469441, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0475699901581', 'lastCheck': 1295374054.825557, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0528399944305', 'lastCheck': 1295374054.8568311, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0499188899994', 'lastCheck': 1295374054.8485229, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:07:42,249::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:42,865::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.583251 seconds, 1.8 MB/s\n'; = 0 Thread-19673::INFO::2011-01-18 20:07:42,999::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19673::DEBUG::2011-01-18 20:07:42,999::task::577::irs::Task cf8a4d50-e936-4a15-9123-0dec00e3c8fd: moving from state init -> state preparing Thread-19673::DEBUG::2011-01-18 20:07:43,000::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19673::DEBUG::2011-01-18 20:07:43,031::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000453 seconds, 4.5 MB/s\n'; = 0 Thread-19673::DEBUG::2011-01-18 20:07:43,032::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000453 seconds, 4.5 MB/s'], size: 2048 Thread-19673::DEBUG::2011-01-18 20:07:43,032::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19673::DEBUG::2011-01-18 20:07:43,032::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19673::DEBUG::2011-01-18 20:07:43,033::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19673::DEBUG::2011-01-18 20:07:43,033::task::577::irs::Task cf8a4d50-e936-4a15-9123-0dec00e3c8fd: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19673::DEBUG::2011-01-18 20:07:43,034::task::577::irs::Task cf8a4d50-e936-4a15-9123-0dec00e3c8fd: moving from state preparing -> state finished Thread-19673::DEBUG::2011-01-18 20:07:43,034::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19673::DEBUG::2011-01-18 20:07:43,034::task::577::irs::Task cf8a4d50-e936-4a15-9123-0dec00e3c8fd: ref 0 aborting False Thread-19673::INFO::2011-01-18 20:07:43,034::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19674::INFO::2011-01-18 20:07:43,042::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19674::DEBUG::2011-01-18 20:07:43,042::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: moving from state init -> state preparing Thread-19674::DEBUG::2011-01-18 20:07:43,043::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 846c14ef-6b25-412a-ba69-65a0639b4f15 acquire shared (120000) Thread-19674::DEBUG::2011-01-18 20:07:43,043::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19674::DEBUG::2011-01-18 20:07:43,043::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '846c14ef-6b25-412a-ba69-65a0639b4f15' Thread-19674::DEBUG::2011-01-18 20:07:43,044::resource::524::irs::Owner 846c14ef-6b25-412a-ba69-65a0639b4f15: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19674::DEBUG::2011-01-18 20:07:43,044::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19674::DEBUG::2011-01-18 20:07:43,044::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: ref 1 aborting False Thread-19674::INFO::2011-01-18 20:07:43,045::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19674::DEBUG::2011-01-18 20:07:43,045::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19674::DEBUG::2011-01-18 20:07:43,046::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: moving from state preparing -> state finished Thread-19674::DEBUG::2011-01-18 20:07:43,046::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19674::DEBUG::2011-01-18 20:07:43,046::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 846c14ef-6b25-412a-ba69-65a0639b4f15 releasing Thread-19674::DEBUG::2011-01-18 20:07:43,047::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19674::DEBUG::2011-01-18 20:07:43,047::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19674::DEBUG::2011-01-18 20:07:43,047::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19674::DEBUG::2011-01-18 20:07:43,047::resource::503::irs::Owner 846c14ef-6b25-412a-ba69-65a0639b4f15: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19674::DEBUG::2011-01-18 20:07:43,048::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19674::DEBUG::2011-01-18 20:07:43,048::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19674::DEBUG::2011-01-18 20:07:43,048::task::577::irs::Task 846c14ef-6b25-412a-ba69-65a0639b4f15: ref 0 aborting False Thread-19674::INFO::2011-01-18 20:07:43,049::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-18497::INFO::2011-01-18 20:07:44,824::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:07:44,825::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:07:44,847::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:07:44,848::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:07:44,848::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:07:44,851::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:07:44,856::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18496::INFO::2011-01-18 20:07:44,856::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18493::DEBUG::2011-01-18 20:07:44,858::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::DEBUG::2011-01-18 20:07:44,859::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:07:44,865::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:44,876::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18495::DEBUG::2011-01-18 20:07:44,888::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:07:44,890::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:07:44,900::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:07:44,900::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:45,718::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.80964 seconds, 1.3 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:47,731::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:48,441::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.678068 seconds, 1.5 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:50,453::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:51,166::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.68154 seconds, 1.5 MB/s\n'; = 0 Thread-19679::INFO::2011-01-18 20:07:51,822::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19679::DEBUG::2011-01-18 20:07:51,823::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: moving from state init -> state preparing Thread-19679::DEBUG::2011-01-18 20:07:51,823::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5d95805e-85d8-4ee3-ac19-5b57268a8d04 acquire shared (120000) Thread-19679::DEBUG::2011-01-18 20:07:51,823::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19679::DEBUG::2011-01-18 20:07:51,824::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5d95805e-85d8-4ee3-ac19-5b57268a8d04' Thread-19679::DEBUG::2011-01-18 20:07:51,824::resource::524::irs::Owner 5d95805e-85d8-4ee3-ac19-5b57268a8d04: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19679::DEBUG::2011-01-18 20:07:51,824::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19679::DEBUG::2011-01-18 20:07:51,824::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: ref 1 aborting False Thread-19679::DEBUG::2011-01-18 20:07:51,825::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0489439964294', 'lastCheck': 1295374064.904855, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0470631122589', 'lastCheck': 1295374064.8955431, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0494349002838', 'lastCheck': 1295374064.8962879, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0504829883575', 'lastCheck': 1295374064.9073529, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0483050346375', 'lastCheck': 1295374064.873184, 'valid': True, 'code': 0}} Thread-19679::DEBUG::2011-01-18 20:07:51,825::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: moving from state preparing -> state finished Thread-19679::DEBUG::2011-01-18 20:07:51,825::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19679::DEBUG::2011-01-18 20:07:51,826::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5d95805e-85d8-4ee3-ac19-5b57268a8d04 releasing Thread-19679::DEBUG::2011-01-18 20:07:51,826::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19679::DEBUG::2011-01-18 20:07:51,826::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19679::DEBUG::2011-01-18 20:07:51,827::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19679::DEBUG::2011-01-18 20:07:51,827::resource::503::irs::Owner 5d95805e-85d8-4ee3-ac19-5b57268a8d04: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19679::DEBUG::2011-01-18 20:07:51,827::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19679::DEBUG::2011-01-18 20:07:51,827::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19679::DEBUG::2011-01-18 20:07:51,828::task::577::irs::Task 5d95805e-85d8-4ee3-ac19-5b57268a8d04: ref 0 aborting False Thread-19679::INFO::2011-01-18 20:07:51,828::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0489439964294', 'lastCheck': 1295374064.904855, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0494349002838', 'lastCheck': 1295374064.8962879, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0483050346375', 'lastCheck': 1295374064.873184, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0504829883575', 'lastCheck': 1295374064.9073529, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0470631122589', 'lastCheck': 1295374064.8955431, 'valid': True, 'code': 0}} Thread-19681::INFO::2011-01-18 20:07:53,101::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19681::DEBUG::2011-01-18 20:07:53,102::task::577::irs::Task d8f59087-9ed0-43ac-8889-3d85b5622a72: moving from state init -> state preparing Thread-19681::DEBUG::2011-01-18 20:07:53,102::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19681::DEBUG::2011-01-18 20:07:53,134::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000409 seconds, 5.0 MB/s\n'; = 0 Thread-19681::DEBUG::2011-01-18 20:07:53,134::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000409 seconds, 5.0 MB/s'], size: 2048 Thread-19681::DEBUG::2011-01-18 20:07:53,134::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19681::DEBUG::2011-01-18 20:07:53,135::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19681::DEBUG::2011-01-18 20:07:53,135::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19681::DEBUG::2011-01-18 20:07:53,136::task::577::irs::Task d8f59087-9ed0-43ac-8889-3d85b5622a72: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19681::DEBUG::2011-01-18 20:07:53,136::task::577::irs::Task d8f59087-9ed0-43ac-8889-3d85b5622a72: moving from state preparing -> state finished Thread-19681::DEBUG::2011-01-18 20:07:53,136::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19681::DEBUG::2011-01-18 20:07:53,137::task::577::irs::Task d8f59087-9ed0-43ac-8889-3d85b5622a72: ref 0 aborting False Thread-19681::INFO::2011-01-18 20:07:53,137::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19682::INFO::2011-01-18 20:07:53,145::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19682::DEBUG::2011-01-18 20:07:53,145::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: moving from state init -> state preparing Thread-19682::DEBUG::2011-01-18 20:07:53,146::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea acquire shared (120000) Thread-19682::DEBUG::2011-01-18 20:07:53,146::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19682::DEBUG::2011-01-18 20:07:53,146::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '90f0a4e1-cf49-46f8-be4d-4f32e4efcfea' Thread-19682::DEBUG::2011-01-18 20:07:53,147::resource::524::irs::Owner 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19682::DEBUG::2011-01-18 20:07:53,147::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19682::DEBUG::2011-01-18 20:07:53,147::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: ref 1 aborting False Thread-19682::INFO::2011-01-18 20:07:53,148::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19682::DEBUG::2011-01-18 20:07:53,148::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19682::DEBUG::2011-01-18 20:07:53,149::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: moving from state preparing -> state finished Thread-19682::DEBUG::2011-01-18 20:07:53,149::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19682::DEBUG::2011-01-18 20:07:53,149::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea releasing Thread-19682::DEBUG::2011-01-18 20:07:53,149::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19682::DEBUG::2011-01-18 20:07:53,150::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19682::DEBUG::2011-01-18 20:07:53,150::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19682::DEBUG::2011-01-18 20:07:53,150::resource::503::irs::Owner 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19682::DEBUG::2011-01-18 20:07:53,151::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19682::DEBUG::2011-01-18 20:07:53,151::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19682::DEBUG::2011-01-18 20:07:53,151::task::577::irs::Task 90f0a4e1-cf49-46f8-be4d-4f32e4efcfea: ref 0 aborting False Thread-19682::INFO::2011-01-18 20:07:53,152::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:07:53,178::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:53,751::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.541303 seconds, 1.9 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:07:54,872::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:07:54,873::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:07:54,895::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:07:54,896::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:07:54,896::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:07:54,897::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:07:54,905::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:07:54,906::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:07:54,909::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:07:54,910::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:07:54,913::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:07:54,940::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:07:54,941::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:07:54,947::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:07:54,953::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:55,763::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:56,552::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.756931 seconds, 1.4 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:07:58,565::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:07:59,356::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.759317 seconds, 1.3 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:01,369::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19687::INFO::2011-01-18 20:08:01,988::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19687::DEBUG::2011-01-18 20:08:01,988::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: moving from state init -> state preparing Thread-19687::DEBUG::2011-01-18 20:08:01,989::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2797276a-70b1-4ff1-9cc0-14dda87b4d0b acquire shared (120000) Thread-19687::DEBUG::2011-01-18 20:08:01,989::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19687::DEBUG::2011-01-18 20:08:01,989::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '2797276a-70b1-4ff1-9cc0-14dda87b4d0b' Thread-19687::DEBUG::2011-01-18 20:08:01,990::resource::524::irs::Owner 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19687::DEBUG::2011-01-18 20:08:01,990::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19687::DEBUG::2011-01-18 20:08:01,990::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: ref 1 aborting False Thread-19687::DEBUG::2011-01-18 20:08:01,991::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464890003204', 'lastCheck': 1295374074.9513581, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0512518882751', 'lastCheck': 1295374074.9461119, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0525901317596', 'lastCheck': 1295374074.9489191, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494539737701', 'lastCheck': 1295374074.958333, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462942123413', 'lastCheck': 1295374074.9191351, 'valid': True, 'code': 0}} Thread-19687::DEBUG::2011-01-18 20:08:01,991::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: moving from state preparing -> state finished Thread-19687::DEBUG::2011-01-18 20:08:01,992::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19687::DEBUG::2011-01-18 20:08:01,992::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 2797276a-70b1-4ff1-9cc0-14dda87b4d0b releasing Thread-19687::DEBUG::2011-01-18 20:08:01,992::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19687::DEBUG::2011-01-18 20:08:01,993::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19687::DEBUG::2011-01-18 20:08:01,993::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19687::DEBUG::2011-01-18 20:08:01,993::resource::503::irs::Owner 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19687::DEBUG::2011-01-18 20:08:01,994::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19687::DEBUG::2011-01-18 20:08:01,994::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19687::DEBUG::2011-01-18 20:08:01,994::task::577::irs::Task 2797276a-70b1-4ff1-9cc0-14dda87b4d0b: ref 0 aborting False Thread-19687::INFO::2011-01-18 20:08:01,995::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0464890003204', 'lastCheck': 1295374074.9513581, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0525901317596', 'lastCheck': 1295374074.9489191, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0462942123413', 'lastCheck': 1295374074.9191351, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0494539737701', 'lastCheck': 1295374074.958333, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0512518882751', 'lastCheck': 1295374074.9461119, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:08:02,164::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.764395 seconds, 1.3 MB/s\n'; = 0 Thread-19689::INFO::2011-01-18 20:08:03,224::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19689::DEBUG::2011-01-18 20:08:03,224::task::577::irs::Task 8723a00d-c87a-40e7-b711-67ac492b21ff: moving from state init -> state preparing Thread-19689::DEBUG::2011-01-18 20:08:03,224::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19689::DEBUG::2011-01-18 20:08:03,256::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000525 seconds, 3.9 MB/s\n'; = 0 Thread-19689::DEBUG::2011-01-18 20:08:03,256::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000525 seconds, 3.9 MB/s'], size: 2048 Thread-19689::DEBUG::2011-01-18 20:08:03,257::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19689::DEBUG::2011-01-18 20:08:03,257::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19689::DEBUG::2011-01-18 20:08:03,258::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19689::DEBUG::2011-01-18 20:08:03,258::task::577::irs::Task 8723a00d-c87a-40e7-b711-67ac492b21ff: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19689::DEBUG::2011-01-18 20:08:03,258::task::577::irs::Task 8723a00d-c87a-40e7-b711-67ac492b21ff: moving from state preparing -> state finished Thread-19689::DEBUG::2011-01-18 20:08:03,259::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19689::DEBUG::2011-01-18 20:08:03,259::task::577::irs::Task 8723a00d-c87a-40e7-b711-67ac492b21ff: ref 0 aborting False Thread-19689::INFO::2011-01-18 20:08:03,259::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19690::INFO::2011-01-18 20:08:03,268::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19690::DEBUG::2011-01-18 20:08:03,269::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: moving from state init -> state preparing Thread-19690::DEBUG::2011-01-18 20:08:03,269::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ff6ac267-86fe-407d-a453-8ab3642798de acquire shared (120000) Thread-19690::DEBUG::2011-01-18 20:08:03,269::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19690::DEBUG::2011-01-18 20:08:03,269::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'ff6ac267-86fe-407d-a453-8ab3642798de' Thread-19690::DEBUG::2011-01-18 20:08:03,270::resource::524::irs::Owner ff6ac267-86fe-407d-a453-8ab3642798de: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19690::DEBUG::2011-01-18 20:08:03,270::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19690::DEBUG::2011-01-18 20:08:03,270::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: ref 1 aborting False Thread-19690::INFO::2011-01-18 20:08:03,271::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19690::DEBUG::2011-01-18 20:08:03,271::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19690::DEBUG::2011-01-18 20:08:03,272::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: moving from state preparing -> state finished Thread-19690::DEBUG::2011-01-18 20:08:03,272::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19690::DEBUG::2011-01-18 20:08:03,272::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: ff6ac267-86fe-407d-a453-8ab3642798de releasing Thread-19690::DEBUG::2011-01-18 20:08:03,273::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19690::DEBUG::2011-01-18 20:08:03,273::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19690::DEBUG::2011-01-18 20:08:03,273::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19690::DEBUG::2011-01-18 20:08:03,273::resource::503::irs::Owner ff6ac267-86fe-407d-a453-8ab3642798de: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19690::DEBUG::2011-01-18 20:08:03,274::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19690::DEBUG::2011-01-18 20:08:03,274::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19690::DEBUG::2011-01-18 20:08:03,274::task::577::irs::Task ff6ac267-86fe-407d-a453-8ab3642798de: ref 0 aborting False Thread-19690::INFO::2011-01-18 20:08:03,275::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:08:04,176::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 20:08:04,919::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:08:04,919::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:08:04,946::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:08:04,947::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:08:04,949::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:08:04,950::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:08:04,950::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:08:04,951::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18496::INFO::2011-01-18 20:08:04,958::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:08:04,959::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:08:04,963::misc::122::irs::SUCCESS: = ''; = 0 Thread-18494::DEBUG::2011-01-18 20:08:04,989::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:08:04,992::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:08:04,996::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:08:05,019::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:05,246::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 1.03703 seconds, 987 kB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:07,256::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:08:08,237::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.948306 seconds, 1.1 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:10,250::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:08:11,218::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.934635 seconds, 1.1 MB/s\n'; = 0 Thread-19695::INFO::2011-01-18 20:08:12,150::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19695::DEBUG::2011-01-18 20:08:12,151::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: moving from state init -> state preparing Thread-19695::DEBUG::2011-01-18 20:08:12,151::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd acquire shared (120000) Thread-19695::DEBUG::2011-01-18 20:08:12,151::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19695::DEBUG::2011-01-18 20:08:12,152::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '5d6036ab-4ca6-4bfd-8f25-0073ab4278dd' Thread-19695::DEBUG::2011-01-18 20:08:12,152::resource::524::irs::Owner 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19695::DEBUG::2011-01-18 20:08:12,152::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19695::DEBUG::2011-01-18 20:08:12,152::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: ref 1 aborting False Thread-19695::DEBUG::2011-01-18 20:08:12,153::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0524880886078', 'lastCheck': 1295374085.0033791, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0491809844971', 'lastCheck': 1295374084.9951849, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0524380207062', 'lastCheck': 1295374085.001395, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0674769878387', 'lastCheck': 1295374085.0253811, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0550720691681', 'lastCheck': 1295374084.9739251, 'valid': True, 'code': 0}} Thread-19695::DEBUG::2011-01-18 20:08:12,153::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: moving from state preparing -> state finished Thread-19695::DEBUG::2011-01-18 20:08:12,153::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19695::DEBUG::2011-01-18 20:08:12,154::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd releasing Thread-19695::DEBUG::2011-01-18 20:08:12,154::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19695::DEBUG::2011-01-18 20:08:12,154::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19695::DEBUG::2011-01-18 20:08:12,155::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19695::DEBUG::2011-01-18 20:08:12,155::resource::503::irs::Owner 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19695::DEBUG::2011-01-18 20:08:12,155::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19695::DEBUG::2011-01-18 20:08:12,155::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19695::DEBUG::2011-01-18 20:08:12,156::task::577::irs::Task 5d6036ab-4ca6-4bfd-8f25-0073ab4278dd: ref 0 aborting False Thread-19695::INFO::2011-01-18 20:08:12,156::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0524880886078', 'lastCheck': 1295374085.0033791, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0524380207062', 'lastCheck': 1295374085.001395, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0550720691681', 'lastCheck': 1295374084.9739251, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0674769878387', 'lastCheck': 1295374085.0253811, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0491809844971', 'lastCheck': 1295374084.9951849, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:08:13,229::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19697::INFO::2011-01-18 20:08:13,343::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19697::DEBUG::2011-01-18 20:08:13,344::task::577::irs::Task 5b670452-d43d-4aa5-a88a-fafd1071c561: moving from state init -> state preparing Thread-19697::DEBUG::2011-01-18 20:08:13,344::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19697::DEBUG::2011-01-18 20:08:13,378::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.001962 seconds, 1.0 MB/s\n'; = 0 Thread-19697::DEBUG::2011-01-18 20:08:13,379::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.001962 seconds, 1.0 MB/s'], size: 2048 Thread-19697::DEBUG::2011-01-18 20:08:13,379::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19697::DEBUG::2011-01-18 20:08:13,380::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19697::DEBUG::2011-01-18 20:08:13,380::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19697::DEBUG::2011-01-18 20:08:13,381::task::577::irs::Task 5b670452-d43d-4aa5-a88a-fafd1071c561: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19697::DEBUG::2011-01-18 20:08:13,381::task::577::irs::Task 5b670452-d43d-4aa5-a88a-fafd1071c561: moving from state preparing -> state finished Thread-19697::DEBUG::2011-01-18 20:08:13,381::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19697::DEBUG::2011-01-18 20:08:13,382::task::577::irs::Task 5b670452-d43d-4aa5-a88a-fafd1071c561: ref 0 aborting False Thread-19697::INFO::2011-01-18 20:08:13,382::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19698::INFO::2011-01-18 20:08:13,392::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19698::DEBUG::2011-01-18 20:08:13,392::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: moving from state init -> state preparing Thread-19698::DEBUG::2011-01-18 20:08:13,392::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e4d10f5b-28ff-4bab-9273-c6347189c0ab acquire shared (120000) Thread-19698::DEBUG::2011-01-18 20:08:13,393::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19698::DEBUG::2011-01-18 20:08:13,393::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'e4d10f5b-28ff-4bab-9273-c6347189c0ab' Thread-19698::DEBUG::2011-01-18 20:08:13,393::resource::524::irs::Owner e4d10f5b-28ff-4bab-9273-c6347189c0ab: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19698::DEBUG::2011-01-18 20:08:13,393::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19698::DEBUG::2011-01-18 20:08:13,394::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: ref 1 aborting False Thread-19698::INFO::2011-01-18 20:08:13,394::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19698::DEBUG::2011-01-18 20:08:13,395::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19698::DEBUG::2011-01-18 20:08:13,395::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: moving from state preparing -> state finished Thread-19698::DEBUG::2011-01-18 20:08:13,396::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19698::DEBUG::2011-01-18 20:08:13,396::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: e4d10f5b-28ff-4bab-9273-c6347189c0ab releasing Thread-19698::DEBUG::2011-01-18 20:08:13,396::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19698::DEBUG::2011-01-18 20:08:13,396::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19698::DEBUG::2011-01-18 20:08:13,397::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19698::DEBUG::2011-01-18 20:08:13,397::resource::503::irs::Owner e4d10f5b-28ff-4bab-9273-c6347189c0ab: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19698::DEBUG::2011-01-18 20:08:13,397::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19698::DEBUG::2011-01-18 20:08:13,398::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19698::DEBUG::2011-01-18 20:08:13,398::task::577::irs::Task e4d10f5b-28ff-4bab-9273-c6347189c0ab: ref 0 aborting False Thread-19698::INFO::2011-01-18 20:08:13,398::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:08:14,147::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.885458 seconds, 1.2 MB/s\n'; = 0 Thread-18497::INFO::2011-01-18 20:08:14,973::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:08:14,974::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:08:14,995::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:08:14,996::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:08:15,002::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:08:15,003::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:08:15,003::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:08:15,007::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:08:15,014::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 20:08:15,025::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:08:15,026::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:08:15,042::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:08:15,043::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:08:15,050::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:08:15,066::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:16,159::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:08:17,111::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.919937 seconds, 1.1 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:19,123::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Dummy-18546::DEBUG::2011-01-18 20:08:19,886::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.731659 seconds, 1.4 MB/s\n'; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:21,899::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-19703::INFO::2011-01-18 20:08:22,313::dispatcher::95::irs::Run and protect: repoStats, args: () Thread-19703::DEBUG::2011-01-18 20:08:22,314::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: moving from state init -> state preparing Thread-19703::DEBUG::2011-01-18 20:08:22,314::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0a0e5e3d-475a-40aa-898f-7c36d551f11c acquire shared (120000) Thread-19703::DEBUG::2011-01-18 20:08:22,315::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19703::DEBUG::2011-01-18 20:08:22,315::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to '0a0e5e3d-475a-40aa-898f-7c36d551f11c' Thread-19703::DEBUG::2011-01-18 20:08:22,315::resource::524::irs::Owner 0a0e5e3d-475a-40aa-898f-7c36d551f11c: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19703::DEBUG::2011-01-18 20:08:22,316::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19703::DEBUG::2011-01-18 20:08:22,316::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: ref 1 aborting False Thread-19703::DEBUG::2011-01-18 20:08:22,317::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: finished: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0500099658966', 'lastCheck': 1295374095.0537131, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0511629581451', 'lastCheck': 1295374095.0460279, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0475800037384', 'lastCheck': 1295374095.0494361, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0472631454468', 'lastCheck': 1295374095.0721321, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0465359687805', 'lastCheck': 1295374095.0203841, 'valid': True, 'code': 0}} Thread-19703::DEBUG::2011-01-18 20:08:22,317::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: moving from state preparing -> state finished Thread-19703::DEBUG::2011-01-18 20:08:22,317::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19703::DEBUG::2011-01-18 20:08:22,318::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: 0a0e5e3d-475a-40aa-898f-7c36d551f11c releasing Thread-19703::DEBUG::2011-01-18 20:08:22,318::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19703::DEBUG::2011-01-18 20:08:22,318::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19703::DEBUG::2011-01-18 20:08:22,319::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19703::DEBUG::2011-01-18 20:08:22,319::resource::503::irs::Owner 0a0e5e3d-475a-40aa-898f-7c36d551f11c: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19703::DEBUG::2011-01-18 20:08:22,319::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19703::DEBUG::2011-01-18 20:08:22,320::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19703::DEBUG::2011-01-18 20:08:22,320::task::577::irs::Task 0a0e5e3d-475a-40aa-898f-7c36d551f11c: ref 0 aborting False Thread-19703::INFO::2011-01-18 20:08:22,321::dispatcher::101::irs::Run and protect: repoStats, Return response: {'status': {'message': 'OK', 'code': 0}, 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'delay': '0.0500099658966', 'lastCheck': 1295374095.0537131, 'valid': True, 'code': 0}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'delay': '0.0475800037384', 'lastCheck': 1295374095.0494361, 'valid': True, 'code': 0}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'delay': '0.0465359687805', 'lastCheck': 1295374095.0203841, 'valid': True, 'code': 0}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'delay': '0.0472631454468', 'lastCheck': 1295374095.0721321, 'valid': True, 'code': 0}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'delay': '0.0511629581451', 'lastCheck': 1295374095.0460279, 'valid': True, 'code': 0}} Dummy-18546::DEBUG::2011-01-18 20:08:22,508::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.578098 seconds, 1.8 MB/s\n'; = 0 Thread-19705::INFO::2011-01-18 20:08:23,473::dispatcher::95::irs::Run and protect: getSpmStatus, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19705::DEBUG::2011-01-18 20:08:23,473::task::577::irs::Task fdeeb1a4-409d-4149-be96-3cd8423adf04: moving from state init -> state preparing Thread-19705::DEBUG::2011-01-18 20:08:23,474::misc::99::irs::'/bin/dd iflag=direct skip=0 bs=2048 if=/dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata count=1' (cwd None) Thread-19705::DEBUG::2011-01-18 20:08:23,505::misc::122::irs::SUCCESS: = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000416 seconds, 4.9 MB/s\n'; = 0 Thread-19705::DEBUG::2011-01-18 20:08:23,506::misc::291::irs::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000416 seconds, 4.9 MB/s'], size: 2048 Thread-19705::DEBUG::2011-01-18 20:08:23,506::blockSD::87::irs::(BlockSDMetadata._get) metadata=['CLASS=Data', 'DESCRIPTION=RH_SCALE_VG_2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=2', 'POOL_DESCRIPTION=RH_SCALE_DC', 'POOL_DOMAINS=a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'POOL_SPM_LVER=4', 'POOL_UUID=6e314f2e-203e-4814-9d34-ced6a238c98e', 'PV0=pv:1REDHAT_SCALE12,uuid:97niee-y7X3-fe8f-BHsm-nKCX-WzjP-S3nRnx,pestart:0,pecount:95,mapoffset:0', 'PV1=pv:1REDHAT_SCALE13,uuid:2tEKn6-31gT-YP0y-e68a-kUIu-P7vr-vMbFXO,pestart:0,pecount:95,mapoffset:95', 'PV2=pv:1REDHAT_SCALE10,uuid:KjmCqU-MFP3-UlZp-suob-h8TU-MckL-X8XsFG,pestart:0,pecount:95,mapoffset:190', 'PV3=pv:1REDHAT_SCALE11,uuid:cddiPv-frlj-ubCx-kpi1-fgah-EV6p-uCzjBQ,pestart:0,pecount:95,mapoffset:285', 'PV4=pv:1REDHAT_SCALE14,uuid:23VguZ-gHE7-uHSP-Onck-qcIQ-0nYJ-pQpkMO,pestart:0,pecount:95,mapoffset:380', 'PV5=pv:1REDHAT_SCALE15,uuid:36hlDK-dD0p-Q59K-yaoM-OBwc-XbLu-9USMJd,pestart:0,pecount:95,mapoffset:475', 'PV6=pv:1REDHAT_SCALE8,uuid:hjhYyL-ovxb-Ex3u-72JB-SKZ5-aeBN-0PFhQN,pestart:0,pecount:95,mapoffset:570', 'PV7=pv:1REDHAT_SCALE9,uuid:yHS5a5-bT2m-lqxz-xXWt-NKwx-1CHy-uq3sn0,pestart:0,pecount:95,mapoffset:665', 'ROLE=Master', 'SDUUID=5f225bd7-893f-4585-b75d-391629b8c6d5', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=pWKyHJ-wMtu-VJMI-iwmv-nMcM-IJ60-kLAULf', 'POOL_SPM_ID=1', '_SHA_CKSUM=8cb69898436145001c3ed4a297d1bb0714513cb7'] Thread-19705::DEBUG::2011-01-18 20:08:23,506::metadata::89::irs::metadata.__validate() __cksum(md) = 8cb69898436145001c3ed4a297d1bb0714513cb7 Thread-19705::DEBUG::2011-01-18 20:08:23,507::spm::592::irs::(SPM.status) spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e: spmStatus=SPM spmLver=4 spmId=1 Thread-19705::DEBUG::2011-01-18 20:08:23,507::task::577::irs::Task fdeeb1a4-409d-4149-be96-3cd8423adf04: finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19705::DEBUG::2011-01-18 20:08:23,508::task::577::irs::Task fdeeb1a4-409d-4149-be96-3cd8423adf04: moving from state preparing -> state finished Thread-19705::DEBUG::2011-01-18 20:08:23,508::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19705::DEBUG::2011-01-18 20:08:23,508::task::577::irs::Task fdeeb1a4-409d-4149-be96-3cd8423adf04: ref 0 aborting False Thread-19705::INFO::2011-01-18 20:08:23,509::dispatcher::101::irs::Run and protect: getSpmStatus, Return response: {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4}} Thread-19706::INFO::2011-01-18 20:08:23,519::dispatcher::95::irs::Run and protect: getStoragePoolInfo, args: ( spUUID=6e314f2e-203e-4814-9d34-ced6a238c98e) Thread-19706::DEBUG::2011-01-18 20:08:23,519::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: moving from state init -> state preparing Thread-19706::DEBUG::2011-01-18 20:08:23,520::resource::298::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f729ac53-9260-4a0c-880b-b99b1afa6561 acquire shared (120000) Thread-19706::DEBUG::2011-01-18 20:08:23,520::resource::304::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e - lockstate free Thread-19706::DEBUG::2011-01-18 20:08:23,520::resource::239::irs::Resource 'Storage/6e314f2e-203e-4814-9d34-ced6a238c98e': __granted shared to 'f729ac53-9260-4a0c-880b-b99b1afa6561' Thread-19706::DEBUG::2011-01-18 20:08:23,521::resource::524::irs::Owner f729ac53-9260-4a0c-880b-b99b1afa6561: _acquired Storage/6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19706::DEBUG::2011-01-18 20:08:23,521::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: _resourcesAcquired: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e (shared) Thread-19706::DEBUG::2011-01-18 20:08:23,521::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: ref 1 aborting False Thread-19706::INFO::2011-01-18 20:08:23,522::sp::1367::irs::(StoragePool.getDomains) Get storage pool domains: {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': 'Active', 'd36e088c-e33f-41c9-9799-60f27d683f24': 'Active', '5f225bd7-893f-4585-b75d-391629b8c6d5': 'Active', 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': 'Active', 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': 'Active'} Thread-19706::DEBUG::2011-01-18 20:08:23,522::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: finished: {'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Thread-19706::DEBUG::2011-01-18 20:08:23,523::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: moving from state preparing -> state finished Thread-19706::DEBUG::2011-01-18 20:08:23,523::resource::670::irs::Owner.releaseAll requests [] resources [] Thread-19706::DEBUG::2011-01-18 20:08:23,523::resource::341::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: f729ac53-9260-4a0c-880b-b99b1afa6561 releasing Thread-19706::DEBUG::2011-01-18 20:08:23,523::resource::348::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: owners after release [] Thread-19706::DEBUG::2011-01-18 20:08:23,524::resource::351::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: requests after release [] Thread-19706::DEBUG::2011-01-18 20:08:23,524::resource::370::irs::Resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e: free lock Thread-19706::DEBUG::2011-01-18 20:08:23,524::resource::503::irs::Owner f729ac53-9260-4a0c-880b-b99b1afa6561: _released Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/ (['Storage/6e314f2e-203e-4814-9d34-ced6a238c98e/']) Thread-19706::DEBUG::2011-01-18 20:08:23,525::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: resourceReleased: Storage.6e314f2e-203e-4814-9d34-ced6a238c98e Thread-19706::DEBUG::2011-01-18 20:08:23,525::resource::176::irs::resource Storage/6e314f2e-203e-4814-9d34-ced6a238c98e after decref ref 0 Thread-19706::DEBUG::2011-01-18 20:08:23,525::task::577::irs::Task f729ac53-9260-4a0c-880b-b99b1afa6561: ref 0 aborting False Thread-19706::INFO::2011-01-18 20:08:23,525::dispatcher::101::irs::Run and protect: getStoragePoolInfo, Return response: {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'RH_SCALE_DC', 'isoprefix': '', 'pool_status': 'connected', 'lver': '4', 'spm_id': '1', 'master_uuid': '5f225bd7-893f-4585-b75d-391629b8c6d5', 'domains': 'a34b5c63-e7ce-41e7-a4fc-9336c22c8737:Active,5f225bd7-893f-4585-b75d-391629b8c6d5:Active,d36e088c-e33f-41c9-9799-60f27d683f24:Active,d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3:Active,a36cbc28-c9d3-4a98-ac45-3fb661bf39c4:Active', 'type': 'ISCSI', 'master_ver': '2'}, 'dominfo': {'a34b5c63-e7ce-41e7-a4fc-9336c22c8737': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, 'a36cbc28-c9d3-4a98-ac45-3fb661bf39c4': {'status': 'Active', 'diskfree': '76369887232', 'disktotal': '102005473280'}, 'd36e088c-e33f-41c9-9799-60f27d683f24': {'status': 'Active', 'diskfree': '72343355392', 'disktotal': '76504104960'}, 'd03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}, '5f225bd7-893f-4585-b75d-391629b8c6d5': {'status': 'Active', 'diskfree': '97844723712', 'disktotal': '102005473280'}}} Dummy-18546::DEBUG::2011-01-18 20:08:24,520::misc::99::irs::'dd if=/rhev/data-center/6e314f2e-203e-4814-9d34-ced6a238c98e/mastersd/dom_md/inbox iflag=direct bs=512 count=2000' (cwd None) Thread-18497::INFO::2011-01-18 20:08:25,020::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d36e088c-e33f-41c9-9799-60f27d683f24 Thread-18497::DEBUG::2011-01-18 20:08:25,020::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d36e088c-e33f-41c9-9799-60f27d683f24 /dev/d36e088c-e33f-41c9-9799-60f27d683f24/metadata /dev/d36e088c-e33f-41c9-9799-60f27d683f24/leases /dev/d36e088c-e33f-41c9-9799-60f27d683f24/ids /dev/d36e088c-e33f-41c9-9799-60f27d683f24/inbox /dev/d36e088c-e33f-41c9-9799-60f27d683f24/outbox' (cwd None) Thread-18494::INFO::2011-01-18 20:08:25,046::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 Thread-18494::DEBUG::2011-01-18 20:08:25,047::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4 /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/metadata /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/leases /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/ids /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/inbox /dev/a36cbc28-c9d3-4a98-ac45-3fb661bf39c4/outbox' (cwd None) Thread-18495::INFO::2011-01-18 20:08:25,049::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=5f225bd7-893f-4585-b75d-391629b8c6d5 Thread-18495::DEBUG::2011-01-18 20:08:25,050::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/5f225bd7-893f-4585-b75d-391629b8c6d5 /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/metadata /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/leases /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/ids /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/inbox /dev/5f225bd7-893f-4585-b75d-391629b8c6d5/outbox' (cwd None) Thread-18493::INFO::2011-01-18 20:08:25,053::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=a34b5c63-e7ce-41e7-a4fc-9336c22c8737 Thread-18493::DEBUG::2011-01-18 20:08:25,055::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737 /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/metadata /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/leases /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/ids /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/inbox /dev/a34b5c63-e7ce-41e7-a4fc-9336c22c8737/outbox' (cwd None) Thread-18497::DEBUG::2011-01-18 20:08:25,065::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::INFO::2011-01-18 20:08:25,072::blockSD::457::irs::(BlockStorageDomain.validate) sdUUID=d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 Thread-18496::DEBUG::2011-01-18 20:08:25,073::misc::99::irs::'/usr/bin/sudo -n /bin/chown vdsm:kvm /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3 /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/metadata /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/leases /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/ids /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/inbox /dev/d03ffe7c-e71c-4b8d-ad7c-de2bcbc9cae3/outbox' (cwd None) Thread-18494::DEBUG::2011-01-18 20:08:25,094::misc::122::irs::SUCCESS: = ''; = 0 Thread-18495::DEBUG::2011-01-18 20:08:25,095::misc::122::irs::SUCCESS: = ''; = 0 Thread-18493::DEBUG::2011-01-18 20:08:25,102::misc::122::irs::SUCCESS: = ''; = 0 Thread-18496::DEBUG::2011-01-18 20:08:25,117::misc::122::irs::SUCCESS: = ''; = 0 Dummy-18546::DEBUG::2011-01-18 20:08:25,203::misc::122::irs::SUCCESS: = '2000+0 records in\n2000+0 records out\n1024000 bytes (1.0 MB) copied, 0.650035 seconds, 1.6 MB/s\n'; = 0