Linux version 2.6.18-189.el5PAE (mockbuild@x86-004.build.bos.redhat.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Tue Feb 16 11:18:43 EST 2010 BIOS-provided physical RAM map: BIOS-e820: 0000000000010000 - 00000000000a0000 (usable) BIOS-e820: 0000000000100000 - 00000000bf699000 (usable) BIOS-e820: 00000000bf699000 - 00000000bf6af000 (reserved) BIOS-e820: 00000000bf6af000 - 00000000bf6ce000 (ACPI data) BIOS-e820: 00000000bf6ce000 - 00000000c0000000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000640000000 (usable) 24704MB HIGHMEM available. 896MB LOWMEM available. found SMP MP-table at 000fe710 Memory for crash kernel (0x0 to 0x0) notwithin permissible range disabling kdump NX (Execute Disable) protection: active DMI 2.6 present. Using APIC driver default ACPI: PM-Timer IO Port: 0x808 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) Processor #16 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled) Processor #0 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) Processor #18 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled) Processor #2 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled) Processor #20 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled) Processor #4 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled) Processor #22 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled) Processor #6 7:10 APIC version 21 ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32]) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Enabling APIC mode: Flat. Using 2 I/O APICs ACPI: HPET id: 0x8086a301 base: 0xfed00000 Using ACPI (MADT) for SMP configuration information Allocating PCI resources starting at c2000000 (gap: c0000000:20000000) Detected 2394.130 MHz processor. Built 1 zonelists. Total pages: 6553600 Kernel command line: ro root=/dev/VolGroup00/LogVol00 rhgb console=tty0 console=ttyS0,115200n8 Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Initializing CPU#0 CPU 0 irqstacks, hard=c0765000 soft=c0745000 PID hash table entries: 4096 (order: 12, 16384 bytes) Console: colour VGA+ 80x25 Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) Memory: 24941592k/26214400k available (2175k kernel code, 213328k reserved, 899k data, 228k init, 24238692k highmem) Checking if this processor honours the WP bit even in supervisor mode... Ok. hpet0: at MMIO 0xfed00000 (virtual 0xf8800000), IRQs 2, 8, 0, 0 hpet0: 4 64-bit timers, 14318180 Hz Using HPET for base-timer Calibrating delay loop (skipped), value calculated using timer frequency.. 4788.26 BogoMIPS (lpj=2394130) Security Framework v1.0.0 initialized SELinux: Initializing. selinux_register_security: Registering secondary module capability Capability LSM initialized as secondary Mount-cache hash table entries: 512 monitor/mwait feature present. using mwait in idle threads. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 1 CPU: Processor Core ID: 0 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#0. Checking 'hlt' instruction... OK. SMP alternatives: switching to UP code ACPI: Core revision 20060707 CPU0: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 1/0 eip 11000 CPU 1 irqstacks, hard=c0766000 soft=c0746000 Initializing CPU#1 Calibrating delay using timer specific routine.. 4788.06 BogoMIPS (lpj=2394031) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 0 CPU: Processor Core ID: 0 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#1. CPU1: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 2/2 eip 11000 CPU 2 irqstacks, hard=c0767000 soft=c0747000 Initializing CPU#2 Calibrating delay using timer specific routine.. 4788.01 BogoMIPS (lpj=2394009) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 0 CPU: Processor Core ID: 1 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#2. CPU2: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 3/4 eip 11000 CPU 3 irqstacks, hard=c0768000 soft=c0748000 Initializing CPU#3 Calibrating delay using timer specific routine.. 4788.03 BogoMIPS (lpj=2394015) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 0 CPU: Processor Core ID: 2 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#3. CPU3: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 4/6 eip 11000 CPU 4 irqstacks, hard=c0769000 soft=c0749000 Initializing CPU#4 Calibrating delay using timer specific routine.. 4788.02 BogoMIPS (lpj=2394013) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 0 CPU: Processor Core ID: 3 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#4. CPU4: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 5/18 eip 11000 CPU 5 irqstacks, hard=c076a000 soft=c074a000 Initializing CPU#5 Calibrating delay using timer specific routine.. 4787.98 BogoMIPS (lpj=2393993) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 1 CPU: Processor Core ID: 1 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#5. CPU5: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 6/20 eip 11000 CPU 6 irqstacks, hard=c076b000 soft=c074b000 Initializing CPU#6 Calibrating delay using timer specific routine.. 4787.94 BogoMIPS (lpj=2393973) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 1 CPU: Processor Core ID: 2 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#6. CPU6: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 SMP alternatives: switching to SMP code Booting processor 7/22 eip 11000 CPU 7 irqstacks, hard=c076c000 soft=c074c000 Initializing CPU#7 Calibrating delay using timer specific routine.. 4787.96 BogoMIPS (lpj=2393981) monitor/mwait feature present. CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 256K CPU: L3 cache: 8192K CPU: Physical Processor ID: 1 CPU: Processor Core ID: 3 Intel machine check architecture supported. Intel machine check reporting enabled on CPU#7. CPU7: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz stepping 05 Total of 8 processors activated (38304.29 BogoMIPS). ENABLING IO-APIC IRQs ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1 Using local APIC timer interrupts. checking TSC synchronization across 8 CPUs: passed. Brought up 8 CPUs migration_cost=143,1208 checking if image is initramfs... it is Freeing initrd memory: 3289k freed NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using MMCONFIG Setting up standard PCI resources ACPI: Interpreter enabled ACPI: Using IOAPIC for interrupt routing ACPI: No dock devices found. ACPI: PCI Root Bridge [PCI0] (0000:00) PCI: Transparent bridge - 0000:00:1e.0 ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15) ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15) ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15) Linux Plug and Play Support v0.97 (c) Adam Belay pnp: PnP ACPI init pnp: PnP ACPI: found 13 devices usbcore: registered new driver usbfs usbcore: registered new driver hub PCI: Using ACPI for IRQ routing PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default pnp: 00:07: ioport range 0x800-0x87f could not be reserved pnp: 00:07: ioport range 0x880-0x8ff has been reserved pnp: 00:07: ioport range 0x900-0x91f has been reserved pnp: 00:07: ioport range 0x920-0x923 has been reserved pnp: 00:07: ioport range 0x924-0x924 has been reserved pnp: 00:07: ioport range 0xc00-0xc7f has been reserved pnp: 00:07: ioport range 0xca0-0xca7 has been reserved pnp: 00:08: ioport range 0xca8-0xca8 has been reserved pnp: 00:08: ioport range 0xcac-0xcac has been reserved PCI: Bridge: 0000:00:01.0 IO window: disabled. MEM window: d4000000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:00:03.0 IO window: disabled. MEM window: d8000000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:05:02.0 IO window: e000-0000 MEM window: dd600000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:05:04.0 IO window: d000-0000 MEM window: dd000000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:04:00.0 IO window: d000-0000 MEM window: dd000000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:00:07.0 IO window: d000-0000 MEM window: dd000000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:09:02.0 IO window: c000-0000 MEM window: de200000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:09:04.0 IO window: b000-0000 MEM window: ddc00000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:08:00.0 IO window: b000-0000 MEM window: ddc00000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:00:09.0 IO window: b000-0000 MEM window: ddc00000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:00:1c.0 IO window: f000-0000 MEM window: de900000-00000000 PREFETCH window: disabled. PCI: Bridge: 0000:00:1e.0 IO window: disabled. MEM window: dc000000-00000000 PREFETCH window 0x00000000d3800000-0x00000000d3ffffff ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 53 (level, low) -> IRQ 169 ACPI: PCI Interrupt 0000:00:03.0[A] -> GSI 53 (level, low) -> IRQ 169 ACPI: PCI Interrupt 0000:00:07.0[A] -> GSI 53 (level, low) -> IRQ 169 ACPI: PCI Interrupt 0000:00:09.0[A] -> GSI 53 (level, low) -> IRQ 169 ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 177 NET: Registered protocol family 2 IP route cache hash table entries: 32768 (order: 5, 131072 bytes) TCP established hash table entries: 131072 (order: 8, 1048576 bytes) TCP bind hash table entries: 65536 (order: 7, 524288 bytes) TCP: Hash tables configured (established 131072 bind 65536) TCP reno registered apm: BIOS not found. audit: initializing netlink socket (disabled) type=2000 audit(1267650565.795:1): initialized highmem bounce pool size: 64 pages Total HugeTLB memory allocated, 0 VFS: Disk quotas dquot_6.5.1 Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) Initializing Cryptographic API alg: No test for crc32c (crc32c-generic) ksign: Installing public key data Loading keyring - Added public key 4E3D791AF47D010C - User ID: Red Hat, Inc. (Kernel Module GPG key) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) pci_hotplug: PCI Hot Plug PCI Core version: 0.5 ACPI: CPU0 (power states: C1[C1] C2[C3]) ACPI: CPU1 (power states: C1[C1] C2[C3]) ACPI: CPU5 (power states: C1[C1] C2[C3]) ACPI: CPU2 (power states: C1[C1] C2[C3]) ACPI: CPU6 (power states: C1[C1] C2[C3]) ACPI: CPU3 (power states: C1[C1] C2[C3]) ACPI: CPU7 (power states: C1[C1] C2[C3]) ACPI: CPU4 (power states: C1[C1] C2[C3]) Real Time Clock Driver v1.12ac Non-volatile memory driver v1.2 Linux agpgart interface v0.101 (c) Dave Jones Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled ˙serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A brd: module loaded Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx ide-floppy driver 0.99.newide usbcore: registered new driver hiddev usbcore: registered new driver usbhid drivers/usb/input/hid-core.c: v2.6:USB HID core driver PNP: No PS/2 controller found. Probing ports directly. serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mice: PS/2 mouse device common for all mice md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 md: bitmap version 4.39 TCP bic registered Initializing IPsec netlink socket NET: Registered protocol family 1 NET: Registered protocol family 17 Using IPI No-Shortcut mode Time: tsc clocksource has been installed. ACPI: (supports S0 S4 S5) Initalizing network drop monitor service Freeing unused kernel memory: 228k freed Write protecting the kernel read-only data: 408k Red Hat nash version 5.1.19.6 starting Mounting proc filesystem Mounting sysfs filesystem Creating /dev Creating initial device nodes Setting up hotplug. Creating block device nodes. Loading ehci-hcd.ko module ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 19 (level, low) -> IRQ 74 ehci_hcd 0000:00:1a.7: EHCI Host Controller ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1 ehci_hcd 0000:00:1a.7: debug port 1 ehci_hcd 0000:00:1a.7: irq 74, io mem 0xde8df800 ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 4 ports detected ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 21 (level, low) -> IRQ 82 ehci_hcd 0000:00:1d.7: EHCI Host Controller ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2 ehci_hcd 0000:00:1d.7: debug port 1 ehci_hcd 0000:00:1d.7: irq 82, io mem 0xde8dfc00 ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 usb usb2: configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-0:1.0: 4 ports detected Loading ohci-hcd.ko module Loading uhci-hcd.ko module USB Universal Host Controller Interface driver v3.0 ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 17 (level, low) -> IRQ 90 uhci_hcd 0000:00:1a.0: UHCI Host Controller uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3 uhci_hcd 0000:00:1a.0: irq 90, io base 0x0000ac40 usb usb3: configuration #1 chosen from 1 choice hub 3-0:1.0: USB hub found hub 3-0:1.0: 2 ports detected usb 1-3: new high speed USB device using ehci_hcd and address 2 ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 18 (level, low) -> IRQ 98 uhci_hcd 0000:00:1a.1: UHCI Host Controller uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4 uhci_hcd 0000:00:1a.1: irq 98, io base 0x0000ac60 usb usb4: configuration #1 chosen from 1 choice hub 4-0:1.0: USB hub found hub 4-0:1.0: 2 ports detected usb 1-3: configuration #1 chosen from 1 choice hub 1-3:1.0: USB hub found hub 1-3:1.0: 3 ports detected ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 21 (level, low) -> IRQ 82 uhci_hcd 0000:00:1d.0: UHCI Host Controller uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 5 uhci_hcd 0000:00:1d.0: irq 82, io base 0x0000ac80 usb usb5: configuration #1 chosen from 1 choice hub 5-0:1.0: USB hub found hub 5-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 20 (level, low) -> IRQ 106 uhci_hcd 0000:00:1d.1: UHCI Host Controller uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 6 uhci_hcd 0000:00:1d.1: irq 106, io base 0x0000aca0 usb usb6: configuration #1 chosen from 1 choice hub 6-0:1.0: USB hub found hub 6-0:1.0: 2 ports detected Loading jbd.ko module Loading ext3.ko module Loading scsi_mod.ko module SCSI subsystem initialized Loading sd_mod.ko module Loading scsi_transport_sas.ko module Loading mptbase.ko module Fusion MPT base driver 3.04.13rh Copyright (c) 1999-2008 LSI Corporation Loading mptscsih.ko module Loading mptsas.ko module Fusion MPT SAS Host driver 3.04.13rh ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 16 (level, low) -> IRQ 177 mptbase: ioc0: Initiating bringup ioc0: LSISAS1068E B3: Capabilities={Initiator} usb 5-1: new low speed USB device using uhci_hcd and address 2 usb 5-1: configuration #1 chosen from 1 choice input: Cypress Cypress USB Keyboard / PS2 Mouse as /class/input/input0 input: USB HID v1.00 Keyboard [Cypress Cypress USB Keyboard / PS2 Mouse] on usb-0000:00:1d.0-1 input: Cypress Cypress USB Keyboard / PS2 Mouse as /class/input/input1 input: USB HID v1.00 Mouse [Cypress Cypress USB Keyboard / PS2 Mouse] on usb-0000:00:1d.0-1 usb 5-2: new full speed USB device using uhci_hcd and address 3 usb 5-2: configuration #1 chosen from 1 choice input: Avocent USB Composite Device-0 as /class/input/input2 input: USB HID v1.00 Keyboard [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2 input: Avocent USB Composite Device-0 as /class/input/input3 input: USB HID v1.00 Mouse [Avocent USB Composite Device-0] on usb-0000:00:1d.0-2 scsi0 : ioc0: LSISAS1068E B3, FwRev=00192f00h, Ports=1, MaxQ=266, IRQ=177 mptsas: ioc0: attaching ssp device: fw_channel 0, fw_id 9, phy 0, sas_addr 0x5000c50016fb4241 Vendor: SEAGATE Model: ST9300603SS Rev: FS04 Type: Direct-Access ANSI SCSI revision: 05 mptsas: ioc0: attaching ssp device: fw_channel 0, fw_id 1, phy 1, sas_addr 0x5000c50016ec3a19 Vendor: SEAGATE Model: ST9300603SS Rev: FS04 Type: Direct-Access ANSI SCSI revision: 05 mptsas: ioc0: attaching raid volume, channel 1, id 0 Vendor: Dell Model: VIRTUAL DISK Rev: 1028 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sda: 584843264 512-byte hdwr sectors (299440 MB) sda: Write Protect is off SCSI device sda: drive cache: write through SCSI device sda: 584843264 512-byte hdwr sectors (299440 MB) sda: Write Protect is off SCSI device sda: drive cache: write through sda: sda1 sda2 sd 0:1:0:0: Attached scsi disk sda Loading libata.ko module Loading ata_piix.ko module ACPI: PCI Interrupt 0000:00:1f.2[C] -> GSI 23 (level, low) -> IRQ 114 ata_piix 0000:00:1f.2: MAP [ P0 -- P1 -- ] scsi1 : ata_piix scsi2 : ata_piix ata1: SATA max UDMA/133 cmd 0xac10 ctl 0xac08 bmdma 0xac20 irq 114 ata2: SATA max UDMA/133 cmd 0xac18 ctl 0xac0c bmdma 0xac28 irq 114 ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300) ata1.00: ATAPI: TEAC DVD-ROM DV28SV, D.0K, max UDMA/100 ata1.00: configured for UDMA/100 ata2: SATA link down (SStatus 4 SControl 0) Vendor: TEAC Model: DVD-ROM DV28SV Rev: D.0K Type: CD-ROM ANSI SCSI revision: 05 Loading dm-mod.ko module device-mapper: uevent: version 1.0.3 device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com Loading dm-log.ko module Loading dm-mirror.ko module Loading dm-zero.ko module Loading dm-snapshot.ko module Loading dm-mem-cache.ko module Loading dm-region_hash.ko module Loading dm-message.ko module Loading dm-raid45.ko module device-mapper: dm-raid45: initialized v0.2594l Waiting for driver initialization. Scanning and configuring dmraid supported devices Scanning logical volumes Reading all physical volumes. This may take a while... Found volume group "VolGroup00" using metadata type lvm2 Activating logical volumes 2 logical volume(s) in volume group "VolGroup00" now active Creating root device. Mounting root filesystem. kjournald starting. Commit interval 5 seconds Setting up otherEXT3-fs: mounted filesystem with ordered data mode. filesystems. Setting up new root fs no fstab.sys, mounting internal defaults Switching to new root and running init. unmounting old /dev unmounting old /proc unmounting old /sys SELinux: Disabled at runtime. type=1404 audit(1267650621.159:2): selinux=0 auid=4294967295 ses=4294967295 INIT: version 2.86 booting Welcome to Red Hat Enterprise Linux Server Press 'I' to enter interactive startup. Setting clock (utc): Wed Mar 3 15:10:22 CST 2010 [ OK ] Starting udev: [ OK ] Loading default keymap (us): [ OK ] Setting hostname ipv6: [ OK ] Setting up Logical Volume Management: 2 logical volume(s) in volume group "VolGroup00" now active [ OK ] Checking filesystems Checking all file systems. [/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/VolGroup00/LogVol00 /dev/VolGroup00/LogVol00: clean, 124961/71794688 files, 2921437/71786496 blocks [/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/sda1 /boot: clean, 34/26104 files, 15455/104388 blocks [ OK ] Remounting root filesystem in read-write mode: [ OK ] Mounting local filesystems: [ OK ] Enabling local filesystem quotas: [ OK ] Enabling /etc/fstab swaps: [ OK ] INIT: Entering runlevel: 5 Entering non-interactive startup Applying Intel CPU microcode update: [ OK ] Starting monitoring for VG VolGroup00: 2 logical volume(s) in volume group "VolGroup00" monitored [ OK ] Starting sysstat: Calling the system activity data collector (sadc): [ OK ] Starting background readahead: [ OK ] Checking for hardware changes [ OK ] Bringing up loopback interface: [ OK ] Bringing up interface bond0: Device bond0 does not seem to be present, delaying initialization. [FAILED] Bringing up interface eth8: Determining IP information for eth8... done. [ OK ] Starting auditd: [ OK ] Starting system logger: [ OK ] Starting kernel logger: [ OK ] Starting irqbalance: [ OK ] Starting portmap: [ OK ] Starting NFS statd: [ OK ] Starting RPC idmapd: [ OK ] Starting system message bus: [ OK ] Starting Bluetooth services:[ OK ][ OK ] Mounting other filesystems: [ OK ] Starting PC/SC smart card daemon (pcscd): [ OK ] Starting acpi daemon: [ OK ] Starting HAL daemon: [ OK ] Starting hidd: [ OK ] Starting autofs: Loading autofs4: [ OK ] Starting automount: [ OK ] [ OK ] Starting hpiod: [ OK ] Starting hpssd: [ OK ] Starting sshd: [ OK ] Starting cups: [ OK ] Starting xinetd: [ OK ] Starting sendmail: [ OK ] Starting sm-client: [ OK ] Starting console mouse services: [ OK ] Starting crond: [ OK ] Starting xfs: [ OK ] Starting anacron: [ OK ] Starting atd: [ OK ][ OK ] Starting background readahead: [ OK ] Starting yum-updatesd: [ OK ] Starting Avahi daemon... [ OK ] Starting smartd: [ OK ] Red Hat Enterprise Linux Server release 5.5 Beta (Tikanga) Kernel 2.6.18-189.el5PAE on an i686 ipv6 login: bonding: Warning: either miimon or arp_interval and arp_ip_target module parameters must be specified, otherwise bonding will not detect link failures! see bonding.txt for details. bonding: bond0: Warning: failed to get speed and duplex from eth0, assumed to be 100Mb/sec and Full. bonding: bond0: Warning: failed to get speed and duplex from eth1, assumed to be 100Mb/sec and Full. bonding: bond0: Warning: failed to get speed and duplex from eth2, assumed to be 100Mb/sec and Full. bonding: bond0: Warning: failed to get speed and duplex from eth3, assumed to be 100Mb/sec and Full. printk: 6 messages suppressed. printk: 7 messages suppressed. printk: 7 messages suppressed. printk: 9 messages suppressed. printk: 6 messages suppressed. printk: 10 messages suppressed. printk: 143 messages suppressed. ICMPv6 RA: ndisc_router_discovery() failed to add default route. printk: 479 messages suppressed. BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x70/0x74 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: 00000071 EBX: cda0f200 ECX: cdb77980 EDX: c16549e0 ESI: 00000246 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xd/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at dst_destroy+0x57/0xb2 EFLAGS: 00000286 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dde0 EBX: 00000000 ECX: 00000001 EDX: 00000000 ESI: f2a4f780 EDI: 00000000 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at dst_destroy+0x57/0xb2 EFLAGS: 00000286 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dde0 EBX: 00000000 ECX: 00000001 EDX: 00000000 ESI: f2a4f780 EDI: 00000000 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xd/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at dst_destroy+0x8/0xb2 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: f2a4f780 EBX: 00000000 ECX: 00000001 EDX: f2a4f780 ESI: f2a4f780 EDI: c06b6158 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x0/0x74 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: cdb77980 EBX: 00000000 ECX: 00000001 EDX: f2a4f780 ESI: f2a4f780 EDI: 00000000 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xd/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xd/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x2a/0x74 EFLAGS: 00000287 Not tainted (2.6.18-189.el5PAE #1) EAX: 00000000 EBX: 00000000 ECX: cdb77980 EDX: c16549e0 ESI: f2a4f780 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at dst_destroy+0x76/0xb2 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c06aab80 EBX: 00000000 ECX: 00000001 EDX: 00000000 ESI: f2a4f780 EDI: 00000000 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x47/0x74 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: 80000080 EBX: 00000000 ECX: cdb77980 EDX: c16549e0 ESI: 00000246 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x3/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x70/0x74 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: 0000003d EBX: cda0f200 ECX: c04707f6 EDX: f72e57c0 ESI: 00000246 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x70/0x74 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: 0000003d EBX: cda0f200 ECX: c04707f6 EDX: f72e57c0 ESI: 00000246 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at dst_destroy+0x76/0xb2 EFLAGS: 00000286 Not tainted (2.6.18-189.el5PAE #1) EAX: c06aab80 EBX: 00000000 ECX: 00000001 EDX: 00000000 ESI: f2a4f780 EDI: 00000000 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x70/0x74 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: 0000003d EBX: cda0f200 ECX: c04707f6 EDX: f72e57c0 ESI: 00000246 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xd/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at kmem_cache_free+0x70/0x74 EFLAGS: 00000246 Not tainted (2.6.18-189.el5PAE #1) EAX: 0000006b EBX: cda0f200 ECX: cdb77980 EDX: c16549e0 ESI: 00000246 EDI: f2a4f780 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_destroy+0x86/0xb2 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0x12/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x8/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x3/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#6 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 6 EIP is at dst_destroy+0x76/0xb2 EFLAGS: 00000202 Not tainted (2.6.18-189.el5PAE #1) EAX: c06aab80 EBX: 00000000 ECX: 00000001 EDX: 00000000 ESI: f2a4f780 EDI: 00000000 EBP: 00000100 DS: 007b ES: 007b CR0: 8005003b CR2: 0062fd60 CR3: 379e8480 CR4: 000006f0 [] dst_run_gc+0x4e/0xee [] run_timer_softirq+0x14d/0x1d0 [] dst_run_gc+0x0/0xee [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] apic_timer_interrupt+0x1f/0x24 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#4 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 4 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0749000 EBX: c06b6150 ECX: 00000000 EDX: f313d180 ESI: 00000015 EDI: 00000000 EBP: f7865740 DS: 007b ES: 007b CR0: 8005003b CR2: 0043bca0 CR3: 379e8c20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] del_timer+0x62/0x69 [] addrconf_verify+0xb3/0x25c [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#0 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 0 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0745000 EBX: c06b6150 ECX: f735c780 EDX: f2a49cc0 ESI: f7385700 EDI: f7385710 EBP: f2a49cc0 DS: 007b ES: 007b CR0: 8005003b CR2: 08667254 CR3: 37110420 CR4: 000006f0 [] __dst_free+0xd/0x5f [] fib6_add+0x538/0x571 [ipv6] [] ip6_ins_rt+0x31/0x44 [ipv6] [] ip6_pol_route_input+0x107/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] __activate_task+0x4a/0x59 [] hrtimer_wakeup+0x0/0x18 [] hrtimer_wakeup+0x15/0x18 [] hrtimer_run_queues+0xef/0x176 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 [] start_kernel+0x37b/0x383 ======================= BUG: soft lockup - CPU#1 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 1 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0746000 EBX: f902d038 ECX: 000003e8 EDX: c0746000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: 08ea063c CR3: 379e8420 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#7 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 7 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c074ce1c ESI: c074cdf4 EDI: c074ce1c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: 08d3d734 CR3: 37806d40 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] ndisc_send_ns+0x3a8/0x47a [ipv6] [] mtrr_file_add+0x58/0xb6 [] mtrr_file_add+0x58/0xb6 [] uhci_scan_schedule+0x59/0x742 [uhci_hcd] [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#3 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 3 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c0748000 EBX: c06b6150 ECX: 00000000 EDX: f735c580 ESI: 00000015 EDI: f767b400 EBP: f72b4f40 DS: 007b ES: 007b CR0: 8005003b CR2: b7ff3000 CR3: 371b7e20 CR4: 000006f0 [] __dst_free+0xd/0x5f [] ipv6_ifa_notify+0x1d/0x24 [ipv6] [] ipv6_del_addr+0x1f2/0x386 [ipv6] [] addrconf_dad_failure+0xb6/0xbd [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_get_ifaddr+0x87/0x8e [ipv6] [] ndisc_recv_ns+0x1af/0x3ff [ipv6] [] find_match+0xc0/0x105 [ipv6] [] ndisc_rcv+0x7b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] skb_checksum+0x44/0x27b [] fib6_rule_action+0x46/0xae [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _read_lock_bh+0x8/0x17 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#5 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 5 EIP is at _spin_lock_bh+0xf/0x18 EFLAGS: 00000282 Not tainted (2.6.18-189.el5PAE #1) EAX: c074a000 EBX: f902d038 ECX: 000003e8 EDX: c074a000 ESI: f7865740 EDI: fffedc8e EBP: f767b400 DS: 007b ES: 007b CR0: 8005003b CR2: b7f59000 CR3: 37110a80 CR4: 000006f0 [] addrconf_verify+0x11/0x25c [ipv6] [] _read_lock_bh+0x8/0x17 [] addrconf_dad_start+0x50/0xf1 [ipv6] [] addrconf_prefix_rcv+0x4b0/0x6bf [ipv6] [] ndisc_rcv+0x76b/0x9fe [ipv6] [] rt6_select+0x46/0xbe [ipv6] [] icmpv6_rcv+0x524/0x5d5 [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] _spin_lock_bh+0x8/0x18 [] ipv6_chk_mcast_addr+0xf2/0x11b [ipv6] [] ip6_input+0x1d7/0x32a [ipv6] [] ip6_mc_input+0x65/0x72 [ipv6] [] ipv6_rcv+0x2aa/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] bnx2_poll_work+0xc60/0xd6a [bnx2] [] try_to_wake_up+0x3e8/0x3f2 [] __activate_task+0x4a/0x59 [] mtrr_file_add+0x61/0xb6 [] lock_timer_base+0x15/0x2f [] __mod_timer+0xda/0xe4 [] bnx2_poll_msix+0x29/0xc1 [bnx2] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 ======================= BUG: soft lockup - CPU#2 stuck for 10s! [swapper:0] Pid: 0, comm: swapper EIP: 0060:[] CPU: 2 EIP is at __read_lock_failed+0x5/0x14 EFLAGS: 00000297 Not tainted (2.6.18-189.el5PAE #1) EAX: f902dfac EBX: f902dfac ECX: 00000005 EDX: c0747e9c ESI: c0747e74 EDI: c0747e9c EBP: f902dfa0 DS: 007b ES: 007b CR0: 8005003b CR2: b7fab000 CR3: 379e83e0 CR4: 000006f0 [] _read_lock_bh+0x15/0x17 [] ip6_pol_route_input+0x2a/0x17e [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] fib6_rule_action+0x46/0xae [ipv6] [] fib_rules_lookup+0x37/0x61 [] fib6_rule_lookup+0x28/0x64 [ipv6] [] ip6_pol_route_input+0x0/0x17e [ipv6] [] ip6_route_input+0xbf/0xca [ipv6] [] ipv6_rcv+0x2a2/0x335 [ipv6] [] netif_receive_skb+0x3dd/0x401 [] igb_poll+0x532/0x8a1 [igb] [] net_rx_action+0x9c/0x1a7 [] __do_softirq+0x87/0x114 [] do_softirq+0x52/0x9c [] __do_IRQ+0x0/0xd6 [] do_IRQ+0xb5/0xc3 [] common_interrupt+0x1a/0x20 [] acpi_processor_idle_simple+0x111/0x254 [] cpu_idle+0x9f/0xb9 =======================