FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > Debian > Debian Kernel

 
 
LinkBack Thread Tools
 
Old 09-08-2011, 05:12 PM
Hans van Kranenburg
 
Default Bug#640941: xen dom0 crash: unable to handle kernel paging request / Oops / Kernel panic

Package: linux-image-2.6.32-5-xen-amd64
Version: 2.6.32-35
Severity: important

When putting disk/network load on one of our office servers, Xen/dom0
crashes. Triple ctrl-a does not react any more on serial console.


We did not encounter this earlier on this particular piece of hardware,
having tortured it some more in the past. A few days ago we set up drbd
on this host (and another one, which is not exactly the same hardware)
and right now we're trying to rsync about 2TB of data (lots of small
files) from local (lvm) partitions to the drbd devices. rsync is running
in a domU which has the local lv and drbd mounted inside.


Munin graphs do not show unusual things, except for the device
utilization of the drbd devices, which is (not surprisingly) about 100%
at the moment of crash:

http://syrinx.knorrie.org/~knorrie/munin-drbd-luigi.png

Capture of the stacktrace on serial console is attached as
'stacktrace.txt', also dmesg, xm dmesg and lspci are attached.


Please let me know if I can do anything else to provide more relevant
information.


Thanks,

--
Hans van Kranenburg - System / Network Engineer
+31 (0)10 2760434 | hans.van.kranenburg@mendix.com | www.mendix.com
luigi login: [87014.488066] BUG: unable to handle kernel paging request at ffff88001db0b8e8
[87014.488118] IP: [<ffffffff81256860>] skb_copy_bits+0x114/0x1e0
[87014.488156] PGD 1002067 PUD 1006067 PMD 1cd067 PTE 0
[87014.488195] Thread overran stack, or stack corrupted
[87014.488224] Oops: 0000 [#1] SMP
[87014.488255] last sysfs file: /sys/devices/pci0000:00/0000:00:04.0/host1/target1:0:1/1:0:1:0/block/sr0/stat
[87014.488315] CPU 0
[87014.488339] Modules linked in: tun xen_evtchn xenfs ip6t_LOG ip6t_REJECT nf_conntrack_ipv6 ip6table_filter ip6table_mangle ip6table_raw ip6_tables ipt_LOG xt_limit ipt_REJECT xt_tcpudp xt_state xt_owner xt_multiport iptable_filter iptab
le_nat nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_mangle iptable_raw ip_tables x_tables drbd lru_cache cn 8021q garp bridge stp loop radeon snd_pcm snd_timer ttm snd drm_kms_helper soundcore shpchp snd_page_alloc drm i2c_
nforce2 amd64_edac_mod i2c_algo_bit k10temp pci_hotplug pcspkr evdev edac_core i2c_core serio_raw edac_mce_amd button processor acpi_processor ext4 mbcache jbd2 crc16 dm_mod sr_mod cdrom ata_generic ohci_hcd sg sd_mod crc_t10dif pata_amd a
rcmsr ehci_hcd thermal libata usbcore thermal_sys nls_base forcedeth scsi_mod [last unloaded: scsi_wait_scan]
[87014.488881] Pid: 0, comm: swapper Tainted: G W 2.6.32-5-xen-amd64 #1 H8DMU
[87014.488932] RIP: e030:[<ffffffff81256860>] [<ffffffff81256860>] skb_copy_bits+0x114/0x1e0
[87014.488985] RSP: e02b:ffff880003430ba0 EFLAGS: 00010206
[87014.489019] RAX: ffff88001db0b000 RBX: ffff8800120c3030 RCX: 00000000000005a8
[87014.489053] RDX: 0000000000000042 RSI: ffff88001db0b8e8 RDI: ffff8800120c3140
[87014.489086] RBP: 00000000000005a8 R08: 0000000000000020 R09: 0000000000000014
[87014.489120] R10: dead000000200200 R11: dead000000100100 R12: 0000000000000042
[87014.489153] R13: 00000000000005a8 R14: 0000000000000042 R15: ffff8800098b74e8
[87014.489191] FS: 00007fe561423760(0000) GS:ffff88000342d000(0000) knlGS:0000000000000000
[87014.489248] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[87014.489278] CR2: ffff88001db0b8e8 CR3: 0000000019354000 CR4: 0000000000000660
[87014.489312] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[87014.489346] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[87014.489379] Process swapper (pid: 0, threadinfo ffffffff81444000, task ffffffff814791f0)
[87014.489428] Stack:
[87014.489451] ffff8800120c3000 ffffffff81444000 ffff8800120c3140 000005ea8127d0d2
[87014.489490] <0> 0000000000000000 ffff88000a00910c ffff88000a009120 ffff8800098b74e8
[87014.489548] <0> ffff8800098b74e8 0000000000000000 00000000000005a8 ffffffff8125848a
[87014.489625] Call Trace:
[87014.489649] <IRQ>
[87014.489676] [<ffffffff8125848a>] ? __pskb_pull_tail+0x81/0x28f
[87014.489710] [<ffffffff81288048>] ? ip_finish_output+0x0/0x64
[87014.489747] [<ffffffff812603ff>] ? dev_queue_xmit+0xae/0x38d
[87014.489779] [<ffffffff81287c45>] ? ip_queue_xmit+0x311/0x386
[87014.489813] [<ffffffff8102ddcc>] ? pvclock_clocksource_read+0x3a/0x8b
[87014.489847] [<ffffffff812aa0b1>] ? inet_sk_rebuild_header+0x30/0x358
[87014.489881] [<ffffffff81067029>] ? run_posix_cpu_timers+0x25/0x6ea
[87014.489916] [<ffffffff8100ece2>] ? check_events+0x12/0x20
[87014.489948] [<ffffffff812985f7>] ? tcp_transmit_skb+0x648/0x687
[87014.489981] [<ffffffff81297845>] ? tcp_established_options+0x2d/0xa9
[87014.490014] [<ffffffff81299ed9>] ? tcp_retransmit_skb+0x4a1/0x5aa
[87014.490047] [<ffffffff8129b909>] ? tcp_write_timer+0x0/0x197
[87014.490078] [<ffffffff8129b40f>] ? tcp_retransmit_timer+0x46f/0x56b
[87014.490111] [<ffffffff8129b99f>] ? tcp_write_timer+0x96/0x197
[87014.490145] [<ffffffff8105b5ef>] ? run_timer_softirq+0x1c9/0x268
[87014.490180] [<ffffffff81054c9b>] ? __do_softirq+0xdd/0x1a6
[87014.490212] [<ffffffff81012cac>] ? call_softirq+0x1c/0x30
[87014.490244] [<ffffffff8101422b>] ? do_softirq+0x3f/0x7c
[87014.490277] [<ffffffff81054b0b>] ? irq_exit+0x36/0x76
[87014.490309] [<ffffffff811f2461>] ? xen_evtchn_do_upcall+0x33/0x42
[87014.490342] [<ffffffff81012cfe>] ? xen_do_hypervisor_callback+0x1e/0x30
[87014.490375] <EOI>
[87014.490401] [<ffffffff810093aa>] ? hypercall_page+0x3aa/0x1001
[87014.490433] [<ffffffff810093aa>] ? hypercall_page+0x3aa/0x1001
[87014.490466] [<ffffffff8100e6a7>] ? xen_safe_halt+0xc/0x15
[87014.490497] [<ffffffff8100bfc7>] ? xen_idle+0x37/0x40
[87014.490528] [<ffffffff81010eb1>] ? cpu_idle+0xa2/0xda
[87014.490559] [<ffffffff81509cdd>] ? start_kernel+0x3dc/0x3e8
[87014.490592] [<ffffffff8150bc93>] ? xen_start_kernel+0x586/0x58a
[87014.490622] Code: ff 41 8b 97 cc 00 00 00 49 03 9f d0 00 00 00 49 63 f4 49 63 cd 48 8b 7c 24 10 8b 54 13 10 48 01 d6 49 63 d6 48 29 d6 48 8d 34 30 <f3> a4 48 8b 44 24 08 ff 48 1c 44 29 ed 0f 84 a1 00 00 00 45 01
[87014.490920] RIP [<ffffffff81256860>] skb_copy_bits+0x114/0x1e0
[87014.490953] RSP <ffff880003430ba0>
[87014.490979] CR2: ffff88001db0b8e8
[87014.491191] ---[ end trace a7919e7f17c0a727 ]---
[87014.491244] Kernel panic - not syncing: Fatal exception in interrupt
[87014.491300] Pid: 0, comm: swapper Tainted: G D W 2.6.32-5-xen-amd64 #1
[87014.491357] Call Trace:
[87014.491404] <IRQ> [<ffffffff8130b58a>] ? panic+0x86/0x143
[87014.491491] [<ffffffff8100eccf>] ? xen_restore_fl_direct_end+0x0/0x1
[87014.491550] [<ffffffff811baf05>] ? vgacon_cursor+0x0/0x140
[87014.491606] [<ffffffff8100e629>] ? xen_force_evtchn_callback+0x9/0xa
[87014.491663] [<ffffffff8100ece2>] ? check_events+0x12/0x20
[87014.491718] [<ffffffff811baf05>] ? vgacon_cursor+0x0/0x140
[87014.491775] [<ffffffff8130d42a>] ? _spin_unlock_irqrestore+0xd/0xe
[87014.491832] [<ffffffff8130e2c5>] ? oops_end+0xa7/0xb4
[87014.491887] [<ffffffff810333a4>] ? no_context+0x1e9/0x1f8
[87014.491942] [<ffffffff810547f1>] ? _local_bh_enable_ip+0x22/0x8f
[87014.492002] [<ffffffffa044eace>] ? ipt_do_table+0x5ee/0x620 [ip_tables]
[87014.492013] [<ffffffff81033559>] ? __bad_area_nosemaphore+0x1a6/0x1ca
[87014.492013] [<ffffffffa044eace>] ? ipt_do_table+0x5ee/0x620 [ip_tables]
[87014.492013] [<ffffffff8100c369>] ? __raw_callee_save_xen_pmd_val+0x11/0x1e
[87014.492013] [<ffffffff81032cc7>] ? spurious_fault+0x12c/0x1c4
[87014.492013] [<ffffffff8130f68f>] ? do_page_fault+0x69/0x2fc
[87014.492013] [<ffffffff8130d7a5>] ? page_fault+0x25/0x30
[87014.492013] [<ffffffff81256860>] ? skb_copy_bits+0x114/0x1e0
[87014.492013] [<ffffffff8125848a>] ? __pskb_pull_tail+0x81/0x28f
[87014.492013] [<ffffffff81288048>] ? ip_finish_output+0x0/0x64
[87014.492013] [<ffffffff812603ff>] ? dev_queue_xmit+0xae/0x38d
[87014.492013] [<ffffffff81287c45>] ? ip_queue_xmit+0x311/0x386
[87014.492013] [<ffffffff8102ddcc>] ? pvclock_clocksource_read+0x3a/0x8b
[87014.492013] [<ffffffff812aa0b1>] ? inet_sk_rebuild_header+0x30/0x358
[87014.492013] [<ffffffff81067029>] ? run_posix_cpu_timers+0x25/0x6ea
[87014.492013] [<ffffffff8100ece2>] ? check_events+0x12/0x20
[87014.492013] [<ffffffff812985f7>] ? tcp_transmit_skb+0x648/0x687
[87014.492013] [<ffffffff81297845>] ? tcp_established_options+0x2d/0xa9
[87014.492013] [<ffffffff81299ed9>] ? tcp_retransmit_skb+0x4a1/0x5aa
[87014.492013] [<ffffffff8129b909>] ? tcp_write_timer+0x0/0x197
[87014.492013] [<ffffffff8129b40f>] ? tcp_retransmit_timer+0x46f/0x56b
[87014.492013] [<ffffffff8129b99f>] ? tcp_write_timer+0x96/0x197
[87014.492013] [<ffffffff8105b5ef>] ? run_timer_softirq+0x1c9/0x268
[87014.492013] [<ffffffff81054c9b>] ? __do_softirq+0xdd/0x1a6
[87014.492013] [<ffffffff81012cac>] ? call_softirq+0x1c/0x30
[87014.492013] [<ffffffff8101422b>] ? do_softirq+0x3f/0x7c
[87014.492013] [<ffffffff81054b0b>] ? irq_exit+0x36/0x76
[87014.492013] [<ffffffff811f2461>] ? xen_evtchn_do_upcall+0x33/0x42
[87014.492013] [<ffffffff81012cfe>] ? xen_do_hypervisor_callback+0x1e/0x30
[87014.492013] <EOI> [<ffffffff810093aa>] ? hypercall_page+0x3aa/0x1001
[87014.492013] [<ffffffff810093aa>] ? hypercall_page+0x3aa/0x1001
[87014.492013] [<ffffffff8100e6a7>] ? xen_safe_halt+0xc/0x15
[87014.492013] [<ffffffff8100bfc7>] ? xen_idle+0x37/0x40
[87014.492013] [<ffffffff81010eb1>] ? cpu_idle+0xa2/0xda
[87014.492013] [<ffffffff81509cdd>] ? start_kernel+0x3dc/0x3e8
[87014.492013] [<ffffffff8150bc93>] ? xen_start_kernel+0x586/0x58a
(XEN) Domain 0 crashed: 'noreboot' set - not rebooting.

[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.32-5-xen-amd64 (Debian 2.6.32-35) (dannf@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Tue Jun 14 12:46:30 UTC 2011
[ 0.000000] Command line: placeholder root=UUID=c58fb6ad-2362-4a99-9f86-046b7345328f ro console=tty0 console=hvc0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] released 0 pages of unused memory
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] Xen: 0000000000000000 - 000000000009d800 (usable)
[ 0.000000] Xen: 000000000009d800 - 0000000000100000 (reserved)
[ 0.000000] Xen: 0000000000100000 - 0000000020000000 (usable)
[ 0.000000] Xen: 00000000dffce000 - 00000000dffd0000 type 9
[ 0.000000] Xen: 00000000dffd0000 - 00000000dffde000 (ACPI data)
[ 0.000000] Xen: 00000000dffde000 - 00000000e0000000 (ACPI NVS)
[ 0.000000] Xen: 00000000fec00000 - 00000000fec01000 (reserved)
[ 0.000000] Xen: 00000000fee00000 - 00000000fef00000 (reserved)
[ 0.000000] Xen: 00000000ff700000 - 0000000100000000 (reserved)
[ 0.000000] DMI present.
[ 0.000000] AMI BIOS detected: BIOS may corrupt low RAM, working around it.
[ 0.000000] e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
[ 0.000000] last_pfn = 0x20000 max_arch_pfn = 0x400000000
[ 0.000000] x86 PAT enabled: cpu 0, old 0x50100070406, new 0x7010600070106
[ 0.000000] initial memory mapped : 0 - 20000000
[ 0.000000] init_memory_mapping: 0000000000000000-0000000020000000
[ 0.000000] 0000000000 - 0020000000 page 4k
[ 0.000000] kernel direct mapping tables up to 20000000 @ 100000-202000
[ 0.000000] RAMDISK: 016ba000 - 032d6400
[ 0.000000] ACPI: RSDP 00000000000f9430 00024 (v02 ACPIAM)
[ 0.000000] ACPI: XSDT 00000000dffd0100 00054 (v01 S M C OEMXSDT 12000829 MSFT 00000097)
[ 0.000000] ACPI: FACP 00000000dffd0290 000F4 (v03 S M C OEMFACP 12000829 MSFT 00000097)
[ 0.000000] ACPI: DSDT 00000000dffd0470 04CA9 (v01 H8DMU H8DMU000 00000000 INTL 20051117)
[ 0.000000] ACPI: FACS 00000000dffde000 00040
[ 0.000000] ACPI: APIC 00000000dffd0390 000A0 (v01 S M C OEMAPIC 12000829 MSFT 00000097)
[ 0.000000] ACPI: MCFG 00000000dffd0430 0003C (v01 S M C OEMMCFG 12000829 MSFT 00000097)
[ 0.000000] ACPI: OEMB 00000000dffde040 00091 (v01 S M C SMC_OEM 12000829 MSFT 00000097)
[ 0.000000] ACPI: SRAT 00000000dffd5120 00150 (v01 AMD FAM_F_10 00000002 AMD 00000001)
[ 0.000000] ACPI: HPET 00000000dffd5270 00038 (v01 S M C OEMHPET0 12000829 MSFT 00000097)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] Scanning NUMA topology in Northbridge 24
[ 0.000000] Number of nodes 2
[ 0.000000] Node 0 MemBase 0000000000000000 Limit 0000000020000000
[ 0.000000] Node 1 bogus settings 420000000-20000000.
[ 0.000000] NUMA: Using 63 for the hash shift.
[ 0.000000] Using node hash shift of 63
[ 0.000000] found SMP MP-table at [ffff8800000ff780] ff780
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] Bootmem setup node 0 0000000000000000-0000000020000000
[ 0.000000] NODE_DATA [0000000000010000 - 0000000000017fff]
[ 0.000000] bootmap [0000000000018000 - 000000000001bfff] pages 4
[ 0.000000] (8 early reservations) ==> bootmem [0000000000 - 0020000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
[ 0.000000] #1 [00033d8000 - 00033f7000] XEN PAGETABLES ==> [00033d8000 - 00033f7000]
[ 0.000000] #2 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
[ 0.000000] #3 [0001000000 - 00016999d4] TEXT DATA BSS ==> [0001000000 - 00016999d4]
[ 0.000000] #4 [00016ba000 - 00032d6400] RAMDISK ==> [00016ba000 - 00032d6400]
[ 0.000000] #5 [00032d7000 - 00033d8000] XEN START INFO ==> [00032d7000 - 00033d8000]
[ 0.000000] #6 [000169a000 - 000169a1ac] BRK ==> [000169a000 - 000169a1ac]
[ 0.000000] #7 [0000100000 - 00001e0000] PGTABLE ==> [0000100000 - 00001e0000]
[ 0.000000] found SMP MP-table at [ffff8800000ff780] ff780
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000010 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00100000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[2] active PFN ranges
[ 0.000000] 0: 0x00000010 -> 0x0000009d
[ 0.000000] 0: 0x00000100 -> 0x00020000
[ 0.000000] On node 0 totalpages: 130957
[ 0.000000] DMA zone: 56 pages used for memmap
[ 0.000000] DMA zone: 227 pages reserved
[ 0.000000] DMA zone: 3698 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 1736 pages used for memmap
[ 0.000000] DMA32 zone: 125240 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x2008
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x06] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)
[ 0.000000] ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 8, version 0, address 0xfec00000, GSI 0-0
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ERROR: Unable to locate IOAPIC for GSI 2
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ERROR: Unable to locate IOAPIC for GSI 9
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
[ 0.000000] ERROR: Unable to locate IOAPIC for GSI 14
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
[ 0.000000] ERROR: Unable to locate IOAPIC for GSI 15
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x10de8201 base: 0xfed00000
[ 0.000000] SMP: Allowing 8 CPUs, 0 hotplug CPUs
[ 0.000000] nr_irqs_gsi: 256
[ 0.000000] PM: Registered nosave memory: 000000000009d000 - 000000000009e000
[ 0.000000] PM: Registered nosave memory: 000000000009e000 - 0000000000100000
[ 0.000000] Allocating PCI resources starting at 20000000 (gap: 20000000:bffce000)
[ 0.000000] Booting paravirtualized kernel on Xen
[ 0.000000] Xen version: 4.0.1 (preserve-AD) (dom0)
[ 0.000000] NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 30 pages/cpu @ffff88000342d000 s90328 r8192 d24360 u122880
[ 0.000000] pcpu-alloc: s90328 r8192 d24360 u122880 alloc=30*4096
[ 0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7
[ 0.000000] trying to map vcpu_info 0 at ffff880003438020, mfn 41b438, offset 32
[ 0.000000] cpu 0 using vcpu_info at ffff880003438020
[ 0.000000] trying to map vcpu_info 1 at ffff880003456020, mfn 41b456, offset 32
[ 0.000000] cpu 1 using vcpu_info at ffff880003456020
[ 0.000000] trying to map vcpu_info 2 at ffff880003474020, mfn 41b474, offset 32
[ 0.000000] cpu 2 using vcpu_info at ffff880003474020
[ 0.000000] trying to map vcpu_info 3 at ffff880003492020, mfn 41b492, offset 32
[ 0.000000] cpu 3 using vcpu_info at ffff880003492020
[ 0.000000] trying to map vcpu_info 4 at ffff8800034b0020, mfn 41b4b0, offset 32
[ 0.000000] cpu 4 using vcpu_info at ffff8800034b0020
[ 0.000000] trying to map vcpu_info 5 at ffff8800034ce020, mfn 41b4ce, offset 32
[ 0.000000] cpu 5 using vcpu_info at ffff8800034ce020
[ 0.000000] trying to map vcpu_info 6 at ffff8800034ec020, mfn 41b4ec, offset 32
[ 0.000000] cpu 6 using vcpu_info at ffff8800034ec020
[ 0.000000] trying to map vcpu_info 7 at ffff88000350a020, mfn 41b50a, offset 32
[ 0.000000] cpu 7 using vcpu_info at ffff88000350a020
[ 0.000000] Xen: using vcpu_info placement
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 128938
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: placeholder root=UUID=c58fb6ad-2362-4a99-9f86-046b7345328f ro console=tty0 console=hvc0
[ 0.000000] PID hash table entries: 2048 (order: 2, 16384 bytes)
[ 0.000000] Initializing CPU#0
[ 0.000000] DMA: Placing 64MB software IO TLB between ffff880003efe000 - ffff880007efe000
[ 0.000000] DMA: software IO TLB at phys 0x3efe000 - 0x7efe000
[ 0.000000] xen_swiotlb_fixup: buf=ffff880003efe000 size=67108864
[ 0.000000] xen_swiotlb_fixup: buf=ffff880007f5e000 size=32768
[ 0.000000] Memory: 411832k/524288k available (3149k kernel code, 460k absent, 111996k reserved, 1906k data, 604k init)
[ 0.000000] SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] NR_IRQS:4352 nr_irqs:2304
[ 0.000000] xen: --> irq=0
[ 0.000000] xen: --> irq=1
[ 0.000000] xen: --> irq=2
[ 0.000000] xen: --> irq=3
[ 0.000000] xen: --> irq=4
[ 0.000000] xen: --> irq=5
[ 0.000000] xen: --> irq=6
[ 0.000000] xen: --> irq=7
[ 0.000000] xen: --> irq=8
[ 0.000000] xen: --> irq=9
[ 0.000000] xen: --> irq=10
[ 0.000000] xen: --> irq=11
[ 0.000000] xen: --> irq=12
[ 0.000000] xen: --> irq=13
[ 0.000000] xen: --> irq=14
[ 0.000000] xen: --> irq=15
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] xen: sci override: source_irq=9 global_irq=9 trigger=c polarity=1
[ 0.000000] xen: registering gsi 9 triggering 0 polarity 0
[ 0.000000] xen_allocate_pirq: returning irq 9 for gsi 9
[ 0.000000] xen: --> irq=9
[ 0.000000] xen: acpi sci 9
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] console [hvc0] enabled
[ 0.000000] Xen: using vcpuop timer interface
[ 0.000000] installing Xen timer for CPU 0
[ 0.000000] alloc irq_desc for 2303 on node -1
[ 0.000000] alloc kstat_irqs on node -1
[ 0.000000] Detected 2563790.632 MHz processor.
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4824.82 BogoMIPS (lpj=9649648)
[ 0.004000] Security Framework initialized
[ 0.004000] SELinux: Disabled at boot.
[ 0.004081] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.004447] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.004634] Mount-cache hash table entries: 256
[ 0.004837] Initializing cgroup subsys ns
[ 0.004893] Initializing cgroup subsys cpuacct
[ 0.004948] Initializing cgroup subsys devices
[ 0.005003] Initializing cgroup subsys freezer
[ 0.005057] Initializing cgroup subsys net_cls
[ 0.005138] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.005198] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.005253] CPU 0/0x0 -> Node 0
[ 0.005305] tseg: 0000000000
[ 0.005314] CPU: Physical Processor ID: 0
[ 0.005365] CPU: Processor Core ID: 0
[ 0.005419] mce: CPU supports 6 MCE banks
[ 0.005484] Performance Events: AMD PMU driver.
[ 0.005568] ------------[ cut here ]------------
[ 0.005627] WARNING: at /build/buildd-linux-2.6_2.6.32-35-amd64-aZSlKL/linux-2.6-2.6.32/debian/build/source_amd64_xen/arch/x86/xen/enlighten.c:726 init_hw_perf_events+0x32d/0x3cd()
[ 0.005733] Hardware name: H8DMU
[ 0.005783] Modules linked in:
[ 0.005864] Pid: 0, comm: swapper Not tainted 2.6.32-5-xen-amd64 #1
[ 0.005921] Call Trace:
[ 0.005973] [<ffffffff81510efc>] ? init_hw_perf_events+0x32d/0x3cd
[ 0.006032] [<ffffffff81510efc>] ? init_hw_perf_events+0x32d/0x3cd
[ 0.006093] [<ffffffff8104ef00>] ? warn_slowpath_common+0x77/0xa3
[ 0.006151] [<ffffffff81510efc>] ? init_hw_perf_events+0x32d/0x3cd
[ 0.006210] [<ffffffff813044dc>] ? identify_cpu+0x2f7/0x300
[ 0.006270] [<ffffffff8100eccf>] ? xen_restore_fl_direct_end+0x0/0x1
[ 0.006329] [<ffffffff810e81d5>] ? kmem_cache_alloc+0x8c/0xf0
[ 0.006387] [<ffffffff81510a16>] ? identify_boot_cpu+0x15/0x3e
[ 0.006444] [<ffffffff81510baa>] ? check_bugs+0x9/0x2e
[ 0.006505] [<ffffffff81509cce>] ? start_kernel+0x3cd/0x3e8
[ 0.006563] [<ffffffff8150bc93>] ? xen_start_kernel+0x586/0x58a
[ 0.006624] ---[ end trace a7919e7f17c0a725 ]---
[ 0.006678] ... version: 0
[ 0.006730] ... bit width: 48
[ 0.006782] ... generic registers: 4
[ 0.006834] ... value mask: 0000ffffffffffff
[ 0.006889] ... max period: 00007fffffffffff
[ 0.006945] ... fixed-purpose events: 0
[ 0.006997] ... event mask: 000000000000000f
[ 0.007064] SMP alternatives: switching to UP code
[ 0.008000] ACPI: Core revision 20090903
[ 0.015160] alloc irq_desc for 2302 on node -1
[ 0.015162] alloc kstat_irqs on node -1
[ 0.015170] alloc irq_desc for 2301 on node -1
[ 0.015172] alloc kstat_irqs on node -1
[ 0.015177] alloc irq_desc for 2300 on node -1
[ 0.015178] alloc kstat_irqs on node -1
[ 0.015182] alloc irq_desc for 2299 on node -1
[ 0.015184] alloc kstat_irqs on node -1
[ 0.015418] installing Xen timer for CPU 1
[ 0.015476] alloc irq_desc for 2298 on node -1
[ 0.015478] alloc kstat_irqs on node -1
[ 0.015512] SMP alternatives: switching to SMP code
[ 0.020000] alloc irq_desc for 2297 on node -1
[ 0.020000] alloc kstat_irqs on node -1
[ 0.020006] alloc irq_desc for 2296 on node -1
[ 0.020008] alloc kstat_irqs on node -1
[ 0.020013] alloc irq_desc for 2295 on node -1
[ 0.020015] alloc kstat_irqs on node -1
[ 0.020019] alloc irq_desc for 2294 on node -1
[ 0.020021] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#1
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 1/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 0
[ 0.004000] CPU: Processor Core ID: 1
[ 0.020201] installing Xen timer for CPU 2
[ 0.020564] alloc irq_desc for 2293 on node -1
[ 0.020566] alloc kstat_irqs on node -1
[ 0.020596] alloc irq_desc for 2292 on node -1
[ 0.020599] alloc kstat_irqs on node -1
[ 0.020604] alloc irq_desc for 2291 on node -1
[ 0.020606] alloc kstat_irqs on node -1
[ 0.020610] alloc irq_desc for 2290 on node -1
[ 0.020612] alloc kstat_irqs on node -1
[ 0.020616] alloc irq_desc for 2289 on node -1
[ 0.020618] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#2
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 2/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 0
[ 0.004000] CPU: Processor Core ID: 2
[ 0.020788] installing Xen timer for CPU 3
[ 0.021154] alloc irq_desc for 2288 on node -1
[ 0.021156] alloc kstat_irqs on node -1
[ 0.021180] alloc irq_desc for 2287 on node -1
[ 0.021182] alloc kstat_irqs on node -1
[ 0.021187] alloc irq_desc for 2286 on node -1
[ 0.021189] alloc kstat_irqs on node -1
[ 0.021193] alloc irq_desc for 2285 on node -1
[ 0.021195] alloc kstat_irqs on node -1
[ 0.021199] alloc irq_desc for 2284 on node -1
[ 0.021201] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#3
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 3/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 0
[ 0.004000] CPU: Processor Core ID: 3
[ 0.021364] installing Xen timer for CPU 4
[ 0.021727] alloc irq_desc for 2283 on node -1
[ 0.021729] alloc kstat_irqs on node -1
[ 0.021753] alloc irq_desc for 2282 on node -1
[ 0.021755] alloc kstat_irqs on node -1
[ 0.021760] alloc irq_desc for 2281 on node -1
[ 0.021762] alloc kstat_irqs on node -1
[ 0.021766] alloc irq_desc for 2280 on node -1
[ 0.021768] alloc kstat_irqs on node -1
[ 0.021772] alloc irq_desc for 2279 on node -1
[ 0.021774] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#4
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 4/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 1
[ 0.004000] CPU: Processor Core ID: 0
[ 0.022000] installing Xen timer for CPU 5
[ 0.022365] alloc irq_desc for 2278 on node -1
[ 0.022367] alloc kstat_irqs on node -1
[ 0.022390] alloc irq_desc for 2277 on node -1
[ 0.022392] alloc kstat_irqs on node -1
[ 0.022400] alloc irq_desc for 2276 on node -1
[ 0.022402] alloc kstat_irqs on node -1
[ 0.022406] alloc irq_desc for 2275 on node -1
[ 0.022408] alloc kstat_irqs on node -1
[ 0.022412] alloc irq_desc for 2274 on node -1
[ 0.022414] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#5
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 5/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 1
[ 0.004000] CPU: Processor Core ID: 1
[ 0.022639] installing Xen timer for CPU 6
[ 0.023020] alloc irq_desc for 2273 on node -1
[ 0.023022] alloc kstat_irqs on node -1
[ 0.023045] alloc irq_desc for 2272 on node -1
[ 0.023047] alloc kstat_irqs on node -1
[ 0.023053] alloc irq_desc for 2271 on node -1
[ 0.023054] alloc kstat_irqs on node -1
[ 0.023061] alloc irq_desc for 2270 on node -1
[ 0.023063] alloc kstat_irqs on node -1
[ 0.023067] alloc irq_desc for 2269 on node -1
[ 0.023069] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#6
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 6/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 1
[ 0.004000] CPU: Processor Core ID: 2
[ 0.023264] installing Xen timer for CPU 7
[ 0.023629] alloc irq_desc for 2268 on node -1
[ 0.023631] alloc kstat_irqs on node -1
[ 0.023654] alloc irq_desc for 2267 on node -1
[ 0.023656] alloc kstat_irqs on node -1
[ 0.023662] alloc irq_desc for 2266 on node -1
[ 0.023663] alloc kstat_irqs on node -1
[ 0.023668] alloc irq_desc for 2265 on node -1
[ 0.023670] alloc kstat_irqs on node -1
[ 0.023674] alloc irq_desc for 2264 on node -1
[ 0.023676] alloc kstat_irqs on node -1
[ 0.004000] Initializing CPU#7
[ 0.004000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.004000] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.004000] CPU 7/0x0 -> Node 0
[ 0.004000] CPU: Physical Processor ID: 1
[ 0.004000] CPU: Processor Core ID: 3
[ 0.023834] Brought up 8 CPUs
[ 0.024001] CPU0 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 0 1 2 3 4 5 6 7
[ 0.024001] CPU1 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 1 2 3 4 5 6 7 0
[ 0.024001] CPU2 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 2 3 4 5 6 7 0 1
[ 0.024001] CPU3 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 3 4 5 6 7 0 1 2
[ 0.024001] CPU4 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 4 5 6 7 0 1 2 3
[ 0.024001] CPU5 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 5 6 7 0 1 2 3 4
[ 0.024001] CPU6 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 6 7 0 1 2 3 4 5
[ 0.024001] CPU7 attaching sched-domain:
[ 0.024001] domain 0: span 0-7 level CPU
[ 0.024001] groups: 7 0 1 2 3 4 5 6
[ 0.024039] devtmpfs: initialized
[ 0.026540] Grant table initialized
[ 0.026540] regulator: core version 0.5
[ 0.026540] NET: Registered protocol family 16
[ 0.026540] alloc irq_desc for 2263 on node -1
[ 0.026540] alloc kstat_irqs on node -1
[ 0.026540] node 0 link 2: io port [1000, ffffff]
[ 0.026540] TOM: 00000000e0000000 aka 3584M
[ 0.026540] Fam 10h mmconf [e0000000, efffffff]
[ 0.026540] node 0 link 2: mmio [e0000000, efffffff] ==> none
[ 0.026540] node 0 link 2: mmio [f0000000, ffe0ffff]
[ 0.026540] node 0 link 2: mmio [a0000, bffff]
[ 0.026540] TOM2: 0000000820000000 aka 33280M
[ 0.026540] bus: [00,7f] on node 0 link 2
[ 0.026540] bus: 00 index 0 io port: [0, ffff]
[ 0.026540] bus: 00 index 1 mmio: [f0000000, ffffffff]
[ 0.026540] bus: 00 index 2 mmio: [a0000, bffff]
[ 0.026540] bus: 00 index 3 mmio: [820000000, fcffffffff]
[ 0.026540] ACPI: bus type pci registered
[ 0.026540] sync cpu 0 get result 1 max_id 7
[ 0.026540] sync cpu 1 get result 1 max_id 7
[ 0.026540] sync cpu 2 get result 1 max_id 7
[ 0.026540] sync cpu 3 get result 1 max_id 7
[ 0.026540] sync cpu 4 get result 1 max_id 7
[ 0.026540] sync cpu 5 get result 1 max_id 7
[ 0.026540] sync cpu 6 get result 1 max_id 7
[ 0.026540] sync cpu 7 get result 1 max_id 7
[ 0.026540] alloc irq_desc for 2262 on node -1
[ 0.026540] alloc kstat_irqs on node -1
[ 0.028069] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[ 0.028129] PCI: Not using MMCONFIG.
[ 0.028182] PCI: Using configuration type 1 for base access
[ 0.028239] PCI: Using configuration type 1 for extended access
[ 0.028685] bio: create slab <bio-0> at 0
[ 0.029031] ERROR: Unable to locate IOAPIC for GSI 9
[ 0.029116] ACPI: EC: Look up EC in DSDT
[ 0.034148] ACPI Warning for \_SB_._OSC: Return type mismatch - found Integer, expected Buffer (20090903/nspredef-1006)
[ 0.034295] \_SB_:_OSC evaluation returned wrong type
[ 0.034297] _OSC request data:1 7
[ 0.035274] ACPI: Executed 1 blocks of module-level executable AML code
[ 0.042252] ACPI: Interpreter enabled
[ 0.042306] ACPI: (supports S0 S1 S4 S5)
[ 0.042498] ACPI: Using IOAPIC for interrupt routing
[ 0.042604] PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
[ 0.048288] PCI: MCFG area at e0000000 reserved in ACPI motherboard resources
[ 0.089119] PCI: Using MMCONFIG at e0000000 - efffffff
[ 0.099089] ACPI Warning: Incorrect checksum in table [OEMB] - A7, should be A4 (20090903/tbutils-314)
[ 0.099452] ACPI: No dock devices found.
[ 0.099818] ACPI: PCI Root Bridge [PCI0] (0000:00)
[ 0.100041] pci 0000:00:01.1: reg 10 io port: [0xdc00-0xdc3f]
[ 0.100064] pci 0000:00:01.1: reg 20 io port: [0x2d00-0x2d3f]
[ 0.100072] pci 0000:00:01.1: reg 24 io port: [0x2e00-0x2e3f]
[ 0.100104] pci 0000:00:01.1: PME# supported from D3hot D3cold
[ 0.100167] pci 0000:00:01.1: PME# disabled
[ 0.100264] pci 0000:00:02.0: reg 10 32bit mmio: [0xfe8fb000-0xfe8fbfff]
[ 0.100313] pci 0000:00:02.0: supports D1 D2
[ 0.100315] pci 0000:00:02.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.100386] pci 0000:00:02.0: PME# disabled
[ 0.100477] pci 0000:00:02.1: reg 10 32bit mmio: [0xfe8fac00-0xfe8facff]
[ 0.100527] pci 0000:00:02.1: supports D1 D2
[ 0.100529] pci 0000:00:02.1: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.100591] pci 0000:00:02.1: PME# disabled
[ 0.100702] pci 0000:00:04.0: reg 20 io port: [0xffa0-0xffaf]
[ 0.100861] pci 0000:00:08.0: reg 10 32bit mmio: [0xfe8f9000-0xfe8f9fff]
[ 0.100868] pci 0000:00:08.0: reg 14 io port: [0xd480-0xd487]
[ 0.100874] pci 0000:00:08.0: reg 18 32bit mmio: [0xfe8fa800-0xfe8fa8ff]
[ 0.100881] pci 0000:00:08.0: reg 1c 32bit mmio: [0xfe8fa400-0xfe8fa40f]
[ 0.100928] pci 0000:00:08.0: supports D1 D2
[ 0.100930] pci 0000:00:08.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.100992] pci 0000:00:08.0: PME# disabled
[ 0.101108] pci 0000:00:09.0: reg 10 32bit mmio: [0xfe8f8000-0xfe8f8fff]
[ 0.101115] pci 0000:00:09.0: reg 14 io port: [0xd400-0xd407]
[ 0.101122] pci 0000:00:09.0: reg 18 32bit mmio: [0xfe8fa000-0xfe8fa0ff]
[ 0.101130] pci 0000:00:09.0: reg 1c 32bit mmio: [0xfe8f7c00-0xfe8f7c0f]
[ 0.101176] pci 0000:00:09.0: supports D1 D2
[ 0.101178] pci 0000:00:09.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.101241] pci 0000:00:09.0: PME# disabled
[ 0.101389] pci 0000:00:0a.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.101449] pci 0000:00:0a.0: PME# disabled
[ 0.101599] pci 0000:00:0b.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.101660] pci 0000:00:0b.0: PME# disabled
[ 0.101814] pci 0000:00:0c.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.101874] pci 0000:00:0c.0: PME# disabled
[ 0.102022] pci 0000:00:0d.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.102082] pci 0000:00:0d.0: PME# disabled
[ 0.102231] pci 0000:00:0e.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.102291] pci 0000:00:0e.0: PME# disabled
[ 0.102439] pci 0000:00:0f.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 0.102499] pci 0000:00:0f.0: PME# disabled
[ 0.103121] pci 0000:01:05.0: reg 10 32bit mmio pref: [0xf0000000-0xf7ffffff]
[ 0.103130] pci 0000:01:05.0: reg 14 io port: [0xe000-0xe0ff]
[ 0.103138] pci 0000:01:05.0: reg 18 32bit mmio: [0xfe9f0000-0xfe9fffff]
[ 0.103162] pci 0000:01:05.0: reg 30 32bit mmio pref: [0xfe9c0000-0xfe9dffff]
[ 0.103184] pci 0000:01:05.0: supports D1 D2
[ 0.103233] pci 0000:00:06.0: transparent bridge
[ 0.103289] pci 0000:00:06.0: bridge io port: [0xe000-0xefff]
[ 0.103294] pci 0000:00:06.0: bridge 32bit mmio: [0xfe900000-0xfe9fffff]
[ 0.103298] pci 0000:00:06.0: bridge 32bit mmio pref: [0xf0000000-0xf7ffffff]
[ 0.103644] pci 0000:07:00.0: reg 10 32bit mmio: [0xfeae0000-0xfeafffff]
[ 0.103695] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold
[ 0.103755] pci 0000:07:00.0: PME# disabled
[ 0.108104] pci 0000:00:0f.0: bridge 32bit mmio: [0xfea00000-0xfebfffff]
[ 0.108112] pci 0000:00:0f.0: bridge 64bit mmio pref: [0xfdc00000-0xfdffffff]
[ 0.108213] pci 0000:08:01.0: PME# supported from D0 D3hot D3cold
[ 0.108275] pci 0000:08:01.0: PME# disabled
[ 0.108449] pci 0000:08:08.0: PME# supported from D0 D3hot D3cold
[ 0.108512] pci 0000:08:08.0: PME# disabled
[ 0.108684] pci 0000:08:09.0: PME# supported from D0 D3hot D3cold
[ 0.108744] pci 0000:08:09.0: PME# disabled
[ 0.108881] pci 0000:07:00.0: bridge 32bit mmio: [0xfeb00000-0xfebfffff]
[ 0.108888] pci 0000:07:00.0: bridge 64bit mmio pref: [0xfdc00000-0xfdffffff]
[ 0.109035] pci 0000:0a:00.0: PME# supported from D0 D3hot D3cold
[ 0.109095] pci 0000:0a:00.0: PME# disabled
[ 0.109240] pci 0000:0a:00.2: PME# supported from D0 D3hot D3cold
[ 0.109301] pci 0000:0a:00.2: PME# disabled
[ 0.109383] pci 0000:0a:00.0: disabling ASPM on pre-1.1 PCIe device. You can enable it with 'pcie_aspm=force'
[ 0.109550] pci 0000:08:08.0: bridge 32bit mmio: [0xfeb00000-0xfebfffff]
[ 0.109557] pci 0000:08:08.0: bridge 64bit mmio pref: [0xfdc00000-0xfdffffff]
[ 0.109648] pci 0000:0b:0e.0: reg 10 32bit mmio: [0xfebff000-0xfebfffff]
[ 0.109665] pci 0000:0b:0e.0: reg 18 32bit mmio pref: [0xfdc00000-0xfdffffff]
[ 0.109695] pci 0000:0b:0e.0: reg 30 32bit mmio pref: [0xfebe0000-0xfebeffff]
[ 0.109735] pci 0000:0b:0e.0: supports D1
[ 0.109799] pci 0000:0a:00.0: bridge 32bit mmio: [0xfeb00000-0xfebfffff]
[ 0.109808] pci 0000:0a:00.0: bridge 64bit mmio pref: [0xfdc00000-0xfdffffff]
[ 0.110017] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[ 0.110312] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P1._PRT]
[ 0.110379] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.BR10._PRT]
[ 0.110448] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.BR11._PRT]
[ 0.110516] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.BR12._PRT]
[ 0.110584] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.BR15._PRT]
[ 0.124506] ACPI: PCI Interrupt Link [LNKA] (IRQs 16 17 18 19) *5
[ 0.124987] ACPI: PCI Interrupt Link [LNKB] (IRQs 16 17 18 19) *0, disabled.
[ 0.125493] ACPI: PCI Interrupt Link [LNKC] (IRQs 16 17 18 19) *0, disabled.
[ 0.125998] ACPI: PCI Interrupt Link [LNKD] (IRQs 16 17 18 19) *0, disabled.
[ 0.126511] ACPI: PCI Interrupt Link [LNEA] (IRQs 16 17 18 19) *0, disabled.
[ 0.127013] ACPI: PCI Interrupt Link [LNEB] (IRQs 16 17 18 19) *10
[ 0.127484] ACPI: PCI Interrupt Link [LNEC] (IRQs 16 17 18 19) *11
[ 0.127953] ACPI: PCI Interrupt Link [LNED] (IRQs 16 17 18 19) *11
[ 0.128180] ACPI: PCI Interrupt Link [LUB0] (IRQs 20 21 22 23) *11
[ 0.128665] ACPI: PCI Interrupt Link [LMAD] (IRQs 20 21 22 23) *10
[ 0.129137] ACPI: PCI Interrupt Link [LUB2] (IRQs 20 21 22 23) *5
[ 0.129606] ACPI: PCI Interrupt Link [LMAC] (IRQs 20 21 22 23) *10
[ 0.130086] ACPI: PCI Interrupt Link [LAZA] (IRQs 20 21 22 23) *0, disabled.
[ 0.130591] ACPI: PCI Interrupt Link [LSMB] (IRQs 20 21 22 23) *7
[ 0.131066] ACPI: PCI Interrupt Link [LPMU] (IRQs 20 21 22 23) *10
[ 0.131535] ACPI: PCI Interrupt Link [LSA0] (IRQs 20 21 22 23) *0, disabled.
[ 0.132042] ACPI: PCI Interrupt Link [LSA1] (IRQs 20 21 22 23) *0, disabled.
[ 0.132580] ACPI: PCI Interrupt Link [LATA] (IRQs 20 21 22 23) *0, disabled.
[ 0.133087] ACPI: PCI Interrupt Link [LSA2] (IRQs 20 21 22 23) *0, disabled.
[ 0.133462] xen_balloon: Initialising balloon driver with page order 0.
[ 0.133583] vgaarb: device added: PCI:0000:01:05.0,decodes=io+mem,owns=io+mem,locks= none
[ 0.133664] vgaarb: loaded
[ 0.133756] PCI: Using ACPI for IRQ routing
[ 0.133756] Switching to clocksource xen
[ 0.133756] pnp: PnP ACPI init
[ 0.133792] ACPI: bus type pnp registered
[ 0.134216] xen: registering gsi 8 triggering 1 polarity 0
[ 0.134220] xen_allocate_pirq: returning irq 8 for gsi 8
[ 0.134278] xen: --> irq=8
[ 0.134349] xen: registering gsi 13 triggering 1 polarity 0
[ 0.134352] xen_allocate_pirq: returning irq 13 for gsi 13
[ 0.134410] xen: --> irq=13
[ 0.135026] xen: registering gsi 4 triggering 1 polarity 0
[ 0.135028] xen_allocate_pirq: returning irq 4 for gsi 4
[ 0.135085] xen: --> irq=4
[ 0.135088] Already setup the GSI :4
[ 0.135826] xen: registering gsi 3 triggering 1 polarity 0
[ 0.135829] xen_allocate_pirq: returning irq 3 for gsi 3
[ 0.135887] xen: --> irq=3
[ 0.137958] xen: registering gsi 1 triggering 1 polarity 0
[ 0.137961] xen_allocate_pirq: returning irq 1 for gsi 1
[ 0.138019] xen: --> irq=1
[ 0.139941] pnp: PnP ACPI: found 14 devices
[ 0.139998] ACPI: ACPI bus type pnp unregistered
[ 0.140071] system 00:07: ioport range 0x4d0-0x4d1 has been reserved
[ 0.140133] system 00:07: ioport range 0x800-0x80f has been reserved
[ 0.140193] system 00:07: ioport range 0x2000-0x207f has been reserved
[ 0.140260] system 00:07: ioport range 0x2080-0x20ff has been reserved
[ 0.140321] system 00:07: ioport range 0x2400-0x247f has been reserved
[ 0.140382] system 00:07: ioport range 0x2480-0x24ff has been reserved
[ 0.140443] system 00:07: ioport range 0x2800-0x287f has been reserved
[ 0.140509] system 00:07: ioport range 0x2880-0x28ff has been reserved
[ 0.140570] system 00:07: ioport range 0x2c00-0x2c7f has been reserved
[ 0.140632] system 00:07: ioport range 0x2c80-0x2cff has been reserved
[ 0.140694] system 00:07: iomem range 0xfe880000-0xfe8bffff has been reserved
[ 0.140762] system 00:07: iomem range 0xfee01000-0xfeefffff has been reserved
[ 0.140828] system 00:09: iomem range 0xfec00000-0xfec00fff could not be reserved
[ 0.140906] system 00:09: iomem range 0xfee00000-0xfee00fff has been reserved
[ 0.140974] system 00:0b: ioport range 0x290-0x29f has been reserved
[ 0.141037] system 00:0c: iomem range 0xe0000000-0xefffffff has been reserved
[ 0.141103] system 00:0d: iomem range 0x0-0x9ffff could not be reserved
[ 0.141164] system 00:0d: iomem range 0xc0000-0xcffff could not be reserved
[ 0.141227] system 00:0d: iomem range 0xe0000-0xfffff could not be reserved
[ 0.141289] system 00:0d: iomem range 0x100000-0xdfffffff could not be reserved
[ 0.141366] system 00:0d: iomem range 0xfec00000-0xffffffff could not be reserved
[ 0.146878] PM-Timer failed consistency check (0x0xffffff) - aborting.
[ 0.146957] pci 0000:01:05.0: BAR 6: address space collision on of device [0xfe9c0000-0xfe9dffff]
[ 0.147154] pci 0000:00:06.0: PCI bridge, secondary bus 0000:01
[ 0.147214] pci 0000:00:06.0: IO window: 0xe000-0xefff
[ 0.147276] pci 0000:00:06.0: MEM window: 0xfe900000-0xfe9fffff
[ 0.147340] pci 0000:00:06.0: PREFETCH window: 0xf0000000-0xf7ffffff
[ 0.147432] pci 0000:00:0a.0: PCI bridge, secondary bus 0000:02
[ 0.147492] pci 0000:00:0a.0: IO window: disabled
[ 0.147553] pci 0000:00:0a.0: MEM window: disabled
[ 0.147612] pci 0000:00:0a.0: PREFETCH window: disabled
[ 0.147675] pci 0000:00:0b.0: PCI bridge, secondary bus 0000:03
[ 0.147734] pci 0000:00:0b.0: IO window: disabled
[ 0.147795] pci 0000:00:0b.0: MEM window: disabled
[ 0.147854] pci 0000:00:0b.0: PREFETCH window: disabled
[ 0.147917] pci 0000:00:0c.0: PCI bridge, secondary bus 0000:04
[ 0.147977] pci 0000:00:0c.0: IO window: disabled
[ 0.148037] pci 0000:00:0c.0: MEM window: disabled
[ 0.148097] pci 0000:00:0c.0: PREFETCH window: disabled
[ 0.148160] pci 0000:00:0d.0: PCI bridge, secondary bus 0000:05
[ 0.148218] pci 0000:00:0d.0: IO window: disabled
[ 0.148279] pci 0000:00:0d.0: MEM window: disabled
[ 0.148338] pci 0000:00:0d.0: PREFETCH window: disabled
[ 0.148401] pci 0000:00:0e.0: PCI bridge, secondary bus 0000:06
[ 0.148460] pci 0000:00:0e.0: IO window: disabled
[ 0.148527] pci 0000:00:0e.0: MEM window: disabled
[ 0.148587] pci 0000:00:0e.0: PREFETCH window: disabled
[ 0.148653] pci 0000:08:01.0: BAR 14: can't allocate mem resource [0xfec00000-0xfebfffff]
[ 0.148735] pci 0000:08:01.0: BAR 15: can't allocate mem resource [0xfe000000-0xfdffffff]
[ 0.148820] pci 0000:08:09.0: BAR 14: can't allocate mem resource [0xfec00000-0xfebfffff]
[ 0.148900] pci 0000:08:09.0: BAR 15: can't allocate mem resource [0xfe000000-0xfdffffff]
[ 0.148981] pci 0000:08:01.0: PCI bridge, secondary bus 0000:09
[ 0.149041] pci 0000:08:01.0: IO window: 0x3000-0x3fff
[ 0.149103] pci 0000:08:01.0: MEM window: disabled
[ 0.149163] pci 0000:08:01.0: PREFETCH window: disabled
[ 0.149229] pci 0000:0a:00.0: PCI bridge, secondary bus 0000:0b
[ 0.149288] pci 0000:0a:00.0: IO window: disabled
[ 0.149350] pci 0000:0a:00.0: MEM window: 0xfeb00000-0xfebfffff
[ 0.149413] pci 0000:0a:00.0: PREFETCH window: 0x000000fdc00000-0x000000fdffffff
[ 0.149499] pci 0000:0a:00.2: PCI bridge, secondary bus 0000:0c
[ 0.149561] pci 0000:0a:00.2: IO window: disabled
[ 0.149623] pci 0000:0a:00.2: MEM window: disabled
[ 0.149684] pci 0000:0a:00.2: PREFETCH window: disabled
[ 0.149751] pci 0000:08:08.0: PCI bridge, secondary bus 0000:0a
[ 0.149753] pci 0000:08:08.0: IO window: 0x4000-0x4fff
[ 0.149753] pci 0000:08:08.0: MEM window: 0xfeb00000-0xfebfffff
[ 0.149753] pci 0000:08:08.0: PREFETCH window: 0x000000fdc00000-0x000000fdffffff
[ 0.149753] pci 0000:08:09.0: PCI bridge, secondary bus 0000:0d
[ 0.149753] pci 0000:08:09.0: IO window: 0x5000-0x5fff
[ 0.149753] pci 0000:08:09.0: MEM window: disabled
[ 0.149753] pci 0000:08:09.0: PREFETCH window: disabled
[ 0.149753] pci 0000:07:00.0: PCI bridge, secondary bus 0000:08
[ 0.153531] pci 0000:07:00.0: IO window: 0x3000-0x5fff
[ 0.153531] pci 0000:07:00.0: MEM window: 0xfeb00000-0xfebfffff
[ 0.153531] pci 0000:07:00.0: PREFETCH window: 0x000000fdc00000-0x000000fdffffff
[ 0.153531] pci 0000:00:0f.0: PCI bridge, secondary bus 0000:07
[ 0.153531] pci 0000:00:0f.0: IO window: 0x3000-0x5fff
[ 0.153531] pci 0000:00:0f.0: MEM window: 0xfea00000-0xfebfffff
[ 0.153531] pci 0000:00:0f.0: PREFETCH window: 0x000000fdc00000-0x000000fdffffff
[ 0.156027] pci 0000:00:06.0: setting latency timer to 64
[ 0.156027] pci 0000:00:0a.0: setting latency timer to 64
[ 0.156027] pci 0000:00:0b.0: setting latency timer to 64
[ 0.156027] pci 0000:00:0c.0: setting latency timer to 64
[ 0.156027] pci 0000:00:0d.0: setting latency timer to 64
[ 0.156027] pci 0000:00:0e.0: setting latency timer to 64
[ 0.156027] pci 0000:00:0f.0: enabling device (0006 -> 0007)
[ 0.156027] pci 0000:00:0f.0: setting latency timer to 64
[ 0.156187] pci 0000:07:00.0: enabling device (0106 -> 0107)
[ 0.156579] ACPI: PCI Interrupt Link [LNEB] enabled at IRQ 19
[ 0.156638] xen: registering gsi 19 triggering 0 polarity 1
[ 0.156651] alloc irq_desc for 19 on node -1
[ 0.156653] alloc kstat_irqs on node -1
[ 0.156657] xen: --> irq=19
[ 0.156665] pci 0000:07:00.0: PCI INT A -> Link[LNEB] -> GSI 19 (level, low) -> IRQ 19
[ 0.156744] pci 0000:07:00.0: setting latency timer to 64
[ 0.156759] pci 0000:08:01.0: enabling device (0104 -> 0105)
[ 0.157115] ACPI: PCI Interrupt Link [LNEC] enabled at IRQ 18
[ 0.157172] xen: registering gsi 18 triggering 0 polarity 1
[ 0.157180] alloc irq_desc for 18 on node -1
[ 0.157182] alloc kstat_irqs on node -1
[ 0.157185] xen: --> irq=18
[ 0.157189] pci 0000:08:01.0: PCI INT A -> Link[LNEC] -> GSI 18 (level, low) -> IRQ 18
[ 0.157273] pci 0000:08:01.0: setting latency timer to 64
[ 0.157283] pci 0000:08:08.0: enabling device (0106 -> 0107)
[ 0.157341] xen: registering gsi 19 triggering 0 polarity 1
[ 0.157343] xen_allocate_pirq: returning irq 19 for gsi 19
[ 0.157398] xen: --> irq=19
[ 0.157400] Already setup the GSI :19
[ 0.157453] pci 0000:08:08.0: PCI INT A -> Link[LNEB] -> GSI 19 (level, low) -> IRQ 19
[ 0.157531] pci 0000:08:08.0: setting latency timer to 64
[ 0.157544] pci 0000:0a:00.0: setting latency timer to 64
[ 0.157558] pci 0000:0a:00.2: setting latency timer to 64
[ 0.157568] pci 0000:08:09.0: enabling device (0104 -> 0105)
[ 0.157625] xen: registering gsi 18 triggering 0 polarity 1
[ 0.157628] xen_allocate_pirq: returning irq 18 for gsi 18
[ 0.157682] xen: --> irq=18
[ 0.157684] Already setup the GSI :18
[ 0.157738] pci 0000:08:09.0: PCI INT A -> Link[LNEC] -> GSI 18 (level, low) -> IRQ 18
[ 0.157821] pci 0000:08:09.0: setting latency timer to 64
[ 0.157826] pci_bus 0000:00: resource 0 io: [0x00-0xffff]
[ 0.157829] pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff]
[ 0.157832] pci_bus 0000:01: resource 0 io: [0xe000-0xefff]
[ 0.157835] pci_bus 0000:01: resource 1 mem: [0xfe900000-0xfe9fffff]
[ 0.157838] pci_bus 0000:01: resource 2 pref mem [0xf0000000-0xf7ffffff]
[ 0.157840] pci_bus 0000:01: resource 3 io: [0x00-0xffff]
[ 0.157843] pci_bus 0000:01: resource 4 mem: [0x000000-0xffffffffffffffff]
[ 0.157847] pci_bus 0000:07: resource 0 io: [0x3000-0x5fff]
[ 0.157849] pci_bus 0000:07: resource 1 mem: [0xfea00000-0xfebfffff]
[ 0.157852] pci_bus 0000:07: resource 2 pref mem [0xfdc00000-0xfdffffff]
[ 0.157855] pci_bus 0000:08: resource 0 io: [0x3000-0x5fff]
[ 0.157857] pci_bus 0000:08: resource 1 mem: [0xfeb00000-0xfebfffff]
[ 0.157860] pci_bus 0000:08: resource 2 pref mem [0xfdc00000-0xfdffffff]
[ 0.157863] pci_bus 0000:09: resource 0 io: [0x3000-0x3fff]
[ 0.157865] pci_bus 0000:0a: resource 0 io: [0x4000-0x4fff]
[ 0.157868] pci_bus 0000:0a: resource 1 mem: [0xfeb00000-0xfebfffff]
[ 0.157870] pci_bus 0000:0a: resource 2 pref mem [0xfdc00000-0xfdffffff]
[ 0.157873] pci_bus 0000:0b: resource 1 mem: [0xfeb00000-0xfebfffff]
[ 0.157875] pci_bus 0000:0b: resource 2 pref mem [0xfdc00000-0xfdffffff]
[ 0.157878] pci_bus 0000:0d: resource 0 io: [0x5000-0x5fff]
[ 0.157905] NET: Registered protocol family 2
[ 0.158040] IP route cache hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.158351] TCP established hash table entries: 16384 (order: 6, 262144 bytes)
[ 0.158545] TCP bind hash table entries: 16384 (order: 6, 262144 bytes)
[ 0.158692] TCP: Hash tables configured (established 16384 bind 16384)
[ 0.158750] TCP reno registered
[ 0.158904] NET: Registered protocol family 1
[ 0.172147] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.172294] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.172449] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.172622] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.172802] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.172995] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.173204] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.173428] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.173660] pci 0000:00:00.0: Found enabled HT MSI Mapping
[ 0.173746] pci 0000:01:05.0: Boot video device
[ 0.173760] pci 0000:0a:00.0: rerouting interrupts for [8086:0370]
[ 0.173818] pci 0000:0a:00.2: rerouting interrupts for [8086:0372]
[ 0.173920] Unpacking initramfs...
[ 0.211044] Freeing initrd memory: 28785k freed
[ 0.224862] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 0.224930] DMA: Placing 64MB software IO TLB between ffff880003efe000 - ffff880007efe000
[ 0.225007] DMA: software IO TLB at phys 0x3efe000 - 0x7efe000
[ 0.225970] audit: initializing netlink socket (disabled)
[ 0.226038] type=2000 audit(1315409215.282:1): initialized
[ 0.228871] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.230603] VFS: Disk quotas dquot_6.5.2
[ 0.230707] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.230848] msgmni has been set to 860
[ 0.231442] alg: No test for stdrng (krng)
[ 0.231555] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[ 0.231631] io scheduler noop registered
[ 0.231686] io scheduler anticipatory registered
[ 0.231740] io scheduler deadline registered
[ 0.231828] io scheduler cfq registered (default)
[ 0.232463] alloc irq_desc for 2261 on node -1
[ 0.232466] alloc kstat_irqs on node -1
[ 0.232496] pcieport 0000:00:0a.0: setting latency timer to 64
[ 0.232706] alloc irq_desc for 2260 on node -1
[ 0.232709] alloc kstat_irqs on node -1
[ 0.232725] pcieport 0000:00:0b.0: setting latency timer to 64
[ 0.232914] alloc irq_desc for 2259 on node -1
[ 0.232916] alloc kstat_irqs on node -1
[ 0.232933] pcieport 0000:00:0c.0: setting latency timer to 64
[ 0.233123] alloc irq_desc for 2258 on node -1
[ 0.233125] alloc kstat_irqs on node -1
[ 0.233142] pcieport 0000:00:0d.0: setting latency timer to 64
[ 0.233338] alloc irq_desc for 2257 on node -1
[ 0.233341] alloc kstat_irqs on node -1
[ 0.233357] pcieport 0000:00:0e.0: setting latency timer to 64
[ 0.233545] alloc irq_desc for 2256 on node -1
[ 0.233547] alloc kstat_irqs on node -1
[ 0.233567] pcieport 0000:00:0f.0: setting latency timer to 64
[ 0.233761] alloc irq_desc for 2255 on node -1
[ 0.233763] alloc kstat_irqs on node -1
[ 0.233788] pcieport 0000:07:00.0: setting latency timer to 64
[ 0.233979] alloc irq_desc for 2254 on node -1
[ 0.233981] alloc kstat_irqs on node -1
[ 0.234005] pcieport 0000:08:01.0: setting latency timer to 64
[ 0.234204] alloc irq_desc for 2253 on node -1
[ 0.234207] alloc kstat_irqs on node -1
[ 0.234230] pcieport 0000:08:08.0: setting latency timer to 64
[ 0.234435] alloc irq_desc for 2252 on node -1
[ 0.234437] alloc kstat_irqs on node -1
[ 0.234461] pcieport 0000:08:09.0: setting latency timer to 64
[ 0.234932] aer 0000:00:0a.0cie02: service driver aer loaded
[ 0.234980] aer 0000:00:0b.0cie02: service driver aer loaded
[ 0.235026] aer 0000:00:0c.0cie02: service driver aer loaded
[ 0.235071] aer 0000:00:0d.0cie02: service driver aer loaded
[ 0.235117] aer 0000:00:0e.0cie02: service driver aer loaded
[ 0.235217] aer 0000:00:0f.0cie02: service driver aer loaded
[ 0.245082] registering netback
[ 0.245236] alloc irq_desc for 2251 on node -1
[ 0.245239] alloc kstat_irqs on node -1
[ 0.246397] alloc irq_desc for 2250 on node -1
[ 0.246399] alloc kstat_irqs on node -1
[ 0.246783] hpet_acpi_add: no address or irqs in _CRS
[ 0.246873] Linux agpgart interface v0.103
[ 0.246975] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 0.247191] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 0.247581] 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 0.247834] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[ 0.247958] PNP: PS/2 Controller [PNP0303:PS2K] at 0x60,0x64 irq 1
[ 0.248017] PNP: PS/2 appears to have AUX port disabled, if this is incorrect please boot with i8042.nopnp
[ 0.248657] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 0.248781] mice: PS/2 mouse device common for all mice
[ 0.248886] rtc_cmos 00:02: RTC can wake from S4
[ 0.248976] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[ 0.249065] rtc0: alarms up to one year, y3k, 114 bytes nvram
[ 0.249131] cpuidle: using governor ladder
[ 0.249185] cpuidle: using governor menu
[ 0.249241] No iBFT detected.
[ 0.249611] TCP cubic registered
[ 0.249772] NET: Registered protocol family 10
[ 0.250643] Mobile IPv6
[ 0.250697] NET: Registered protocol family 17
[ 0.250821] PM: Resume from disk failed.
[ 0.250840] registered taskstats version 1
[ 0.251746] rtc_cmos 00:02: setting system clock to 2011-09-07 15:26:54 UTC (1315409214)
[ 0.251852] Initalizing network drop monitor service
[ 0.251991] Freeing unused kernel memory: 604k freed
[ 0.252123] Write protecting the kernel read-only data: 4332k
[ 0.290003] udev[172]: starting version 164
[ 0.328852] SCSI subsystem initialized
[ 0.330478] forcedeth: Reverse Engineered nForce ethernet driver. Version 0.64.
[ 0.331044] ACPI: PCI Interrupt Link [LMAC] enabled at IRQ 23
[ 0.331116] xen: registering gsi 23 triggering 0 polarity 1
[ 0.331149] alloc irq_desc for 23 on node -1
[ 0.331152] alloc kstat_irqs on node -1
[ 0.331168] xen: --> irq=23
[ 0.331183] forcedeth 0000:00:08.0: PCI INT A -> Link[LMAC] -> GSI 23 (level, low) -> IRQ 23
[ 0.331302] forcedeth 0000:00:08.0: setting latency timer to 64
[ 0.331425] nv_probe: set workaround bit for reversed mac addr
[ 0.350219] usbcore: registered new interface driver usbfs
[ 0.350304] usbcore: registered new interface driver hub
[ 0.350428] usbcore: registered new device driver usb
[ 0.373003] libata version 3.00 loaded.
[ 0.376191] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 0.378540] ACPI: PCI Interrupt Link [LNED] enabled at IRQ 17
[ 0.378607] xen: registering gsi 17 triggering 0 polarity 1
[ 0.378625] alloc irq_desc for 17 on node -1
[ 0.378628] alloc kstat_irqs on node -1
[ 0.378632] xen: --> irq=17
[ 0.378641] arcmsr 0000:0b:0e.0: PCI INT A -> Link[LNED] -> GSI 17 (level, low) -> IRQ 17
[ 0.392155] ARECA RAID ADAPTER0: FIRMWARE VERSION V1.47 2009-07-02
[ 0.408086] scsi0 : Areca SATA Host Adapter RAID Controller( RAID6 capable)
[ 0.408088] Driver Version 1.20.00.15 2008/02/27
[ 0.409514] scsi 0:0:0:0: Direct-Access Areca LUIGI 2000 R001 PQ: 0 ANSI: 5
[ 0.409726] scsi 0:0:0:1: Direct-Access Areca LUIGI 1000 R001 PQ: 0 ANSI: 5
[ 0.410497] scsi 0:0:16:0: Processor Areca RAID controller R001 PQ: 0 ANSI: 0
[ 0.418256] sd 0:0:0:1: [sdb] 3906249728 512-byte logical blocks: (1.99 TB/1.81 TiB)
[ 0.418268] sd 0:0:0:0: [sda] 7812499456 512-byte logical blocks: (3.99 TB/3.63 TiB)
[ 0.418434] sd 0:0:0:0: [sda] Write Protect is off
[ 0.418501] sd 0:0:0:0: [sda] Mode Sense: cb 00 00 08
[ 0.418561] sd 0:0:0:1: [sdb] Write Protect is off
[ 0.418599] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 0.418692] sd 0:0:0:1: [sdb] Mode Sense: cb 00 00 08
[ 0.418776] sd 0:0:0:1: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 0.418985] sda:
[ 0.419262] sdb:
[ 0.421165] sd 0:0:0:0: Attached scsi generic sg0 type 0
[ 0.421439] sd 0:0:0:1: Attached scsi generic sg1 type 0
[ 0.421657] scsi 0:0:16:0: Attached scsi generic sg2 type 3
[ 0.429788] unknown partition table
[ 0.431028] sd 0:0:0:1: [sdb] Attached SCSI disk
[ 0.471475] sda1 sda2
[ 0.472246] sd 0:0:0:0: [sda] Attached SCSI disk
[ 0.852771] forcedeth 0000:00:08.0: ifname eth0, PHY OUI 0x5043 @ 2, addr 00:30:48:c9:31:9a
[ 0.852850] forcedeth 0000:00:08.0: highdma csum vlan pwrctl mgmt gbit lnktim msi desc-v3
[ 0.853468] ACPI: PCI Interrupt Link [LUB2] enabled at IRQ 22
[ 0.853528] xen: registering gsi 22 triggering 0 polarity 1
[ 0.853542] alloc irq_desc for 22 on node -1
[ 0.853544] alloc kstat_irqs on node -1
[ 0.853549] xen: --> irq=22
[ 0.853558] ehci_hcd 0000:00:02.1: PCI INT B -> Link[LUB2] -> GSI 22 (level, low) -> IRQ 22
[ 0.853653] ehci_hcd 0000:00:02.1: setting latency timer to 64
[ 0.853657] ehci_hcd 0000:00:02.1: EHCI Host Controller
[ 0.853743] ehci_hcd 0000:00:02.1: new USB bus registered, assigned bus number 1
[ 0.853890] ehci_hcd 0000:00:02.1: debug port 1
[ 0.853951] ehci_hcd 0000:00:02.1: cache line size of 64 is not supported
[ 0.853978] ehci_hcd 0000:00:02.1: irq 22, io mem 0xfe8fac00
[ 0.868033] ehci_hcd 0000:00:02.1: USB 2.0 started, EHCI 1.00
[ 0.868115] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 0.868172] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 0.868246] usb usb1: Product: EHCI Host Controller
[ 0.868304] usb usb1: Manufacturer: Linux 2.6.32-5-xen-amd64 ehci_hcd
[ 0.868361] usb usb1: SerialNumber: 0000:00:02.1
[ 0.868531] usb usb1: configuration #1 chosen from 1 choice
[ 0.868647] hub 1-0:1.0: USB hub found
[ 0.868730] hub 1-0:1.0: 10 ports detected
[ 0.869117] pata_amd 0000:00:04.0: version 0.4.1
[ 0.869163] pata_amd 0000:00:04.0: setting latency timer to 64
[ 0.869296] scsi1 : pata_amd
[ 0.869432] scsi2 : pata_amd
[ 0.871586] ata1: PATA max UDMA/133 cmd 0x1f0 ctl 0x3f6 bmdma 0xffa0 irq 14
[ 0.871646] ata2: PATA max UDMA/133 cmd 0x170 ctl 0x376 bmdma 0xffa8 irq 15
[ 0.872233] ACPI: PCI Interrupt Link [LMAD] enabled at IRQ 21
[ 0.872293] xen: registering gsi 21 triggering 0 polarity 1
[ 0.872303] alloc irq_desc for 21 on node -1
[ 0.872305] alloc kstat_irqs on node -1
[ 0.872309] xen: --> irq=21
[ 0.872317] forcedeth 0000:00:09.0: PCI INT A -> Link[LMAD] -> GSI 21 (level, low) -> IRQ 21
[ 0.872404] forcedeth 0000:00:09.0: setting latency timer to 64
[ 0.872468] nv_probe: set workaround bit for reversed mac addr
[ 0.953384] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 1.040410] ata1.01: ATAPI: DVD-ROM UJDA780, 1.50, max UDMA/33
[ 1.040486] ata1: nv_mode_filter: 0x739f&0x739f->0x739f, BIOS=0x7000 (0xc00000) ACPI=0x701f (900:60:0x14)
[ 1.056394] ata1.01: configured for UDMA/33
[ 1.058003] scsi 1:0:1:0: CD-ROM MATSHITA DVD-ROM UJDA780 1.50 PQ: 0 ANSI: 5
[ 1.058181] scsi 1:0:1:0: Attached scsi generic sg3 type 5
[ 1.058326] ata2: port disabled. ignoring.
[ 1.392920] forcedeth 0000:00:09.0: ifname eth1, PHY OUI 0x5043 @ 3, addr 00:30:48:c9:31:9b
[ 1.393006] forcedeth 0000:00:09.0: highdma csum vlan pwrctl mgmt gbit lnktim msi desc-v3
[ 1.393893] ACPI: PCI Interrupt Link [LUB0] enabled at IRQ 20
[ 1.393956] xen: registering gsi 20 triggering 0 polarity 1
[ 1.393965] alloc irq_desc for 20 on node -1
[ 1.393968] alloc kstat_irqs on node -1
[ 1.393972] xen: --> irq=20
[ 1.393978] ohci_hcd 0000:00:02.0: PCI INT A -> Link[LUB0] -> GSI 20 (level, low) -> IRQ 20
[ 1.394072] ohci_hcd 0000:00:02.0: setting latency timer to 64
[ 1.394076] ohci_hcd 0000:00:02.0: OHCI Host Controller
[ 1.396015] ohci_hcd 0000:00:02.0: new USB bus registered, assigned bus number 2
[ 1.396015] ohci_hcd 0000:00:02.0: irq 20, io mem 0xfe8fb000
[ 1.450040] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[ 1.450101] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.450181] usb usb2: Product: OHCI Host Controller
[ 1.450240] usb usb2: Manufacturer: Linux 2.6.32-5-xen-amd64 ohci_hcd
[ 1.450296] usb usb2: SerialNumber: 0000:00:02.0
[ 1.450477] usb usb2: configuration #1 chosen from 1 choice
[ 1.450589] hub 2-0:1.0: USB hub found
[ 1.450679] hub 2-0:1.0: 10 ports detected
[ 1.461991] sr0: scsi3-mmc drive: 24x/24x cd/rw xa/form2 cdda tray
[ 1.462051] Uniform CD-ROM driver Revision: 3.20
[ 1.462348] sr 1:0:1:0: Attached scsi CD-ROM sr0
[ 1.541680] device-mapper: uevent: version 1.0.3
[ 1.542101] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
[ 1.790165] EXT4-fs (sda1): INFO: recovery required on readonly filesystem
[ 1.790295] EXT4-fs (sda1): write access will be enabled during recovery
[ 1.907090] EXT4-fs (sda1): recovery complete
[ 1.907336] EXT4-fs (sda1): mounted filesystem with ordered data mode
[ 2.784331] udev[441]: starting version 164
[ 2.968715] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input1
[ 2.968838] ACPI: Power Button [PWRB]
[ 2.968962] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
[ 2.969037] ACPI: Power Button [PWRF]
[ 3.109904] EDAC MC: Ver: 2.1.0 Jun 14 2011
[ 3.112725] input: PC Speaker as /devices/platform/pcspkr/input/input3
[ 3.116214] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 3.117365] k10temp 0000:00:18.3: unreliable CPU thermal sensor; monitoring disabled
[ 3.117603] k10temp 0000:00:19.3: unreliable CPU thermal sensor; monitoring disabled
[ 3.126038] EDAC amd64_edac: Ver: 3.2.0 Jun 14 2011
[ 3.126275] EDAC amd64: ECC is enabled by BIOS.
[ 3.126473] EDAC amd64: ECC is enabled by BIOS.
[ 3.126587] EDAC MC: F10h CPU detected
[ 3.126720] EDAC MC0: Giving out device to 'amd64_edac' 'Family 10h': DEV 0000:00:18.2
[ 3.126804] EDAC MC: F10h CPU detected
[ 3.126906] i2c i2c-0: nForce2 SMBus adapter at 0x2d00
[ 3.126936] EDAC MC1: Giving out device to 'amd64_edac' 'Family 10h': DEV 0000:00:19.2
[ 3.126955] EDAC PCI0: Giving out device to module 'amd64_edac' controller 'EDAC PCI controller': DEV '0000:00:18.2' (POLLED)
[ 3.127154] i2c i2c-1: nForce2 SMBus adapter at 0x2e00
[ 3.150526] [drm] Initialized drm 1.1.0 20060810
[ 3.153895] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 3.272910] [drm] radeon defaulting to userspace modesetting.
[ 3.273507] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 16
[ 3.273565] xen: registering gsi 16 triggering 0 polarity 1
[ 3.273581] alloc irq_desc for 16 on node -1
[ 3.273584] alloc kstat_irqs on node -1
[ 3.273589] xen: --> irq=16
[ 3.273598] pci 0000:01:05.0: PCI INT A -> Link[LNKA] -> GSI 16 (level, low) -> IRQ 16
[ 3.273894] [drm] Initialized radeon 1.32.0 20080528 for 0000:0
 
Old 09-10-2011, 11:18 PM
Hans van Kranenburg
 
Default Bug#640941: xen dom0 crash: unable to handle kernel paging request / Oops / Kernel panic

On 09/08/2011 07:12 PM, Hans van Kranenburg wrote:


When putting disk/network load on one of our office servers, Xen/dom0
crashes. Triple ctrl-a does not react any more on serial console.

We did not encounter this earlier on this particular piece of hardware,
having tortured it some more in the past. A few days ago we set up drbd
on this host [...]


I've been searching some more, using snippets from the stacktrace. This
seems to be a known issue [1], [2] when using DRBD in combination with Xen.


A workaround should be to set the option disable_sendpage when loading
the drbd module [3], [4].


I remember reading about this some months ago. I've set this option on
both of the Xen/DRBD hosts at the office...

echo 1 > /sys/module/drbd/parameters/disable_sendpage
... and added the "options drbd disable_sendpage=1" into
/etc/modprobe.d/drbd.conf


Next week we'll see what happens when we put some stress on it.

[1] http://www.gossamer-threads.com/lists/drbd/users/16962
[2]
http://www.mentby.com/Group/drbd-user/kernel-panic-in-skbcopybits-squeeze.html

[3] http://www.gossamer-threads.com/lists/drbd/users/19980
[4] http://www.drbd.org/users-guide/s-xen-drbd-mod-params.html

--
Hans van Kranenburg - System / Network Engineer
T +31 (0)10 2760434 | hans.van.kranenburg@mendix.com | www.mendix.com



--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 4E6BF051.3040904@mendix.com">http://lists.debian.org/4E6BF051.3040904@mendix.com
 
Old 09-11-2011, 03:37 PM
Ian Campbell
 
Default Bug#640941: xen dom0 crash: unable to handle kernel paging request / Oops / Kernel panic

On Sun, 2011-09-11 at 01:18 +0200, Hans van Kranenburg wrote:
> On 09/08/2011 07:12 PM, Hans van Kranenburg wrote:
> >
> > When putting disk/network load on one of our office servers, Xen/dom0
> > crashes. Triple ctrl-a does not react any more on serial console.
> >
> > We did not encounter this earlier on this particular piece of hardware,
> > having tortured it some more in the past. A few days ago we set up drbd
> > on this host [...]
>
> I've been searching some more, using snippets from the stacktrace. This
> seems to be a known issue [1], [2] when using DRBD in combination with Xen.
>
> A workaround should be to set the option disable_sendpage when loading
> the drbd module [3], [4].

Sounds similar to the NFS issue[0] which caused me to begin working on
the SKB paged fragment destructor patches[1]. I just gave a talk about
this problem at LPC last week[2]

They are still a WIP but I hope to have them ready for Linux 3.3. I will
include DRDB in my list of subsystems to consider.

In the meantime disabling sendpage sounds like the best workaround.

[0] http://marc.info/?l=linux-nfs&m=122424132729720&w=2
[1] http://marc.info/?l=linux-netdev&m=131072801125521&w=2
[2] http://linuxplumbersconf.org/2011/ocw/proposals/129

Ian.

>
> I remember reading about this some months ago. I've set this option on
> both of the Xen/DRBD hosts at the office...
> echo 1 > /sys/module/drbd/parameters/disable_sendpage
> ... and added the "options drbd disable_sendpage=1" into
> /etc/modprobe.d/drbd.conf
>
> Next week we'll see what happens when we put some stress on it.
>
> [1] http://www.gossamer-threads.com/lists/drbd/users/16962
> [2]
> http://www.mentby.com/Group/drbd-user/kernel-panic-in-skbcopybits-squeeze.html
> [3] http://www.gossamer-threads.com/lists/drbd/users/19980
> [4] http://www.drbd.org/users-guide/s-xen-drbd-mod-params.html
>
> --
> Hans van Kranenburg - System / Network Engineer
> T +31 (0)10 2760434 | hans.van.kranenburg@mendix.com | www.mendix.com
>
>
>

--
Ian Campbell


A hacker does for love what others would not do for money.
 
Old 09-14-2011, 09:17 PM
Hans van Kranenburg
 
Default Bug#640941: xen dom0 crash: unable to handle kernel paging request / Oops / Kernel panic

Hi Ian,

On 09/11/2011 05:37 PM, Ian Campbell wrote:

On Sun, 2011-09-11 at 01:18 +0200, Hans van Kranenburg wrote:

On 09/08/2011 07:12 PM, Hans van Kranenburg wrote:


When putting disk/network load on one of our office servers, Xen/dom0
crashes. Triple ctrl-a does not react any more on serial console.


[...]
A workaround should be to set the option disable_sendpage when loading
the drbd module [3], [4].


Sounds similar to the NFS issue[0] which caused me to begin working on
the SKB paged fragment destructor patches[1]. I just gave a talk about
this problem at LPC last week[2]

They are still a WIP but I hope to have them ready for Linux 3.3. I will
include DRDB in my list of subsystems to consider.


That sure is very interesting material to read. Ths original stack trace
I posted makes a lot more sense to me now.



In the meantime disabling sendpage sounds like the best workaround.


So, we set the disable_sendpage option, did a domU reboot with drbdadm
down/up of the drbd devices (just to be sure, don't know where/when this
option is read by drbd), and after some days of hitting the disks and
the network with data, no kernel panics happened anymore. Yay!


In the post you reference with [1] you write: "I expect that other block
and filesystem users of the network subsystem (e.g. iSCSI) would also
benefit from this functionality since they will suffer from the same
class of issue.".
Part of my work in the near future is doing lenny->squeeze upgrades of
a couple of systems where we use lvm backed block devices for domU's
which are on dm-multipath on iSCSI.
Should I be concerned about the same issues that can happen when using
iSCSI on squeeze? If so, or if unknown, do you recommend specific
(stress)tests that we can do at the test-upgrade environment?


[1] http://marc.info/?l=linux-netdev&m=131072801125521&w=2

What should be done with this bug report? Should I close it, as there's
a workaround, and there's no simple fix that can be done in squeeze, or
should it be hanging around to be closed when the work on this is done
and included in the kernel?


Thanks!

--
Hans van Kranenburg - System / Network Engineer
T +31 (0)10 2760434 | hans.van.kranenburg@mendix.com | www.mendix.com



--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 4E7119E6.5000402@mendix.com">http://lists.debian.org/4E7119E6.5000402@mendix.com
 
Old 09-15-2011, 08:25 AM
Ian Campbell
 
Default Bug#640941: xen dom0 crash: unable to handle kernel paging request / Oops / Kernel panic

On Wed, 2011-09-14 at 23:17 +0200, Hans van Kranenburg wrote:
> Hi Ian,
>
> On 09/11/2011 05:37 PM, Ian Campbell wrote:
> > On Sun, 2011-09-11 at 01:18 +0200, Hans van Kranenburg wrote:
> >> On 09/08/2011 07:12 PM, Hans van Kranenburg wrote:

> > In the meantime disabling sendpage sounds like the best workaround.
>
> So, we set the disable_sendpage option, did a domU reboot with drbdadm
> down/up of the drbd devices (just to be sure, don't know where/when this
> option is read by drbd), and after some days of hitting the disks and
> the network with data, no kernel panics happened anymore. Yay!

Glad to hear it!

> In the post you reference with [1] you write: "I expect that other block
> and filesystem users of the network subsystem (e.g. iSCSI) would also
> benefit from this functionality since they will suffer from the same
> class of issue.".
> Part of my work in the near future is doing lenny->squeeze upgrades of
> a couple of systems where we use lvm backed block devices for domU's
> which are on dm-multipath on iSCSI.
> Should I be concerned about the same issues that can happen when using
> iSCSI on squeeze? If so, or if unknown, do you recommend specific
> (stress)tests that we can do at the test-upgrade environment?

The strange thing is that this class of issue has always been present
AFAIK, it seems that it just takes a very particular confluence of
circumstances (involving heavy load, bad luck etc) before anything goes
wrong, although it does seem that if a particular setup is susceptible
it will see it quite a lot.

DRDB's use of sendpage is pretty recent (I think) which is why you only
just started seeing it. I think if you've been using iSCSI up to now
without problem I wouldn't expect you to start seeing problems now,
although you should obviously keep this issue in mind if you see
anything weird.

>
> [1] http://marc.info/?l=linux-netdev&m=131072801125521&w=2
>
> What should be done with this bug report? Should I close it, as there's
> a workaround, and there's no simple fix that can be done in squeeze, or
> should it be hanging around to be closed when the work on this is done
> and included in the kernel?

I think there's no harm in keeping it around as a reminder (to me) that
something needs to be done. We can close it when the fixed upstream
kernel hits Sid.

Ian.
--
Ian Campbell

Heuristics are bug ridden by definition. If they didn't have bugs,
then they'd be algorithms.




--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 1316075170.25935.10.camel@cthulhu.hellion.org.uk"> http://lists.debian.org/1316075170.25935.10.camel@cthulhu.hellion.org.uk
 

Thread Tools




All times are GMT. The time now is 04:30 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright 2007 - 2008, www.linux-archive.org