FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > Debian > Debian Kernel

 
 
LinkBack Thread Tools
 
Old 04-04-2012, 01:54 AM
Quintin Russ
 
Default Bug#667434: lvcreate / lvremove snapshot under Xen causes Kernel OOPs

Package: linux-image-2.6.32-5-xen-amd64
Version: 2.6.32-39
Severity: important

We have observed an issue when a Xen dom0 is removing a snapshot for a logical volume and another process comes along to create a snapshot for that same device (different names) causing the server to Kernel Ooops. According to my logs sometimes removing of the snapshot can pause or take a while contributing to the issue. Attempts to add locking code (using dotlockfile) have not so far been successful in mitigating this bug, but we are still exploring this option.

The nodes that are affected intermittently& we have been unable to reproduce this issue in the lab (on either the same model of hardware or hardware that has crashed in production). From our logs we can see that every time this issue occurs one process has been removing the snapshot while another has been creating a snapshot shortly after (seconds normally). We are currently seeing about a 5% chance of a crash per month (assuming our nodes are equal).

This bug looks similar to a number of bugs that have already been filed related to this issue:http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=614400 A quick Google search shows many more (which have mostly been merged): https://www.google.co.nz/webhp?q=site%3Abugs.debian.org%20xen%20snapshot%20 kernel%20oops%20squeeze

# lspci
00:00.0 Host bridge: Intel Corporation 5520 I/O Hub to ESI Port (rev 22)
00:01.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 (rev 22)
00:02.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 2 (rev 22)
00:03.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3 (rev 22)
00:05.0 PCI bridge: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 5 (rev 22)
00:07.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 (rev 22)
00:13.0 PIC: Intel Corporation 5520/5500/X58 I/O Hub I/OxAPIC Interrupt Controller (rev 22)
00:14.0 PIC: Intel Corporation 5520/5500/X58 I/O Hub System Management Registers (rev 22)
00:14.1 PIC: Intel Corporation 5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers (rev 22)
00:14.2 PIC: Intel Corporation 5520/5500/X58 I/O Hub Control Status and RAS Registers (rev 22)
00:14.3 PIC: Intel Corporation 5520/5500/X58 I/O Hub Throttle Registers (rev 22)
00:16.0 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.1 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.2 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.3 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.4 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.5 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.6 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.7 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4
00:1a.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5
00:1a.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6
00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2
00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1
00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2
00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3
00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)
00:1f.0 ISA bridge: Intel Corporation 82801JIB (ICH10) LPC Interface Controller
00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller #1
00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller
00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller #2
01:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
02:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
04:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 02)
05:00.0 InfiniBand: Mellanox Technologies MT25208 [InfiniHost III Ex] (rev a0)
06:01.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200eW WPCM450 (rev 0a)

# lsmod
Module Size Used by
nf_conntrack_ipv4 9833 10
nf_defrag_ipv4 1139 1 nf_conntrack_ipv4
xt_state 1303 10
nf_conntrack 46519 2 nf_conntrack_ipv4,xt_state
xt_physdev 1508 20
ebt_arp 1793 6
ebt_ip 1470 6
ebt_log 2836 5
ebtable_filter 1599 1
ebtables 13933 1 ebtable_filter
bridge 39678 0
stp 1440 1 bridge
xt_multiport 2267 1
xen_evtchn 4339 5
xenfs 9600 1
ipt_REJECT 1953 1
xt_tcpudp 2319 17
iptable_filter 2258 1
ip_tables 13915 1 iptable_filter
x_tables 12845 10 xt_state,xt_physdev,ebt_arp,ebt_ip,ebt_log,ebtable s,xt_multiport,ipt_REJECT,xt_tcpudp,ip_tables
dm_snapshot 18481 3
ib_umad 9879 8
ib_ipoib 59777 0
ib_cm 26272 1 ib_ipoib
ib_sa 16103 2 ib_ipoib,ib_cm
inet_lro 4630 1 ib_ipoib
drbd 193296 59
lru_cache 5042 1 drbd
cn 4563 1 drbd
loop 11799 0
snd_pcm 60535 0
snd_timer 15598 1 snd_pcm
snd 46526 2 snd_pcm,snd_timer
soundcore 4598 1 snd
snd_page_alloc 6249 1 snd_pcm
ib_mthca 111389 0
ib_mad 30001 4 ib_umad,ib_cm,ib_sa,ib_mthca
pcspkr 1699 0
i2c_i801 7830 0
ioatdma 34876 64
psmouse 49937 0
ib_core 40967 6 ib_umad,ib_ipoib,ib_cm,ib_sa,ib_mthca,ib_mad
serio_raw 3752 0
i2c_core 15819 1 i2c_i801
evdev 7352 3
joydev 8459 0
dca 3761 1 ioatdma
processor 35941 0
button 4650 0
acpi_processor 5087 1 processor,[permanent]
ext3 106710 1
jbd 37205 1 ext3
mbcache 5050 1 ext3
dm_mod 53898 188 dm_snapshot
raid1 18431 2
raid0 5517 2
md_mod 73872 6 raid1,raid0
ses 5144 0
enclosure 5503 1 ses
sd_mod 29905 40
crc_t10dif 1276 1 sd_mod
usbhid 33276 0
hid 63257 1 usbhid
ata_generic 3239 0
mpt2sas 87853 28
scsi_transport_sas 19865 1 mpt2sas
uhci_hcd 18521 0
ata_piix 21124 0
ehci_hcd 32065 0
libata 133760 2 ata_generic,ata_piix
usbcore 122674 4 usbhid,uhci_hcd,ehci_hcd
nls_base 6377 1 usbcore
scsi_mod 126517 5 ses,sd_mod,mpt2sas,scsi_transport_sas,libata
e1000e 124772 0
thermal 11674 0
thermal_sys 11942 2 processor,thermal

# dpkg -l
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Description
+++-=======================================-============================-================================================== ===================
ii acpi 1.5-2 displays information on ACPI devices
ii acpi-support-base 0.137-5 scripts for handling base ACPI events such as the power button
ii acpid 1:2.0.7-1squeeze3 Advanced Configuration and Power Interface event daemon
ii adduser 3.112+nmu2 add and remove users and groups
ii apt 0.8.10.3+squeeze1 Advanced front-end for dpkg
ii apt-utils 0.8.10.3+squeeze1 APT utility programs
ii aptitude 0.6.3-3.2+squeeze1 terminal-based package manager (terminal interface only)
ii base-files 6.0squeeze3 Debian base system miscellaneous files
ii base-passwd 3.5.22 Debian base system master password and group files
ii bash 4.1-3 The GNU Bourne Again SHell
ii binutils 2.20.1-16 The GNU assembler, linker and binary utilities
ii bridge-utils 1.4-5 Utilities for configuring the Linux Ethernet bridge
ii bsdmainutils 8.0.13 collection of more utilities from FreeBSD
ii bsdutils 1:2.17.2-9 Basic utilities from 4.4BSD-Lite
ii busybox 1:1.17.1-8 Tiny utilities for small and embedded systems
ii bzip2 1.0.5-6+squeeze1 high-quality block-sorting file compressor - utilities
ii ca-certificates 20090814+nmu3squeeze1 Common CA certificates
ii console-setup 1.68+squeeze2 console font and keymap setup program
ii console-terminus 4.30-2 Fixed-width fonts for fast reading on the Linux console
ii coreutils 8.5-1 GNU core utilities
ii cpio 2.11-4 GNU cpio -- a program to manage archives of files
ii cpp 4:4.4.5-1 The GNU C preprocessor (cpp)
ii cpp-4.4 4.4.5-8 The GNU C preprocessor
ii cron 3.0pl1-116 process scheduling daemon
ii cstream 2.7.6-1 general-purpose stream-handling tool similar to dd
ii dash 0.5.5.1-7.4 POSIX-compliant shell
ii dbus 1.2.24-4+squeeze1 simple interprocess messaging system
ii debconf 1.5.36.1 Debian configuration management system
ii debconf-i18n 1.5.36.1 full internationalization support for debconf
ii debian-archive-keyring 2010.08.28 GnuPG archive keys of the Debian archive
ii debianutils 3.4 Miscellaneous utilities specific to Debian
ii diffutils 1:3.0-1 File comparison utilities
ii discover 2.1.2-5 hardware identification system
ii discover-data 2.2010.10.18 Data lists for Discover hardware detection system
ii dmidecode 2.9-1.2 Dump Desktop Management Interface data
ii dmsetup 2:1.02.48-5 The Linux Kernel Device Mapper userspace library
ii dpkg 1.15.8.11 Debian package management system
ii dpkg-dev 1.15.8.12 Debian package development tools
ii drbd8-utils 2:8.3.7-2.1 RAID 1 over tcp/ip for Linux utilities
ii e2fslibs 1.41.12-4stable1 ext2/ext3/ext4 file system libraries
ii e2fsprogs 1.41.12-4stable1 ext2/ext3/ext4 file system utilities
ii ebtables 2.0.9.2-2 Ethernet bridge frame table administration
ii esound-common 0.2.41-8 Enlightened Sound Daemon - Common files
ii etherboot 5.4.4-9 Bootstrapping for various network adapters
ii etherboot-qemu 5.4.4-9 Bootstrapping for various network adapters (qemu)
ii fail2ban 0.8.4-3 bans IPs that cause multiple authentication errors
ii fakeroot 1.14.4-1 Gives a fake root environment
ii file 5.04-5 Determines file type using "magic" numbers
ii findutils 4.4.2-1+b1 utilities for finding files--find, xargs
ii firmware-linux-free 2.6.32-39 Binary firmware for various drivers in the Linux kernel
ii g++ 4:4.4.5-1 The GNU C++ compiler
ii g++-4.4 4.4.5-8 The GNU C++ compiler
ii gawk 1:3.1.7.dfsg-5 GNU awk, a pattern scanning and processing language
ii gcc 4:4.4.5-1 The GNU C compiler
ii gcc-4.4 4.4.5-8 The GNU C compiler
ii gcc-4.4-base 4.4.5-8 The GNU Compiler Collection (base package)
ii gettext-base 0.18.1.1-3 GNU Internationalization utilities for the base system
ii gnupg 1.4.10-4 GNU privacy guard - a free PGP replacement
ii gpgv 1.4.10-4 GNU privacy guard - signature verification tool
ii grep 2.6.3-3 GNU grep, egrep and fgrep
ii groff-base 1.20.1-10 GNU troff text-formatting system (base system components)
ii grub-common 1.98+20100804-14+squeeze1 GRand Unified Bootloader, version 2 (common files)
ii grub-pc 1.98+20100804-14+squeeze1 GRand Unified Bootloader, version 2 (PC/BIOS version)
ii gzip 1.3.12-9 GNU compression utilities
ii heirloom-mailx 12.4-2 feature-rich BSD mail(1)
ii hostname 3.04 utility to set/show the host name or domain name
ii ifupdown 0.6.10 high level tools to configure network interfaces
ii infiniband-diags 1.4.4-20090314-1 InfiniBand diagnostic programs
ii info 4.13a.dfsg.1-6 Standalone GNU Info documentation browser
ii initramfs-tools 0.98.8 tools for generating an initramfs
ii initscripts 2.88dsf-13.1 scripts for initializing and shutting down the system
ii insserv 1.14.0-2 Tool to organize boot sequence using LSB init.d script dependencies
ii install-info 4.13a.dfsg.1-6 Manage installed documentation in info format
ii installation-report 2.44 system installation report
ii iproute 20100519-3 networking and traffic control tools
ii iptables 1.4.8-3 administration tools for packet filtering and NAT
ii iputils-ping 3:20100418-3 Tools to test the reachability of network hosts
ii isc-dhcp-client 4.1.1-P1-15+squeeze3 ISC DHCP client
ii isc-dhcp-common 4.1.1-P1-15+squeeze3 common files used by all the isc-dhcp* packages
ii kbd 1.15.2-2 Linux console font and keytable utilities
ii keyboard-configuration 1.68+squeeze2 system-wide keyboard preferences
ii klibc-utils 1.5.20-1+squeeze1 small utilities built with klibc for early boot
ii laptop-detect 0.13.7 attempt to detect a laptop
ii less 436-1 pager program similar to more
ii libacl1 2.2.49-4 Access control list shared library
ii libalgorithm-diff-perl 1.19.02-2 module to find differences between files
ii libalgorithm-diff-xs-perl 0.04-1 module to find differences between files (XS accelerated)
ii libalgorithm-merge-perl 0.08-2 Perl module for three-way merge of textual data
ii libasound2 1.0.23-2.1 shared library for ALSA applications
ii libasyncns0 0.3-1.1 Asyncronous name service query library
ii libattr1 1:2.4.44-2 Extended attribute shared library
ii libaudiofile0 0.2.6-8 Open-source version of SGI's audiofile library
ii libblkid1 2.17.2-9 block device id library
ii libbluetooth3 4.66-3 Library to use the BlueZ Linux Bluetooth stack
ii libboost-iostreams1.42.0 1.42.0-4 Boost.Iostreams Library
ii libbrlapi0.5 4.2-7+squeeze1 braille display access via BRLTTY - shared library
ii libbsd0 0.2.0-1 utility functions from BSD systems - shared library
ii libbz2-1.0 1.0.5-6+squeeze1 high-quality block-sorting file compressor library - runtime
ii libc-bin 2.11.3-2 Embedded GNU C Library: Binaries
ii libc-dev-bin 2.11.3-2 Embedded GNU C Library: Development binaries
ii libc6 2.11.3-2 Embedded GNU C Library: Shared libraries
ii libc6-dev 2.11.3-2 Embedded GNU C Library: Development Libraries and Header Files
ii libcap-ng0 0.6.4-1 An alternate posix capabilities library
ii libcap2 1:2.19-3 support for getting/setting POSIX.1e capabilities
ii libcmdparse2-ruby1.8 2.0.2-2 Advanced command line parsing module supporting sub-commands
ii libcomerr2 1.41.12-4stable1 common error description library
ii libcurl3 7.21.0-2.1+squeeze1 Multi-protocol file transfer library (OpenSSL)
ii libcurl3-gnutls 7.21.0-2.1+squeeze1 Multi-protocol file transfer library (GnuTLS)
ii libcwidget3 0.5.16-3 high-level terminal interface library for C++ (runtime files)
ii libdaemons-ruby1.8 1.0.10-2 Ruby daemons library
ii libdb4.7 4.7.25-9 Berkeley v4.7 Database Libraries [runtime]
ii libdb4.8 4.8.30-2 Berkeley v4.8 Database Libraries [runtime]
ii libdbus-1-3 1.2.24-4+squeeze1 simple interprocess messaging system
ii libdevmapper1.02.1 2:1.02.48-5 The Linux Kernel Device Mapper userspace library
ii libdirectfb-1.2-9 1.2.10.0-4 direct frame buffer graphics - shared libraries
ii libdiscover2 2.1.2-5 hardware identification library
ii libdpkg-perl 1.15.8.12 Dpkg perl modules
ii libdrm-intel1 2.4.21-1~squeeze3 Userspace interface to intel-specific kernel DRM services -- runtime
ii libdrm-radeon1 2.4.21-1~squeeze3 Userspace interface to radeon-specific kernel DRM services -- runtime
ii libdrm2 2.4.21-1~squeeze3 Userspace interface to kernel DRM services -- runtime
ii libedit2 2.11-20080614-2 BSD editline and history libraries
ii libept1 1.0.4 High-level library for managing Debian package information
ii libesd0 0.2.41-8 Enlightened Sound Daemon - Shared libraries
ii libexpat1 2.0.1-7 XML parsing C library - runtime library
ii libexpect-perl 1.20-2 Expect.pm - Perl Expect interface
ii libflac8 1.2.1-2+b1 Free Lossless Audio Codec - runtime C library
ii libfreetype6 2.4.2-2.1+squeeze3 FreeType 2 font engine, shared library files
ii libgcc1 1:4.4.5-8 GCC support library
ii libgcrypt11 1.4.5-2 LGPL Crypto library - runtime library
ii libgdbm3 1.8.3-9 GNU dbm database routines (runtime version)
ii libgl1-mesa-dri 7.7.1-5 A free implementation of the OpenGL API -- DRI modules
ii libgl1-mesa-glx 7.7.1-5 A free implementation of the OpenGL API -- GLX runtime
ii libgmp3c2 2:4.3.2+dfsg-1 Multiprecision arithmetic library
ii libgnutls26 2.8.6-1+squeeze1 the GNU TLS library - runtime library
ii libgomp1 4.4.5-8 GCC OpenMP (GOMP) support library
ii libgpg-error0 1.6-1 library for common error values and messages in GnuPG components
ii libgpm2 1.20.4-3.3 General Purpose Mouse - shared library
ii libgssapi-krb5-2 1.8.3+dfsg-4squeeze5 MIT Kerberos runtime libraries - krb5 GSS-API Mechanism
ii libibcommon1 1.1.2-20090314-1 InfiniBand management library
ii libibmad1 1.2.3-20090314-1 Infiniband Management Datagram (MAD) library
ii libibumad1 1.2.3-20090314-1.1 InfiniBand Userspace Management Datagram (uMAD) library
ii libice6 2:1.0.6-2 X11 Inter-Client Exchange library
ii libidn11 1.15-2 GNU Libidn library, implementation of IETF IDN specifications
ii libio-pty-perl 1:1.08-1 Perl module for pseudo tty IO
ii libio-stty-perl 0.02-10 Interface to secure pseudo ttys
ii libk5crypto3 1.8.3+dfsg-4squeeze5 MIT Kerberos runtime libraries - Crypto Library
ii libkeyutils1 1.4-1 Linux Key Management Utilities (library)
ii libklibc 1.5.20-1+squeeze1 minimal libc subset for use with initramfs
ii libkrb5-3 1.8.3+dfsg-4squeeze5 MIT Kerberos runtime libraries
ii libkrb5support0 1.8.3+dfsg-4squeeze5 MIT Kerberos runtime libraries - Support library
ii libldap-2.4-2 2.4.23-7.2 OpenLDAP libraries
ii liblocale-gettext-perl 1.05-6 Using libc functions for internationalization in Perl
ii liblockfile1 1.08-4 NFS-safe locking library, includes dotlockfile program
ii liblog4r-ruby1.8 1.0.5-8 A logging library for Ruby
ii liblzma2 5.0.0-2 XZ-format compression library
ii libmagic1 5.04-5 File type determination library using "magic" numbers
ii libmpfr4 3.0.0-2 multiple precision floating-point computation
ii libncurses-ruby1.8 1.2.4-2 ruby Extension for the ncurses C library
ii libncurses5 5.7+20100313-5 shared libraries for terminal handling
ii libncursesw5 5.7+20100313-5 shared libraries for terminal handling (wide character support)
ii libnewt0.52 0.52.11-1 Not Erik's Windowing Toolkit - text mode windowing with slang
ii libnfnetlink0 1.0.0-1 Netfilter netlink library
ii libogg0 1.2.0~dfsg-1 Ogg bitstream library
ii libonig2 5.9.1-1 Oniguruma regular expressions library
ii libopensm2 3.2.6-20090317-2 Infiniband subnet manager libraries
ii libopts25 1:5.10-1.1 automated option processing library based on autogen
ii libpam-modules 1.1.1-6.1+squeeze1 Pluggable Authentication Modules for PAM
ii libpam-runtime 1.1.1-6.1+squeeze1 Runtime support for the PAM library
ii libpam0g 1.1.1-6.1+squeeze1 Pluggable Authentication Modules library
ii libpcap0.8 1.1.1-2+squeeze1 system interface for user-level packet capture
ii libpci3 1:3.1.7-6 Linux PCI Utilities (shared library)
ii libpopt0 1.16-1 lib for parsing cmdline parameters
ii libpulse0 0.9.21-3+squeeze1 PulseAudio client libraries
ii libqdbm14 1.8.77-4 QDBM Database Libraries [runtime]
ii libreadline5 5.2-7 GNU readline and history libraries, run-time libraries
ii libreadline6 6.1-3 GNU readline and history libraries, run-time libraries
ii libruby1.8 1.8.7.302-2squeeze1 Libraries necessary to run Ruby 1.8
ii libsasl2-2 2.1.23.dfsg1-7 Cyrus SASL - authentication abstraction library
ii libsasl2-modules 2.1.23.dfsg1-7 Cyrus SASL - pluggable authentication modules
ii libsdl1.2debian 1.2.14-6.1 Simple DirectMedia Layer
ii libsdl1.2debian-alsa 1.2.14-6.1 Simple DirectMedia Layer (with X11 and ALSA options)
ii libselinux1 2.0.96-1 SELinux runtime shared libraries
ii libsepol1 2.0.41-1 SELinux library for manipulating binary security policies
ii libsigc++-2.0-0c2a 2.2.4.2-1 type-safe Signal Framework for C++ - runtime
ii libslang2 2.2.2-4 The S-Lang programming library - runtime version
ii libsm6 2:1.1.1-1 X11 Session Management library
ii libsndfile1 1.0.21-3+squeeze1 Library for reading/writing audio files
ii libsqlite0 2.8.17-6 SQLite shared library
ii libsqlite3-0 3.7.3-1 SQLite 3 shared library
ii libss2 1.41.12-4stable1 command-line interface parsing library
ii libssh2-1 1.2.6-1 SSH2 client-side library
ii libssl0.9.8 0.9.8o-4squeeze4 SSL shared libraries
ii libstdc++6 4.4.5-8 The GNU Standard C++ Library v3
ii libstdc++6-4.4-dev 4.4.5-8 The GNU Standard C++ Library v3 (development files)
ii libsvga1 1:1.4.3-29 console SVGA display libraries
ii libsysfs2 2.1.0+repack-1 interface library to sysfs
ii libtasn1-3 2.7-1 Manage ASN.1 structures (runtime)
ii libtext-charwidth-perl 0.04-6 get display widths of characters on the terminal
ii libtext-iconv-perl 1.7-2 converts between character sets in Perl
ii libtext-wrapi18n-perl 0.06-7 internationalized substitute of Text::Wrap
ii libtimedate-perl 1.2000-1 collection of modules to manipulate date/time information
ii libts-0.0-0 1.0-7 touch screen library
ii libudev0 164-3 libudev shared library
ii libusb-0.1-4 2:0.1.12-16 userspace USB programming library
ii libuuid-perl 0.02-4 Perl extension for using UUID interfaces as defined in e2fsprogs
ii libuuid1 2.17.2-9 Universally Unique ID library
ii libvde0 2.2.3-3 Virtual Distributed Ethernet - support libraries
ii libvdeplug2 2.2.3-3 Virtual Distributed Ethernet - Plug library
ii libvorbis0a 1.3.1-1 The Vorbis General Audio Compression Codec (Decoder library)
ii libvorbisenc2 1.3.1-1 The Vorbis General Audio Compression Codec (Encoder library)
ii libwrap0 7.6.q-19 Wietse Venema's TCP wrappers library
ii libx11-6 2:1.3.3-4 X11 client-side library
ii libx11-data 2:1.3.3-4 X11 client-side library
ii libx86-1 1.1+ds1-6 x86 real-mode library
ii libxapian22 1.2.3-2 Search engine library
ii libxau6 1:1.0.6-1 X11 authorisation library
ii libxcb1 1.6-1 X C Binding
ii libxdamage1 1:1.1.3-1 X11 damaged region extension library
ii libxdmcp6 1:1.0.3-2 X11 Display Manager Control Protocol library
ii libxenstore3.0 4.0.1-4 Xenstore communications library for Xen
ii libxext6 2:1.1.2-1 X11 miscellaneous extension library
ii libxfixes3 1:4.0.5-1 X11 miscellaneous 'fixes' extension library
ii libxi6 2:1.3-6 X11 Input extension library
ii libxml2 2.7.8.dfsg-2+squeeze2 GNOME XML library
ii libxmuu1 2:1.0.5-2 X11 miscellaneous micro-utility library
ii libxtst6 2:1.1.0-3 X11 Testing -- Record extension library
ii libxxf86vm1 1:1.1.0-2 X11 XFree86 video mode extension library
ii linux-base 2.6.32-39 Linux image base package
ii linux-image-2.6-amd64 2.6.32+29 Linux 2.6 for 64-bit PCs (meta-package)
ii linux-image-2.6.32-5-amd64 2.6.32-39 Linux 2.6.32 for 64-bit PCs
ii linux-image-2.6.32-5-xen-amd64 2.6.32-39 Linux 2.6.32 for 64-bit PCs, Xen dom0 support
ii linux-image-xen-amd64 2.6.32+29 Linux for 64-bit PCs (meta-package), Xen dom0 support
ii linux-libc-dev 2.6.32-41 Linux support headers for userspace development
ii locales 2.11.2-10 Embedded GNU C Library: National Language (locale) data [support]
ii login 1:4.1.4.2+svn3283-2+squeeze1 system login tools
ii logrotate 3.7.8-6 Log rotation utility
ii logtail 1.3.13 Print log file lines that have not been read (deprecated)
ii lsb-base 3.2-23.2squeeze1 Linux Standard Base 3.2 init script functionality
ii lsb-release 3.2-23.2squeeze1 Linux Standard Base version reporting utility
ii lshw 02.14-1 information about hardware configuration
ii lsof 4.81.dfsg.1-1 List open files
ii lvm2 2.02.66-5 The Linux Logical Volume Manager
ii make 3.81-8 An utility for Directing compilation.
ii man-db 2.5.7-8 on-line manual pager
ii manpages 3.27-1 Manual pages about using a GNU/Linux system
ii manpages-dev 3.27-1 Manual pages about using GNU/Linux for development
ii mawk 1.3.3-15 a pattern scanning and text processing language
ii mdadm 3.1.4-1+8efb9d1 tool to administer Linux MD arrays (software RAID)
ii mime-support 3.48-1 MIME files 'mime.types'& 'mailcap', and support programs
ii mknbi 1.4.4-7 Create tagged images for Etherboot or Netboot
ii module-init-tools 3.12-1 tools for managing Linux kernel modules
ii mount 2.17.2-9 Tools for mounting and manipulating filesystems
ii nano 2.2.4-1 small, friendly text editor inspired by Pico
ii ncurses-base 5.7+20100313-5 basic terminal type definitions
ii ncurses-bin 5.7+20100313-5 terminal-related programs and man pages
ii net-tools 1.60-23 The NET-3 networking toolkit
ii netbase 4.45 Basic TCP/IP networking system
ii netcat-traditional 1.10-38 TCP/IP swiss army knife
ii ntp 1:4.2.6.p2+dfsg-1+b1 Network Time Protocol daemon and utility programs
ii openbios-ppc 1.0+svn640-1 PowerPC Open Firmware
ii openbios-sparc 1.0+svn640-1 SPARC Open Firmware
ii openhackware 0.4.1-4 OpenFirmware emulator for PowerPC
ii opensm 3.2.6-20090317-2 An Infiniband subnet manager
ii openssh-blacklist 0.4.1 list of default blacklisted OpenSSH RSA and DSA keys
ii openssh-blacklist-extra 0.4.1 list of non-default blacklisted OpenSSH RSA and DSA keys
ii openssh-client 1:5.5p1-6+squeeze1 secure shell (SSH) client, for secure access to remote machines
ii openssh-server 1:5.5p1-6+squeeze1 secure shell (SSH) server, for secure access from remote machines
ii openssl 0.9.8o-4squeeze7 Secure Socket Layer (SSL) binary and related cryptographic tools
ii os-prober 1.42 utility to detect other OSes on a set of drives
ii passwd 1:4.1.4.2+svn3283-2+squeeze1 change and administer password and group data
ii patch 2.6-2 Apply a diff file to an original
ii pciutils 1:3.1.7-6 Linux PCI Utilities
ii perl 5.10.1-17squeeze3 Larry Wall's Practical Extraction and Report Language
ii perl-base 5.10.1-17squeeze3 minimal Perl system
ii perl-modules 5.10.1-17squeeze3 Core Perl modules
ii php5-cli 5.3.10-1~dotdeb.1 command-line interpreter for the php5 scripting language
ii php5-common 5.3.10-1~dotdeb.1 Common files for packages built from the php5 source
ii php5-curl 5.3.10-1~dotdeb.1 CURL module for php5
ii php5-sqlite 5.3.10-1~dotdeb.1 SQLite module for php5
ii php5-suhosin 5.3.10-1~dotdeb.1 suhosin module for php5
ii postfix 2.7.1-1+squeeze1 High-performance mail transport agent
ii procps 1:3.2.8-9 /proc file system utilities
ii pv 1.1.4-1 Shell pipeline element to meter data passing through
ii python 2.6.6-3+squeeze6 interactive high-level object-oriented language (default version)
ii python-central 0.6.16+nmu1 register and build utility for Python packages
ii python-minimal 2.6.6-3+squeeze6 minimal subset of the Python language (default version)
ii python-support 1.0.10 automated rebuilding support for Python modules
ii python2.5 2.5.5-11 An interactive high-level object-oriented language (version 2.5)
ii python2.5-minimal 2.5.5-11 A minimal subset of the Python language (version 2.5)
ii python2.6 2.6.6-8+b1 An interactive high-level object-oriented language (version 2.6)
ii python2.6-minimal 2.6.6-8+b1 A minimal subset of the Python language (version 2.6)
ii qemu-keymaps 0.12.5+dfsg-3squeeze1 QEMU keyboard maps
ii qemu-system 0.12.5+dfsg-3squeeze1 QEMU full system emulation binaries
ii qemu-utils 0.12.5+dfsg-3squeeze1 QEMU utilities
ii readline-common 6.1-3 GNU readline and history libraries, common files
ii rsyslog 4.6.4-2 enhanced multi-threaded syslogd
ii ruby1.8 1.8.7.302-2squeeze1 Interpreter of object-oriented scripting language Ruby 1.8
ii rubygems1.8 1.3.7-3 package management framework for Ruby libraries/applications
ii seabios 0.5.1-3 Legacy BIOS implementation
ii sed 4.2.1-7 The GNU sed stream editor
ii sensible-utils 0.0.4 Utilities for sensible alternative selection
ii sgml-base 1.26+nmu1 SGML infrastructure and SGML catalog file support
ii smartmontools 5.39.1+svn3124-2 control and monitor storage systems using S.M.A.R.T.
ii ssh 1:5.5p1-6+squeeze1 secure shell client and server (metapackage)
ii ssl-cert 1.0.28 simple debconf wrapper for OpenSSL
ii sudo 1.7.4p4-2.squeeze.2 Provide limited super user privileges to specific users
ii sysstat 9.0.6.1-2 system performance tools for Linux
ii sysv-rc 2.88dsf-13.1 System-V-like runlevel change mechanism
ii sysvinit 2.88dsf-13.1 System-V-like init utilities
ii sysvinit-utils 2.88dsf-13.1 System-V-like utilities
ii tar 1.23-3 GNU version of the tar archiving utility
ii tasksel 2.88 Tool for selecting tasks for installation on Debian systems
ii tasksel-data 2.88 Official tasks used for installation of Debian systems
ii tcpd 7.6.q-19 Wietse Venema's TCP wrapper utilities
ii tcpdump 4.1.1-1 A powerful tool for network monitoring and data acquisition
ii traceroute 1:2.0.15-1 Traces the route taken by packets over an IPv4/IPv6 network
ii tsconf 1.0-7 touch screen library common files
ii tzdata 2011n-0squeeze1 time zone and daylight-saving time data
ii ucf 3.0025+nmu1 Update Configuration File: preserve user changes to config files.
ii udev 164-3 /dev/ and hotplug management daemon
ii usbutils 0.87-5squeeze1 Linux USB utilities
ii util-linux 2.17.2-9 Miscellaneous system utilities
ii vde2 2.2.3-3 Virtual Distributed Ethernet
ii vgabios 0.6c-2 VGA BIOS software for the Bochs and Qemu emulated VGA card
ii vim 2:7.2.445+hg~cb94c42c0e1a-1 Vi IMproved - enhanced vi editor
ii vim-common 2:7.2.445+hg~cb94c42c0e1a-1 Vi IMproved - Common files
ii vim-runtime 2:7.2.445+hg~cb94c42c0e1a-1 Vi IMproved - Runtime files
ii vim-tiny 2:7.2.445+hg~cb94c42c0e1a-1 Vi IMproved - enhanced vi editor - compact version
ii wget 1.12-2.1 retrieves files from the web
ii whiptail 0.52.11-1 Displays user-friendly dialog boxes from shell scripts
ii whois 5.0.10 an intelligent whois client
ii x11-common 1:7.5+8+squeeze1 X Window System (X.Org) infrastructure
ii xauth 1:1.0.4-1 X authentication utility
ii xen-hypervisor-4.0-amd64 4.0.1-4 The Xen Hypervisor on AMD64
ii xen-qemu-dm-4.0 4.0.1-2+squeeze1 Xen Qemu Device Model virtual machine hardware emulator
ii xen-utils-4.0 4.0.1-4 XEN administrative tools
ii xen-utils-common 4.0.0-1 XEN administrative tools - common files
ii xenstore-utils 4.0.1-4 Xenstore utilities for Xen
ii xkb-data 1.8-2 X Keyboard Extension (XKB) configuration data
ii xml-core 0.13 XML infrastructure and XML catalog file support
ii xz-utils 5.0.0-2 XZ-format compression utilities
ii zlib1g 1:1.2.3.4.dfsg-3 compression library - runtime

Please let me know if anything further is required.




--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 4F7BA9DD.5070907@quintin.co.nz">http://lists.debian.org/4F7BA9DD.5070907@quintin.co.nz
 
Old 04-04-2012, 01:00 PM
Ian Campbell
 
Default Bug#667434: lvcreate / lvremove snapshot under Xen causes Kernel OOPs

Hi Quintin,

Thanks for your report.

On Wed, 2012-04-04 at 13:54 +1200, Quintin Russ wrote:
> Package: linux-image-2.6.32-5-xen-amd64
> Version: 2.6.32-39
> Severity: important
>
> We have observed an issue when a Xen dom0 is removing a snapshot for a
> logical volume and another process comes along to create a snapshot
> for that same device (different names) causing the server to Kernel
> Ooops. According to my logs sometimes removing of the snapshot can
> pause or take a while contributing to the issue. Attempts to add
> locking code (using dotlockfile) have not so far been successful in
> mitigating this bug, but we are still exploring this option.
>
> The nodes that are affected intermittently& we have been unable to
> reproduce this issue in the lab (on either the same model of hardware
> or hardware that has crashed in production). From our logs we can see
> that every time this issue occurs one process has been removing the
> snapshot while another has been creating a snapshot shortly after
> (seconds normally). We are currently seeing about a 5% chance of a
> crash per month (assuming our nodes are equal).
>
> This bug looks similar to a number of bugs that have already been
> filed related to this
> issue:http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=614400 A quick
> Google search shows many more (which have mostly been merged):
> https://www.google.co.nz/webhp?q=site%3Abugs.debian.org%20xen%
> 20snapshot%20kernel%20oops%20squeeze

Those issues were believed to be fixed in 2.6.32-34 and you are running
2.6.32-39 so either this is a different issue (perhaps with similar
symptoms) or the issue isn't really fixed. Either way I think we need to
see your kernel logs containing the actual oops in order to make any
progress.

Thanks,
Ian.

--
Ian Campbell
Current Noise: Cathedral - Carnival Bizarre

HOORAY, Ronald!! Now YOU can marry LINDA RONSTADT too!!




--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 1333544444.20582.13.camel@zakaz.uk.xensource.com"> http://lists.debian.org/1333544444.20582.13.camel@zakaz.uk.xensource.com
 
Old 04-04-2012, 09:00 PM
Quintin Russ
 
Default Bug#667434: lvcreate / lvremove snapshot under Xen causes Kernel OOPs

Hi Ian,

On 05/04/12 01:00, Ian Campbell wrote:

Hi Quintin,

Thanks for your report.

On Wed, 2012-04-04 at 13:54 +1200, Quintin Russ wrote:

Package: linux-image-2.6.32-5-xen-amd64
Version: 2.6.32-39
Severity: important

We have observed an issue when a Xen dom0 is removing a snapshot for a
logical volume and another process comes along to create a snapshot
for that same device (different names) causing the server to Kernel
Ooops. According to my logs sometimes removing of the snapshot can
pause or take a while contributing to the issue. Attempts to add
locking code (using dotlockfile) have not so far been successful in
mitigating this bug, but we are still exploring this option.

The nodes that are affected intermittently& we have been unable to
reproduce this issue in the lab (on either the same model of hardware
or hardware that has crashed in production). From our logs we can see
that every time this issue occurs one process has been removing the
snapshot while another has been creating a snapshot shortly after
(seconds normally). We are currently seeing about a 5% chance of a
crash per month (assuming our nodes are equal).

This bug looks similar to a number of bugs that have already been
filed related to this
issue:http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=614400 A quick
Google search shows many more (which have mostly been merged):
https://www.google.co.nz/webhp?q=site%3Abugs.debian.org%20xen%
20snapshot%20kernel%20oops%20squeeze

Those issues were believed to be fixed in 2.6.32-34 and you are running
2.6.32-39 so either this is a different issue (perhaps with similar
symptoms) or the issue isn't really fixed. Either way I think we need to
see your kernel logs containing the actual oops in order to make any
progress.


Yes, we have been having this problem since before 2.6.32-34 and were
very hopeful that change would fix it. This sadly was not the case.
Unfortunately there isn't anything in the logs for this, but I have a
screenshot from the console, which I have attached.


I also had an idle shell at the time the server crashed and this is what
I saw:


Message from syslogd@dom0 at Apr 4 01:37:22 ...
kernel:[4805213.000629] Oops: 0000 [#1] SMP

Message from syslogd@dom0 at Apr 4 01:37:22 ...
kernel:[4805213.000661] last sysfs file:
/sys/devices/virtual/block/dm-49/removable


Message from syslogd@dom0 at Apr 4 01:37:22 ...
kernel:[4805213.001891] Stack:

Message from syslogd@dom0 at Apr 4 01:37:22 ...
kernel:[4805213.002101] Call Trace:

Message from syslogd@dom0 at Apr 4 01:37:22 ...
kernel:[4805213.002540] Code: 66 ff 05 c9 83 58 00 48 89 ef e8 db 7a
f7 ff 48 89 df e8 7f fe ff ff e8 51 b0 21 00 48 c7 c7 e0 99 67 81 e8 3b
c0 21 00 48 8b 1b <48> 8b 03 48 81 fb 90 d1 48 81 0f 18 08 0f 85 64 ff
ff ff 66 ff


Message from syslogd@dom0 at Apr 4 01:37:22 ...
kernel:[4805213.002901] CR2: 0000000000000000

Please let me know if there is anything further I can provide.
 
Old 04-05-2012, 09:04 AM
Ian Campbell
 
Default Bug#667434: lvcreate / lvremove snapshot under Xen causes Kernel OOPs

On Thu, 2012-04-05 at 09:00 +1200, Quintin Russ wrote:
> Hi Ian,
>
> On 05/04/12 01:00, Ian Campbell wrote:
> > Hi Quintin,
> >
> > Thanks for your report.
> >
> > On Wed, 2012-04-04 at 13:54 +1200, Quintin Russ wrote:
> >> Package: linux-image-2.6.32-5-xen-amd64
> >> Version: 2.6.32-39
> >> Severity: important
> >>
> >> We have observed an issue when a Xen dom0 is removing a snapshot for a
> >> logical volume and another process comes along to create a snapshot
> >> for that same device (different names) causing the server to Kernel
> >> Ooops. According to my logs sometimes removing of the snapshot can
> >> pause or take a while contributing to the issue. Attempts to add
> >> locking code (using dotlockfile) have not so far been successful in
> >> mitigating this bug, but we are still exploring this option.
> >>
> >> The nodes that are affected intermittently& we have been unable to
> >> reproduce this issue in the lab (on either the same model of hardware
> >> or hardware that has crashed in production). From our logs we can see
> >> that every time this issue occurs one process has been removing the
> >> snapshot while another has been creating a snapshot shortly after
> >> (seconds normally). We are currently seeing about a 5% chance of a
> >> crash per month (assuming our nodes are equal).
> >>
> >> This bug looks similar to a number of bugs that have already been
> >> filed related to this
> >> issue:http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=614400 A quick
> >> Google search shows many more (which have mostly been merged):
> >> https://www.google.co.nz/webhp?q=site%3Abugs.debian.org%20xen%
> >> 20snapshot%20kernel%20oops%20squeeze
> > Those issues were believed to be fixed in 2.6.32-34 and you are running
> > 2.6.32-39 so either this is a different issue (perhaps with similar
> > symptoms) or the issue isn't really fixed. Either way I think we need to
> > see your kernel logs containing the actual oops in order to make any
> > progress.
>
> Yes, we have been having this problem since before 2.6.32-34 and were
> very hopeful that change would fix it. This sadly was not the case.
> Unfortunately there isn't anything in the logs for this, but I have a
> screenshot from the console, which I have attached.

Thanks.

Googling around for issues with sync_super threw up
https://bugzilla.redhat.com/show_bug.cgi?id=587265 and
https://bugzilla.redhat.com/show_bug.cgi?id=550724. Comment 81 of the
second one mentioned issues with IRQ handling which reminded me that a
bunch of those were fixed 2.6.32-40 whereas you are running -39 (which
is fair enough since that is the version currently in stable). Could you
try the kernel from stable-proposed-updates (now 2.6.32-43)?

Also referenced was https://lkml.org/lkml/2010/9/1/178 which supports
the interrupt problem theory.

If there's any chance of setting up a serial console to catch this issue
should it happen again then that would be very useful too.

Ian.

>
> I also had an idle shell at the time the server crashed and this is what
> I saw:
>
> Message from syslogd@dom0 at Apr 4 01:37:22 ...
> kernel:[4805213.000629] Oops: 0000 [#1] SMP
>
> Message from syslogd@dom0 at Apr 4 01:37:22 ...
> kernel:[4805213.000661] last sysfs file:
> /sys/devices/virtual/block/dm-49/removable
>
> Message from syslogd@dom0 at Apr 4 01:37:22 ...
> kernel:[4805213.001891] Stack:
>
> Message from syslogd@dom0 at Apr 4 01:37:22 ...
> kernel:[4805213.002101] Call Trace:
>
> Message from syslogd@dom0 at Apr 4 01:37:22 ...
> kernel:[4805213.002540] Code: 66 ff 05 c9 83 58 00 48 89 ef e8 db 7a
> f7 ff 48 89 df e8 7f fe ff ff e8 51 b0 21 00 48 c7 c7 e0 99 67 81 e8 3b
> c0 21 00 48 8b 1b <48> 8b 03 48 81 fb 90 d1 48 81 0f 18 08 0f 85 64 ff
> ff ff 66 ff
>
> Message from syslogd@dom0 at Apr 4 01:37:22 ...
> kernel:[4805213.002901] CR2: 0000000000000000
>
> Please let me know if there is anything further I can provide.

--
Ian Campbell
Current Noise: Crippled Black Phoenix - The Heart Of Every Country

Dealer prices may vary.




--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 1333616660.937.31.camel@zakaz.uk.xensource.com">ht tp://lists.debian.org/1333616660.937.31.camel@zakaz.uk.xensource.com
 
Old 04-09-2012, 11:05 PM
Quintin Russ
 
Default Bug#667434: lvcreate / lvremove snapshot under Xen causes Kernel OOPs

Hi Ian,

On 05/04/12 21:04, Ian Campbell wrote:

On Thu, 2012-04-05 at 09:00 +1200, Quintin Russ wrote:

Those issues were believed to be fixed in 2.6.32-34 and you are running
2.6.32-39 so either this is a different issue (perhaps with similar
symptoms) or the issue isn't really fixed. Either way I think we need to
see your kernel logs containing the actual oops in order to make any
progress.

Yes, we have been having this problem since before 2.6.32-34 and were
very hopeful that change would fix it. This sadly was not the case.
Unfortunately there isn't anything in the logs for this, but I have a
screenshot from the console, which I have attached.

Thanks.

Googling around for issues with sync_super threw up
https://bugzilla.redhat.com/show_bug.cgi?id=587265 and
https://bugzilla.redhat.com/show_bug.cgi?id=550724. Comment 81 of the
second one mentioned issues with IRQ handling which reminded me that a
bunch of those were fixed 2.6.32-40 whereas you are running -39 (which
is fair enough since that is the version currently in stable). Could you
try the kernel from stable-proposed-updates (now 2.6.32-43)?

Also referenced was https://lkml.org/lkml/2010/9/1/178 which supports
the interrupt problem theory.


Thanks for that, I think you could be on the right track here.

On another dom0 which crashed over the weekend I observed the following
behaviour at least 6 times while doing a raid re-sync, unsure if this is
related at all, but disk utilisation is low & the server is responsive.


Apr 10 03:30:47 dom0 kernel: [261639.807061] INFO: task umount:18216
blocked for more than 120 seconds.
Apr 10 03:30:47 dom0 kernel [261639.807098] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Apr 10 03:30:47 dom0 kernel: [261639.807146] umount D
0000000000000002 0 18216 18214 0x00000000
Apr 10 03:30:47 dom0 kernel: [261639.807152] ffff88003d44cdb0
0000000000000286 000000043ca5fd08 ffff88003ca5fd98
Apr 10 03:30:47 dom0 kernel: [261639.807157] 0000000000000000
0000000000000000 000000000000f9e0 ffff88003ca5ffd8
Apr 10 03:30:47 dom0 kernel: [261639.807161] 0000000000015780
0000000000015780 ffff88003d44a350 ffff88003d44a648

Apr 10 03:30:47 dom0 kernel: [261639.807165] Call Trace:
Apr 10 03:30:47 dom0 kernel: [261639.807177] [<ffffffff8100e635>] ?
xen_force_evtchn_callback+0x9/0xa
Apr 10 03:30:47 dom0 kernel: [261639.807180] [<ffffffff8100ecf2>] ?
check_events+0x12/0x20
Apr 10 03:30:47 dom0 kernel: [261639.807186] [<ffffffff81040e42>] ?
check_preempt_wakeup+0x0/0x268
Apr 10 03:30:47 dom0 kernel: [261639.807191] [<ffffffff81109647>] ?
bdi_sched_wait+0x0/0xe
Apr 10 03:30:47 dom0 kernel: [261639.807194] [<ffffffff81109650>] ?
bdi_sched_wait+0x9/0xe
Apr 10 03:30:47 dom0 kernel: [261639.807201] [<ffffffff8130deda>] ?
_spin_unlock_irqrestore+0xd/0xe
Apr 10 03:30:47 dom0 kernel: [261639.807205] [<ffffffff8130d127>] ?
__wait_on_bit+0x41/0x70
Apr 10 03:30:47 dom0 kernel: [261639.807208] [<ffffffff81040e42>] ?
check_preempt_wakeup+0x0/0x268
Apr 10 03:30:47 dom0 kernel: [261639.807211] [<ffffffff81109647>] ?
bdi_sched_wait+0x0/0xe
Apr 10 03:30:47 dom0 kernel: [261639.807214] [<ffffffff8130d1c1>] ?
out_of_line_wait_on_bit+0x6b/0x77
Apr 10 03:30:47 dom0 kernel: [261639.807219] [<ffffffff81066048>] ?
wake_bit_function+0x0/0x23
Apr 10 03:30:47 dom0 kernel: [261639.807222] [<ffffffff811096c8>] ?
sync_inodes_sb+0x73/0x12a
Apr 10 03:30:47 dom0 kernel: [261639.807227] [<ffffffff8110d27d>] ?
__sync_filesystem+0x4b/0x70
Apr 10 03:30:47 dom0 kernel: [261639.807239] [<ffffffff810f1e5e>] ?
generic_shutdown_super+0x21/0xfa
Apr 10 03:30:47 dom0 kernel: [261639.807242] [<ffffffff8100ecdf>] ?
xen_restore_fl_direct_end+0x0/0x1
Apr 10 03:30:47 dom0 kernel: [261639.807245] [<ffffffff810f1f59>] ?
kill_block_super+0x22/0x3a
Apr 10 03:30:47 dom0 kernel: [261639.807249] [<ffffffff810f2629>] ?
deactivate_super+0x60/0x77
Apr 10 03:30:47 dom0 kernel: [261639.807254] [<ffffffff81104f9c>] ?
sys_umount+0x2dc/0x30b
Apr 10 03:30:47 dom0 kernel: [261639.807257] [<ffffffff81011b42>] ?
system_call_fastpath+0x16/0x1b


When reviewing our logs across multiple crashes affecting multiple
physical servers I note that 1 process is umounting the snapshot while
another process takes a new snapshot as the last log entry on the server
before the oops.


It will take us a few days (probably a week) or so to get this new
kernel rolled out, but will post an update here on how that has changed
things once I know more.



If there's any chance of setting up a serial console to catch this issue
should it happen again then that would be very useful too.


Will also be looking into the possibility of setting this up, as it has
been happening fairly frequently for us.


Thanks for your help so far. :-)

Best Regards,

Quintin



--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 4F836B56.6000900@quintin.co.nz">http://lists.debian.org/4F836B56.6000900@quintin.co.nz
 

Thread Tools




All times are GMT. The time now is 04:29 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright 2007 - 2008, www.linux-archive.org