Linux Archive

Linux Archive (http://www.linux-archive.org/)
-   Debian Kernel (http://www.linux-archive.org/debian-kernel/)
-   -   Bug#584217: linux-image-2.6.26-2-686-bigmem: kernel oops in kvm: _bounce_end_io_read (http://www.linux-archive.org/debian-kernel/380335-bug-584217-linux-image-2-6-26-2-686-bigmem-kernel-oops-kvm-_bounce_end_io_read.html)

Brian Miculcy 06-02-2010 11:01 AM

Bug#584217: linux-image-2.6.26-2-686-bigmem: kernel oops in kvm: _bounce_end_io_read
 
Package: linux-2.6
Version: 2.6.26-22lenny1
Severity: critical
Tags: patch
Justification: breaks the whole system

After a few hours running the whole system - running in a kvm - locks up, showing a kernel backtrace.
This bug has been fixed: http://kerneltrap.org/mailarchive/linux-kvm/2009/6/20/6063133

More informations about this bug can be found in the Fedora Bugtracker
(https://bugzilla.redhat.com/show_bug.cgi?id=510304) or even in the Debian Bugtracker
(http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=548509).

Please apply!



-- Package-specific info:
** Version:
Linux version 2.6.26-2-686-bigmem (Debian 2.6.26-22lenny1) (dannf@debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Wed May 12 22:49:37 UTC 2010

** Command line:
root=/dev/vda2 ro elevator=noop vga=791

** Not tainted

** Kernel log:
[ 1.032779] rtc_cmos 00:01: setting system clock to 2010-06-02 06:08:20 UTC (1275458900)
[ 1.032989] Freeing unused kernel memory: 256k freed
[ 1.167241] ACPI: ACPI0007:00 is registered as cooling_device0
[ 1.528127] No dock devices found.
[ 1.540803] SCSI subsystem initialized
[ 1.560174] libata version 3.00 loaded.
[ 1.566125] Uniform Multi-Platform E-IDE driver
[ 1.567643] ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
[ 1.574007] PIIX3: IDE controller (0x8086:0x7010 rev 0x00) at PCI slot 0000:00:01.1
[ 1.575570] PIIX3: not 100% native mode: will probe irqs later
[ 1.576004] ide0: BM-DMA at 0xc000-0xc007
[ 1.576788] ide1: BM-DMA at 0xc008-0xc00f
[ 1.577531] Probing IDE interface ide0...
[ 1.640037] usbcore: registered new interface driver usbfs
[ 1.640939] usbcore: registered new interface driver hub
[ 1.641724] usbcore: registered new device driver usb
[ 1.652461] USB Universal Host Controller Interface driver v3.0
[ 1.752343] FDC 0 is a S82078B
[ 2.144061] Probing IDE interface ide1...
[ 2.884044] hdc: QEMU DVD-ROM, ATAPI CD/DVD-ROM drive
[ 3.556075] hdc: host max PIO4 wanted PIO255(auto-tune) selected PIO0
[ 3.556132] hdc: MWDMA2 mode selected
[ 3.558131] ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
[ 3.558933] ide1 at 0x170-0x177,0x376 on irq 15
[ 3.559928] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[ 3.560673] ACPI: PCI Interrupt 0000:00:01.2[D] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
[ 3.561444] PCI: Setting latency timer of device 0000:00:01.2 to 64
[ 3.561460] uhci_hcd 0000:00:01.2: UHCI Host Controller
[ 3.562284] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
[ 3.563101] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020
[ 3.563932] usb usb1: configuration #1 chosen from 1 choice
[ 3.564709] hub 1-0:1.0: USB hub found
[ 3.565439] hub 1-0:1.0: 2 ports detected
[ 3.668123] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001
[ 3.670319] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 3.671160] usb usb1: Product: UHCI Host Controller
[ 3.671933] usb usb1: Manufacturer: Linux 2.6.26-2-686-bigmem uhci_hcd
[ 3.672700] usb usb1: SerialNumber: 0000:00:01.2
[ 3.673729] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
[ 3.674485] ACPI: PCI Interrupt 0000:00:03.0[A] -> Link [LNKC] -> GSI 10 (level, high) -> IRQ 10
[ 3.676788] ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [LNKD] -> GSI 11 (level, high) -> IRQ 11
[ 3.677754] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[ 3.678501] ACPI: PCI Interrupt 0000:00:05.0[A] -> Link [LNKA] -> GSI 10 (level, high) -> IRQ 10
[ 3.680004] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 11
[ 3.680819] ACPI: PCI Interrupt 0000:00:06.0[A] -> Link [LNKB] -> GSI 11 (level, high) -> IRQ 11
[ 3.699069] hdc: ATAPI 4X CD-ROM drive, 512kB Cache
[ 3.700699] Uniform CD-ROM driver Revision: 3.20
[ 3.757100] vda: vda1 vda2 vda3
[ 3.760177] vdb: vdb1
[ 3.762002] vdc: vdc1
[ 4.208007] usb 1-1: new full speed USB device using uhci_hcd and address 2
[ 4.559344] EXT3-fs: INFO: recovery required on readonly filesystem.
[ 4.561014] EXT3-fs: write access will be enabled during recovery.
[ 4.563116] kjournald starting. Commit interval 5 seconds
[ 4.563901] EXT3-fs: recovery complete.
[ 4.565171] EXT3-fs: mounted filesystem with ordered data mode.
[ 4.875404] udevd version 125 started
[ 4.930056] usb 1-1: configuration #1 chosen from 1 choice
[ 4.941301] usb 1-1: New USB device found, idVendor=0403, idProduct=6001
[ 4.942134] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 4.942943] usb 1-1: Product: test
[ 4.943733] usb 1-1: Manufacturer: ftdi
[ 4.944549] usb 1-1: SerialNumber: ftE21WQS
[ 5.618299] input: Power Button (FF) as /class/input/input1
[ 5.652308] ACPI: Power Button (FF) [PWRF]
[ 5.897214] piix4_smbus 0000:00:01.3: Found 0000:00:01.3 device
[ 6.060636] input: PC Speaker as /class/input/input2
[ 6.229292] usbcore: registered new interface driver usbserial
[ 6.231396] usbserial: USB Serial support registered for generic
[ 6.232343] usbcore: registered new interface driver usbserial_generic
[ 6.233179] usbserial: USB Serial Driver core
[ 6.248961] usbserial: USB Serial support registered for FTDI USB Serial Device
[ 6.251093] ftdi_sio 1-1:1.0: FTDI USB Serial Device converter detected
[ 6.252356] ftdi_sio: Detected FT232BM
[ 6.253325] usb 1-1: FTDI USB Serial Device converter now attached to ttyUSB0
[ 6.254218] usbcore: registered new interface driver ftdi_sio
[ 6.255059] ftdi_sio: v1.4.3:USB FTDI Serial Converters Driver
[ 6.269254] input: ImExPS/2 Generic Explorer Mouse as /class/input/input3
[ 6.301129] parport_pc 00:05: reported by Plug and Play ACPI
[ 6.302258] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
[ 6.720875] Adding 1959888k swap on /dev/vda1. Priority:-1 extents:1 across:1959888k
[ 6.774996] EXT3 FS on vda2, internal journal
[ 7.832029] kjournald starting. Commit interval 5 seconds
[ 7.832029] EXT3 FS on vda3, internal journal
[ 7.832029] EXT3-fs: mounted filesystem with ordered data mode.
[ 7.832029] kjournald starting. Commit interval 5 seconds
[ 7.832029] EXT3 FS on vdb1, internal journal
[ 7.832029] EXT3-fs: mounted filesystem with ordered data mode.
[ 7.832029] kjournald starting. Commit interval 5 seconds
[ 7.832029] EXT3 FS on vdc1, internal journal
[ 7.832029] EXT3-fs: mounted filesystem with ordered data mode.
[ 8.198483] NET: Registered protocol family 10
[ 8.198716] lo: Disabled Privacy Extensions
[ 10.424614] lp0: using parport0 (interrupt-driven).
[ 10.459196] ppdev: user-space parallel port driver
[ 18.700198] eth0: no IPv6 routers present
[ 18.853918] warning: `ntpd' uses 32-bit capabilities (legacy support in use)
[ 226.100010] PPP generic driver version 2.4.2
[ 344.804001] PPP BSD Compression module registered
[ 344.844601] PPP Deflate Compression module registered

** Model information
not available

** Loaded modules:
Module Size Used by
ppp_deflate 4992 1
zlib_deflate 18392 1 ppp_deflate
zlib_inflate 14912 1 ppp_deflate
bsd_comp 5632 0
ppp_async 8256 1
crc_ccitt 2848 1 ppp_async
ppp_generic 20796 7 ppp_deflate,bsd_comp,ppp_async
slhc 6176 1 ppp_generic
ppdev 7236 0
lp 8932 0
ipv6 235940 34
ftdi_sio 45064 1
usbserial 27240 3 ftdi_sio
virtio_net 7520 0
parport_pc 23396 1
parport 31756 3 ppdev,lp,parport_pc
psmouse 33104 0
pcspkr 3200 0
serio_raw 5508 0
i2c_piix4 8016 0
i2c_core 20596 1 i2c_piix4
button 6864 0
evdev 8768 0
ext3 106344 4
jbd 40244 1 ext3
mbcache 7876 1 ext3
virtio_blk 5448 8
ide_cd_mod 28452 0
cdrom 30944 1 ide_cd_mod
floppy 48612 0
virtio_pci 5888 0
virtio_ring 4096 1 virtio_pci
virtio 5124 3 virtio_net,virtio_blk,virtio_pci
uhci_hcd 19504 0
usbcore 119216 4 ftdi_sio,usbserial,uhci_hcd
piix 7336 0 [permanent]
ide_pci_generic 4676 0 [permanent]
ide_core 97000 3 ide_cd_mod,piix,ide_pci_generic
ata_generic 5444 0
libata 141312 1 ata_generic
scsi_mod 130316 1 libata
dock 9072 1 libata
thermal 15996 0
processor 33536 1 thermal
fan 4964 0
thermal_sys 11624 3 thermal,processor,fan

** PCI devices:
00:00.0 Host bridge [0600]: Intel Corporation 440FX - 82441FX PMC [Natoma] [8086:1237] (rev 02)
Subsystem: Qumranet, Inc. Device [1af4:1100]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:01.0 ISA bridge [0601]: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II] [8086:7000]
Subsystem: Qumranet, Inc. Device [1af4:1100]
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0

00:01.1 IDE interface [0101]: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] [8086:7010] (prog-if 80 [Master])
Subsystem: Qumranet, Inc. Device [1af4:1100]
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Region 0: [virtual] Memory at 000001f0 (32-bit, non-prefetchable) [size=8]
Region 1: [virtual] Memory at 000003f0 (type 3, non-prefetchable) [size=1]
Region 2: [virtual] Memory at 00000170 (32-bit, non-prefetchable) [size=8]
Region 3: [virtual] Memory at 00000370 (type 3, non-prefetchable) [size=1]
Region 4: I/O ports at c000 [size=16]
Kernel driver in use: PIIX_IDE
Kernel modules: piix

00:01.2 USB Controller [0c03]: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] [8086:7020] (rev 01) (prog-if 00 [UHCI])
Subsystem: Qumranet, Inc. Device [1af4:1100]
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin D routed to IRQ 11
Region 4: I/O ports at c020 [size=32]
Kernel driver in use: uhci_hcd
Kernel modules: uhci-hcd

00:01.3 Bridge [0680]: Intel Corporation 82371AB/EB/MB PIIX4 ACPI [8086:7113] (rev 03)
Subsystem: Qumranet, Inc. Device [1af4:1100]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 9
Kernel driver in use: piix4_smbus
Kernel modules: i2c-piix4

00:02.0 VGA compatible controller [0300]: Cirrus Logic GD 5446 [1013:00b8] (prog-if 00 [VGA controller])
Subsystem: Qumranet, Inc. Device [1af4:1100]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Region 0: Memory at f0000000 (32-bit, prefetchable) [size=32M]
Region 1: Memory at f2000000 (32-bit, non-prefetchable) [size=4K]
Expansion ROM at f2010000 [disabled] [size=64K]
Kernel modules: cirrusfb

00:03.0 Ethernet controller [0200]: Qumranet, Inc. Device [1af4:1000]
Subsystem: Qumranet, Inc. Device [1af4:0001]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 10
Region 0: I/O ports at c040 [size=32]
Region 1: Memory at f2020000 (32-bit, non-prefetchable) [size=4K]
Expansion ROM at f2028000 [disabled] [size=32K]
Capabilities: [40] MSI-X: Enable- Mask- TabSize=3
Vector table: BAR=1 offset=00000000
PBA: BAR=1 offset=00000800
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci

00:04.0 SCSI storage controller [0100]: Qumranet, Inc. Device [1af4:1001]
Subsystem: Qumranet, Inc. Device [1af4:0002]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 11
Region 0: I/O ports at c080 [size=64]
Region 1: Memory at f2030000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [40] MSI-X: Enable- Mask- TabSize=2
Vector table: BAR=1 offset=00000000
PBA: BAR=1 offset=00000800
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci

00:05.0 SCSI storage controller [0100]: Qumranet, Inc. Device [1af4:1001]
Subsystem: Qumranet, Inc. Device [1af4:0002]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 10
Region 0: I/O ports at c0c0 [size=64]
Region 1: Memory at f2031000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [40] MSI-X: Enable- Mask- TabSize=2
Vector table: BAR=1 offset=00000000
PBA: BAR=1 offset=00000800
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci

00:06.0 SCSI storage controller [0100]: Qumranet, Inc. Device [1af4:1001]
Subsystem: Qumranet, Inc. Device [1af4:0002]
Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Interrupt: pin A routed to IRQ 11
Region 0: I/O ports at c100 [size=64]
Region 1: Memory at f2032000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [40] MSI-X: Enable- Mask- TabSize=2
Vector table: BAR=1 offset=00000000
PBA: BAR=1 offset=00000800
Kernel driver in use: virtio-pci
Kernel modules: virtio_pci


** Sound cards:

-- System Information:
Debian Release: 5.0.4
APT prefers stable
APT policy: (500, 'stable')
Architecture: i386 (i686)

Kernel: Linux 2.6.26-2-686-bigmem (SMP w/1 CPU core)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) (ignored: LC_ALL set to en_US.UTF-8)
Shell: /bin/sh linked to /bin/bash

Versions of packages linux-image-2.6.26-2-686-bigmem depends on:
ii debconf [debconf-2.0] 1.5.24 Debian configuration management sy
ii initramfs-tools [linux-initra 0.92o tools for generating an initramfs
ii module-init-tools 3.4-1 tools for managing Linux kernel mo

Versions of packages linux-image-2.6.26-2-686-bigmem recommends:
ii libc6-i686 2.7-18lenny2 GNU C Library: Shared libraries [i

Versions of packages linux-image-2.6.26-2-686-bigmem suggests:
ii grub 0.97-47lenny2 GRand Unified Bootloader (Legacy v
pn linux-doc-2.6.26 <none> (no description available)

Versions of packages linux-image-2.6.26-2-686-bigmem is related to:
pn firmware-bnx2 <none> (no description available)
pn firmware-bnx2x <none> (no description available)
pn firmware-ipw2x00 <none> (no description available)
pn firmware-ivtv <none> (no description available)
pn firmware-iwlwifi <none> (no description available)
pn firmware-linux <none> (no description available)
pn firmware-linux-nonfree <none> (no description available)
pn firmware-qlogic <none> (no description available)
pn firmware-ralink <none> (no description available)

-- debconf information:
linux-image-2.6.26-2-686-bigmem/preinst/overwriting-modules-2.6.26-2-686-bigmem: true
shared/kernel-image/really-run-bootloader: true
linux-image-2.6.26-2-686-bigmem/preinst/lilo-has-ramdisk:
linux-image-2.6.26-2-686-bigmem/postinst/bootloader-test-error-2.6.26-2-686-bigmem:
linux-image-2.6.26-2-686-bigmem/postinst/depmod-error-2.6.26-2-686-bigmem: false
linux-image-2.6.26-2-686-bigmem/preinst/initrd-2.6.26-2-686-bigmem:
linux-image-2.6.26-2-686-bigmem/preinst/abort-overwrite-2.6.26-2-686-bigmem:
* linux-image-2.6.26-2-686-bigmem/preinst/bootloader-initrd-2.6.26-2-686-bigmem: false
linux-image-2.6.26-2-686-bigmem/postinst/depmod-error-initrd-2.6.26-2-686-bigmem: false
* linux-image-2.6.26-2-686-bigmem/postinst/create-kimage-link-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/preinst/lilo-initrd-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/prerm/would-invalidate-boot-loader-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/preinst/failed-to-move-modules-2.6.26-2-686-bigmem:
linux-image-2.6.26-2-686-bigmem/prerm/removing-running-kernel-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/postinst/old-dir-initrd-link-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/preinst/elilo-initrd-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/preinst/abort-install-2.6.26-2-686-bigmem:
linux-image-2.6.26-2-686-bigmem/postinst/old-initrd-link-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/postinst/old-system-map-link-2.6.26-2-686-bigmem: true
linux-image-2.6.26-2-686-bigmem/postinst/bootloader-error-2.6.26-2-686-bigmem:
linux-image-2.6.26-2-686-bigmem/postinst/kimage-is-a-directory:



--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 20100602110115.23476.761.reportbug@judata.justizbo te.de">http://lists.debian.org/20100602110115.23476.761.reportbug@judata.justizbo te.de

Bastian Blank 06-02-2010 11:32 AM

Bug#584217: linux-image-2.6.26-2-686-bigmem: kernel oops in kvm: _bounce_end_io_read
 
severity 584217 important
tags 584217 lenny
fixed 584217 2.6.31-1
thanks

On Wed, Jun 02, 2010 at 01:01:15PM +0200, Brian Miculcy wrote:
> Severity: critical
> Tags: patch
> Justification: breaks the whole system

No, the kernel is the system.

> After a few hours running the whole system - running in a kvm - locks up, showing a kernel backtrace.
> This bug has been fixed: http://kerneltrap.org/mailarchive/linux-kvm/2009/6/20/6063133

4eff3cae9c9809720c636e64bc72f212258e0bd5, included in 2.6.31.

Bastian

--
You! What PLANET is this!
-- McCoy, "The City on the Edge of Forever", stardate 3134.0



--
To UNSUBSCRIBE, email to debian-kernel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 20100602113211.GA27176@wavehammer.waldi.eu.org">ht tp://lists.debian.org/20100602113211.GA27176@wavehammer.waldi.eu.org


All times are GMT. The time now is 03:34 AM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.