Le 23/11/2011 13:48, Herbert Poetzl a écrit :
> On Tue, Nov 22, 2011 at 07:45:30PM +0100, Jean Weisbuch wrote:
>> Le 22/11/2011 18:35, Herbert Poetzl a écrit :
>>> On Tue, Nov 22, 2011 at 04:02:34PM +0100, Jean Weisbuch wrote:
>>>> Le 22/11/2011 13:01, Ben Green a écrit :
>>>>> A new kernel: 3.0.9-vs2.3.2.1 is now available on repo.psand.net.
>>>>> Util-vserver also updated to pre3000. Enjoy.
>>>>> Cheers,
>>>>> ==
>>>>> From Ben Green
>>>> Hello,
>>>> Its a good news, do you know if this kernel is still vulnerable
>>>> to the pivot root bug because we still have problems with the
>>>> 3.0.7 kernel?
>>> pardon my ignorance, but what is 'the pivot root bug'?
>>> TIA,
>>> Herbert
>>>> Regards.
>> Hello,
>> Its the problem described in here :
>> http://list.linux-vserver.org/archive?mss:5420:201110:mdaibmimlbgoligkjdma
>> and here
>> http://list.linux-vserver.org/archive?mss:5377:201109:jdhnnpplpaabpkjoiind
> well, that was speculation and handwaving and we have no
> indication that the problem is actually related to the
> locking mechanisms used and changed in pivot_root
>
>> Maybe the problem we are encountering lately is different
>> but few month ago when i checked it was verry similar to the
>> pivot_root problem on vanilla kernel.
> while this is entirely possible (i.e. that this was the
> issue caused by the pivot_root locking scheme) it has been
> fixed (by mainline) so it shouldn't happen with recent
> kernels anymore
>
>> Lately, crashes happens often when some php scripts that are
>> handling mutexes are executed and it seems that 3.0.7 from
>> psand repo is more prone to crash than 3.0.5, i upgraded one
>> of the nodes to the 3.0.9 from psand, i will try to get more
>> informations next time i encounter a problem.
> do you have any panic/stack trace from those 'crashes'
> to look at? maybe we can figure out what the issue is ...
>
> best,
> Herbert
>
>> Regards.
Hello,
We havent got any issue yet with the 3.0.9 kernels but we had a new
crash on one of the last running 2.6.38 today.
I first thought that the patch from last week on the mailing list ("Fix
process lockup on a loop device") might be the solution to the bug but
after analysing it, it only seems to adapt the VServer patch for the new
loop.c from 3.1 kernel without doing anything really differently as
before (i might be wrong).
Here is the log produced on kern.log (not even sure these errors are
related but i usually got some of these before a process crashes, there
are only kernel BUGS, since the 20nov (no logs before)) :
Dec 13 09:53:50 prem7 kernel: [9043406.097373] BUG: unable to handle
kernel paging request at 000000077dc5d1d0
Dec 13 09:53:50 prem7 kernel: [9043406.097424] IP:
[<ffffffff81035366>] task_rq_lock+0x37/0x7a
Dec 13 09:53:50 prem7 kernel: [9043406.097461] PGD 1652ce067 PUD 0
Dec 13 09:53:50 prem7 kernel: [9043406.097493] Oops: 0000 [#2] SMP
Dec 13 09:53:50 prem7 kernel: [9043406.097525] last sysfs file:
/sys/module/ip_tables/initstate
Dec 13 09:53:50 prem7 kernel: [9043406.097557] CPU 5
Dec 13 09:53:50 prem7 kernel: [9043406.097568] Modules linked in:
joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
nls_base e1000e [last unloaded: scsi_wait_scan]
Dec 13 09:53:50 prem7 kernel: [9043406.098059]
Dec 13 09:53:50 prem7 kernel: [9043406.098085] Pid: 9987, comm:
apache2 Tainted: G D 2.6.38.8-vs2.3.0.37-rc17-beng #1
Supermicro X8STi/X8STi
Dec 13 09:53:50 prem7 kernel: [9043406.098153] RIP:
0010:[<ffffffff81035366>] [<ffffffff81035366>] task_rq_lock+0x37/0x7a
Dec 13 09:53:50 prem7 kernel: [9043406.098212] RSP:
0000:ffff8801f42cbd58 EFLAGS: 00010092
Dec 13 09:53:50 prem7 kernel: [9043406.098244] RAX: 00000000ff8e3b40
RBX: 0000000000011b80 RCX: 0000000000000220
Dec 13 09:53:50 prem7 kernel: [9043406.098293] RDX: 0000000000000292
RSI: ffff8801f42cbd90 RDI: ffff8803fff37dc0
Dec 13 09:53:50 prem7 kernel: [9043406.098339] RBP: ffff8801f42cbd90
R08: ffff8801d3274660 R09: dead000000100100
Dec 13 09:53:50 prem7 kernel: [9043406.098388] R10: ffff8801f42cbed8
R11: ffff8801d3274648 R12: ffff8803fff37dc0
Dec 13 09:53:50 prem7 kernel: [9043406.098437] R13: 0000000000011b80
R14: 000000000000000f R15: ffff8801f42cbed8
Dec 13 09:53:50 prem7 kernel: [9043406.098487] FS:
0000000000000000(0000) GS:ffff8800df4a0000(0063) knlGS:00000000f74a1970
Dec 13 09:53:50 prem7 kernel: [9043406.098538] CS: 0010 DS: 002b
ES: 002b CR0: 000000008005003b
Dec 13 09:53:50 prem7 kernel: [9043406.098571] CR2: 000000077dc5d1d0
CR3: 00000003fc3de000 CR4: 00000000000006e0
Dec 13 09:53:50 prem7 kernel: [9043406.098621] DR0: 0000000000000000
DR1: 0000000000000000 DR2: 0000000000000000
Dec 13 09:53:50 prem7 kernel: [9043406.098671] DR3: 0000000000000000
DR6: 00000000ffff0ff0 DR7: 0000000000000400
Dec 13 09:53:50 prem7 kernel: [9043406.098721] Process apache2 (pid:
9987, threadinfo ffff8801f42ca000, task ffff880165380f00)
Dec 13 09:53:50 prem7 kernel: [9043406.098772] Stack:
Dec 13 09:53:50 prem7 kernel: [9043406.098797] ffff8801d3274648
ffff8801d3274610 ffff8803fff37dc0 0000000000000000
Dec 13 09:53:50 prem7 kernel: [9043406.098861] 0000000000000000
ffffffff8103a16c 00000001a3e16065 0000000000000292
Dec 13 09:53:50 prem7 kernel: [9043406.098921] 00000003068b8d56
ffff8801d3274610 ffff88015e1c5200 ffff8800113f7ec8
Dec 13 09:53:50 prem7 kernel: [9043406.098981] Call Trace:
Dec 13 09:53:50 prem7 kernel: [9043406.099010] [<ffffffff8103a16c>]
? try_to_wake_up+0x24/0x17b
Dec 13 09:53:50 prem7 kernel: [9043406.099043] [<ffffffff8114f320>]
? freeary+0x1a6/0x224
Dec 13 09:53:50 prem7 kernel: [9043406.099074] [<ffffffff8114ff71>]
? T.637+0x7d/0xb1
Dec 13 09:53:50 prem7 kernel: [9043406.099106] [<ffffffff81026ee8>]
? do_page_fault+0x2ad/0x2e5
Dec 13 09:53:50 prem7 kernel: [9043406.099140] [<ffffffff8111e55e>]
? fsnotify+0x24b/0x278
Dec 13 09:53:50 prem7 kernel: [9043406.099171] [<ffffffff8115065a>]
? sys_semctl+0x74/0x82
Dec 13 09:53:50 prem7 kernel: [9043406.099203] [<ffffffff8114cb70>]
? compat_sys_semctl+0x2ea/0x30d
Dec 13 09:53:50 prem7 kernel: [9043406.099237] [<ffffffff8102b833>]
? ia32_sysret+0x0/0x5
Dec 13 09:53:50 prem7 kernel: [9043406.099267] Code: 48 c7 c3 80 1b
01 00 48 83 ec 08 9c 58 0f 1f 44 00 00 48 89 c2 fa 66 0f 1f 44 00 00
48 89 55 00 49 8b 44 24 08 49 89 dd 8b 40 18 <4c> 03 2c c5 d0 f7 53
81 4c 89 ef e8 5b bd 2e 00 49 8b 44 24 08
Dec 13 09:53:50 prem7 kernel: [9043406.099486] RIP
[<ffffffff81035366>] task_rq_lock+0x37/0x7a
Dec 13 09:53:50 prem7 kernel: [9043406.099524] RSP <ffff8801f42cbd58>
Dec 13 09:53:50 prem7 kernel: [9043406.099551] CR2: 000000077dc5d1d0
Dec 13 09:53:50 prem7 kernel: [9043406.099850] ---[ end trace
3962b66abbf85317 ]---
Dec 18 02:46:27 prem7 kernel: [9448665.376340] BUG: unable to handle
kernel NULL pointer dereference at 0000000000000008
Dec 18 02:46:27 prem7 kernel: [9448665.376402] IP:
[<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 18 02:46:27 prem7 kernel: [9448665.376438] PGD 12cb09067 PUD 0
Dec 18 02:46:27 prem7 kernel: [9448665.376472] Oops: 0000 [#3] SMP
Dec 18 02:46:27 prem7 kernel: [9448665.376500] last sysfs file:
/sys/module/ip_tables/initstate
Dec 18 02:46:27 prem7 kernel: [9448665.376530] CPU 5
Dec 18 02:46:27 prem7 kernel: [9448665.376541] Modules linked in:
joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
nls_base e1000e [last unloaded: scsi_wait_scan]
Dec 18 02:46:27 prem7 kernel: [9448665.377027]
Dec 18 02:46:27 prem7 kernel: [9448665.377049] Pid: 9493, comm:
apache2 Tainted: G M D 2.6.38.8-vs2.3.0.37-rc17-beng #1
Supermicro X8STi/X8STi
Dec 18 02:46:27 prem7 kernel: [9448665.377116] RIP:
0010:[<ffffffff8103535b>] [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 18 02:46:27 prem7 kernel: [9448665.377175] RSP:
0000:ffff88015e0ebd58 EFLAGS: 00010092
Dec 18 02:46:27 prem7 kernel: [9448665.377207] RAX: 0000000000000292
RBX: 0000000000011b80 RCX: ffff88012aa94f40
Dec 18 02:46:27 prem7 kernel: [9448665.377256] RDX: 0000000000000292
RSI: ffff88015e0ebd90 RDI: 0000000000000000
Dec 18 02:46:27 prem7 kernel: [9448665.377305] RBP: ffff88015e0ebd90
R08: ffffffff81331cd0 R09: 0000000000000000
Dec 18 02:46:27 prem7 kernel: [9448665.377354] R10: ffff88015e0ebed8
R11: ffff880188f71888 R12: 0000000000000000
Dec 18 02:46:27 prem7 kernel: [9448665.377404] R13: 0000000000000000
R14: 000000000000000f R15: ffff88015e0ebed8
Dec 18 02:46:27 prem7 kernel: [9448665.377449] FS:
0000000000000000(0000) GS:ffff8800df4a0000(0063) knlGS:00000000f749c970
Dec 18 02:46:27 prem7 kernel: [9448665.383148] CS: 0010 DS: 002b
ES: 002b CR0: 000000008005003b
Dec 18 02:46:27 prem7 kernel: [9448665.383180] CR2: 0000000000000008
CR3: 0000000147265000 CR4: 00000000000006e0
Dec 18 02:46:27 prem7 kernel: [9448665.383228] DR0: 0000000000000000
DR1: 0000000000000000 DR2: 0000000000000000
Dec 18 02:46:27 prem7 kernel: [9448665.383276] DR3: 0000000000000000
DR6: 00000000ffff0ff0 DR7: 0000000000000400
Dec 18 02:46:27 prem7 kernel: [9448665.383325] Process apache2 (pid:
9493, threadinfo ffff88015e0ea000, task ffff8801a75be700)
Dec 18 02:46:27 prem7 kernel: [9448665.383375] Stack:
Dec 18 02:46:27 prem7 kernel: [9448665.383399] ffff88012aa94f40
ffff880188f71850 0000000000000000 0000000000000000
Dec 18 02:46:27 prem7 kernel: [9448665.383461] 0000000000000000
ffffffff8103a16c 0000000374aeb065 0000000000000292
Dec 18 02:46:27 prem7 kernel: [9448665.383518] 0000000f00000000
ffff880188f71850 ffff88027f686c00 ffff880114181ec8
Dec 18 02:46:27 prem7 kernel: [9448665.383575] Call Trace:
Dec 18 02:46:27 prem7 kernel: [9448665.383603] [<ffffffff8103a16c>]
? try_to_wake_up+0x24/0x17b
Dec 18 02:46:27 prem7 kernel: [9448665.383637] [<ffffffff8114f320>]
? freeary+0x1a6/0x224
Dec 18 02:46:27 prem7 kernel: [9448665.383668] [<ffffffff8114ff71>]
? T.637+0x7d/0xb1
Dec 18 02:46:27 prem7 kernel: [9448665.383700] [<ffffffff81026ee8>]
? do_page_fault+0x2ad/0x2e5
Dec 18 02:46:27 prem7 kernel: [9448665.383733] [<ffffffff8111e55e>]
? fsnotify+0x24b/0x278
Dec 18 02:46:27 prem7 kernel: [9448665.383765] [<ffffffff8115065a>]
? sys_semctl+0x74/0x82
Dec 18 02:46:27 prem7 kernel: [9448665.383796] [<ffffffff8114cb70>]
? compat_sys_semctl+0x2ea/0x30d
Dec 18 02:46:27 prem7 kernel: [9448665.383829] [<ffffffff8102b833>]
? ia32_sysret+0x0/0x5
Dec 18 02:46:27 prem7 kernel: [9448665.383858] Code: 55 41 54 49 89
fc 55 48 89 f5 53 48 c7 c3 80 1b 01 00 48 83 ec 08 9c 58 0f 1f 44 00
00 48 89 c2 fa 66 0f 1f 44 00 00 48 89 55 00 <49> 8b 44 24 08 49 89
dd 8b 40 18 4c 03 2c c5 d0 f7 53 81 4c 89
Dec 18 02:46:27 prem7 kernel: [9448665.384078] RIP
[<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 18 02:46:27 prem7 kernel: [9448665.384116] RSP <ffff88015e0ebd58>
Dec 18 02:46:27 prem7 kernel: [9448665.384143] CR2: 0000000000000008
Dec 18 02:46:27 prem7 kernel: [9448665.384433] ---[ end trace
3962b66abbf85318 ]---
Dec 22 14:52:17 prem7 kernel: [9836764.154178] BUG: unable to handle
kernel NULL pointer dereference at 0000000000000008
Dec 22 14:52:17 prem7 kernel: [9836764.154238] IP:
[<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 22 14:52:17 prem7 kernel: [9836764.154280] PGD 1aa576067 PUD 0
Dec 22 14:52:17 prem7 kernel: [9836764.154313] Oops: 0000 [#4] SMP
Dec 22 14:52:17 prem7 kernel: [9836764.154345] last sysfs file:
/sys/module/ip_tables/initstate
Dec 22 14:52:17 prem7 kernel: [9836764.154379] CPU 0
Dec 22 14:52:17 prem7 kernel: [9836764.154390] Modules linked in:
joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
nls_base e1000e [last unloaded: scsi_wait_scan]
Dec 22 14:52:17 prem7 kernel: [9836764.154898]
Dec 22 14:52:17 prem7 kernel: [9836764.154924] Pid: 22398, comm:
apache2 Tainted: G M D 2.6.38.8-vs2.3.0.37-rc17-beng #1
Supermicro X8STi/X8STi
Dec 22 14:52:17 prem7 kernel: [9836764.154996] RIP:
0010:[<ffffffff8103535b>] [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 22 14:52:17 prem7 kernel: [9836764.155056] RSP:
0000:ffff88014c80dd58 EFLAGS: 00010092
Dec 22 14:52:17 prem7 kernel: [9836764.155089] RAX: 0000000000000292
RBX: 0000000000011b80 RCX: ffff8801042d5500
Dec 22 14:52:17 prem7 kernel: [9836764.155139] RDX: 0000000000000292
RSI: ffff88014c80dd90 RDI: 0000000000000000
Dec 22 14:52:17 prem7 kernel: [9836764.155190] RBP: ffff88014c80dd90
R08: ffffffff81331cd0 R09: 0022f27c2125d3c3
Dec 22 14:52:17 prem7 kernel: [9836764.155240] R10: ffff88014c80ded8
R11: ffff8801042d5500 R12: 0000000000000000
Dec 22 14:52:17 prem7 kernel: [9836764.155286] R13: 0000000000000000
R14: 000000000000000f R15: ffff88014c80ded8
Dec 22 14:52:17 prem7 kernel: [9836764.155338] FS:
0000000000000000(0000) GS:ffff8800df400000(0063) knlGS:00000000f7520970
Dec 22 14:52:17 prem7 kernel: [9836764.155390] CS: 0010 DS: 002b
ES: 002b CR0: 000000008005003b
Dec 22 14:52:17 prem7 kernel: [9836764.155423] CR2: 0000000000000008
CR3: 000000014fe13000 CR4: 00000000000006f0
Dec 22 14:52:17 prem7 kernel: [9836764.155474] DR0: 0000000000000000
DR1: 0000000000000000 DR2: 0000000000000000
Dec 22 14:52:17 prem7 kernel: [9836764.155524] DR3: 0000000000000000
DR6: 00000000ffff0ff0 DR7: 0000000000000400
Dec 22 14:52:17 prem7 kernel: [9836764.155573] Process apache2 (pid:
22398, threadinfo ffff88014c80c000, task ffff88012640c4c0)
Dec 22 14:52:17 prem7 kernel: [9836764.155626] Stack:
Dec 22 14:52:17 prem7 kernel: [9836764.155651] ffff8801042d5500
ffff88037cc38310 0000000000000000 0000000000000000
Dec 22 14:52:17 prem7 kernel: [9836764.155713] 0000000000000000
ffffffff8103a16c 0000000299979065 0000000000000292
Dec 22 14:52:17 prem7 kernel: [9836764.155770] 0000000000000000
ffff88037cc38310 ffff88039461b000 ffff88015f23bec8
Dec 22 14:52:17 prem7 kernel: [9836764.155834] Call Trace:
Dec 22 14:52:17 prem7 kernel: [9836764.155864] [<ffffffff8103a16c>]
? try_to_wake_up+0x24/0x17b
Dec 22 14:52:17 prem7 kernel: [9836764.155900] [<ffffffff8114f320>]
? freeary+0x1a6/0x224
Dec 22 14:52:17 prem7 kernel: [9836764.155933] [<ffffffff8114ff71>]
? T.637+0x7d/0xb1
Dec 22 14:52:17 prem7 kernel: [9836764.155967] [<ffffffff81026ee8>]
? do_page_fault+0x2ad/0x2e5
Dec 22 14:52:17 prem7 kernel: [9836764.156003] [<ffffffff8111e55e>]
? fsnotify+0x24b/0x278
Dec 22 14:52:17 prem7 kernel: [9836764.156035] [<ffffffff8115065a>]
? sys_semctl+0x74/0x82
Dec 22 14:52:17 prem7 kernel: [9836764.156068] [<ffffffff8114cb70>]
? compat_sys_semctl+0x2ea/0x30d
Dec 22 14:52:17 prem7 kernel: [9836764.156104] [<ffffffff8102b833>]
? ia32_sysret+0x0/0x5
Dec 22 14:52:17 prem7 kernel: [9836764.156136] Code: 55 41 54 49 89
fc 55 48 89 f5 53 48 c7 c3 80 1b 01 00 48 83 ec 08 9c 58 0f 1f 44 00
00 48 89 c2 fa 66 0f 1f 44 00 00 48 89 55 00 <49> 8b 44 24 08 49 89
dd 8b 40 18 4c 03 2c c5 d0 f7 53 81 4c 89
Dec 22 14:52:17 prem7 kernel: [9836764.156382] RIP
[<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 22 14:52:17 prem7 kernel: [9836764.156418] RSP <ffff88014c80dd58>
Dec 22 14:52:17 prem7 kernel: [9836764.156446] CR2: 0000000000000008
Dec 22 14:52:17 prem7 kernel: [9836764.156746] ---[ end trace
3962b66abbf85319 ]---
Dec 23 00:21:45 prem7 kernel: [9870839.738497] BUG: unable to handle
kernel paging request at 0000000080000007
Dec 23 00:21:45 prem7 kernel: [9870839.738544] IP:
[<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 23 00:21:45 prem7 kernel: [9870839.738582] PGD 136c47067 PUD 0
Dec 23 00:21:45 prem7 kernel: [9870839.738614] Oops: 0000 [#5] SMP
Dec 23 00:21:45 prem7 kernel: [9870839.738646] last sysfs file:
/sys/module/ip_tables/initstate
Dec 23 00:21:45 prem7 kernel: [9870839.738680] CPU 5
Dec 23 00:21:45 prem7 kernel: [9870839.738690] Modules linked in:
joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
nls_base e1000e [last unloaded: scsi_wait_scan]
Dec 23 00:21:45 prem7 kernel: [9870839.739178]
Dec 23 00:21:45 prem7 kernel: [9870839.739204] Pid: 4448, comm:
apache2 Tainted: G M D 2.6.38.8-vs2.3.0.37-rc17-beng #1
Supermicro X8STi/X8STi
Dec 23 00:21:45 prem7 kernel: [9870839.739272] RIP:
0010:[<ffffffff8103535b>] [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 23 00:21:45 prem7 kernel: [9870839.739331] RSP:
0000:ffff880005001d58 EFLAGS: 00010092
Dec 23 00:21:45 prem7 kernel: [9870839.744937] RAX: 0000000000000292
RBX: 0000000000011b80 RCX: 0000000000000220
Dec 23 00:21:45 prem7 kernel: [9870839.744987] RDX: 0000000000000292
RSI: ffff880005001d90 RDI: 000000007fffffff
Dec 23 00:21:45 prem7 kernel: [9870839.745036] RBP: ffff880005001d90
R08: ffff8803905ad120 R09: dead000000100100
Dec 23 00:21:45 prem7 kernel: [9870839.745085] R10: ffff880005001ed8
R11: ffff8803905ad108 R12: 000000007fffffff
Dec 23 00:21:45 prem7 kernel: [9870839.745134] R13: 0000000000000000
R14: 000000000000000f R15: ffff880005001ed8
Dec 23 00:21:45 prem7 kernel: [9870839.745184] FS:
0000000000000000(0000) GS:ffff8800df4a0000(0063) knlGS:00000000f7525970
Dec 23 00:21:45 prem7 kernel: [9870839.745236] CS: 0010 DS: 002b
ES: 002b CR0: 000000008005003b
Dec 23 00:21:45 prem7 kernel: [9870839.745269] CR2: 0000000080000007
CR3: 000000012251e000 CR4: 00000000000006e0
Dec 23 00:21:45 prem7 kernel: [9870839.745321] DR0: 0000000000000000
DR1: 0000000000000000 DR2: 0000000000000000
Dec 23 00:21:45 prem7 kernel: [9870839.745373] DR3: 0000000000000000
DR6: 00000000ffff0ff0 DR7: 0000000000000400
Dec 23 00:21:45 prem7 kernel: [9870839.745424] Process apache2 (pid:
4448, threadinfo ffff880005000000, task ffff880162070b00)
Dec 23 00:21:45 prem7 kernel: [9870839.745476] Stack:
Dec 23 00:21:45 prem7 kernel: [9870839.745502] ffff8803905ad108
ffff8803905ad0d0 000000007fffffff 0000000000000000
Dec 23 00:21:45 prem7 kernel: [9870839.745567] 0000000000000000
ffffffff8103a16c 00000002c7b72065 0000000000000292
Dec 23 00:21:45 prem7 kernel: [9870839.745631] 0000000049000ea0
ffff8803905ad0d0 ffff8803fb9e7200 ffff880100ce5ec8
Dec 23 00:21:45 prem7 kernel: [9870839.745691] Call Trace:
Dec 23 00:21:45 prem7 kernel: [9870839.745723] [<ffffffff8103a16c>]
? try_to_wake_up+0x24/0x17b
Dec 23 00:21:45 prem7 kernel: [9870839.745758] [<ffffffff8114f320>]
? freeary+0x1a6/0x224
Dec 23 00:21:45 prem7 kernel: [9870839.745791] [<ffffffff8114ff71>]
? T.637+0x7d/0xb1
Dec 23 00:21:45 prem7 kernel: [9870839.745825] [<ffffffff81026ee8>]
? do_page_fault+0x2ad/0x2e5
Dec 23 00:21:45 prem7 kernel: [9870839.745860] [<ffffffff8111e55e>]
? fsnotify+0x24b/0x278
Dec 23 00:21:45 prem7 kernel: [9870839.745892] [<ffffffff8115065a>]
? sys_semctl+0x74/0x82
Dec 23 00:21:45 prem7 kernel: [9870839.745925] [<ffffffff8114cb70>]
? compat_sys_semctl+0x2ea/0x30d
Dec 23 00:21:45 prem7 kernel: [9870839.745959] [<ffffffff8102b833>]
? ia32_sysret+0x0/0x5
Dec 23 00:21:45 prem7 kernel: [9870839.745990] Code: 55 41 54 49 89
fc 55 48 89 f5 53 48 c7 c3 80 1b 01 00 48 83 ec 08 9c 58 0f 1f 44 00
00 48 89 c2 fa 66 0f 1f 44 00 00 48 89 55 00 <49> 8b 44 24 08 49 89
dd 8b 40 18 4c 03 2c c5 d0 f7 53 81 4c 89
Dec 23 00:21:45 prem7 kernel: [9870839.746216] RIP
[<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
Dec 23 00:21:45 prem7 kernel: [9870839.746251] RSP <ffff880005001d58>
Dec 23 00:21:45 prem7 kernel: [9870839.746279] CR2: 0000000080000007
Dec 23 00:21:45 prem7 kernel: [9870839.746574] ---[ end trace
3962b66abbf8531a ]---
root@prem7:~# vps aux|egrep '4448|22398|p1096'
root 21290 1096 p1096 0.0 0.0 11524 3316 ?
Ds 01:42 0:00 /usr/sbin/apache2 -k restart
www-data 21291 1096 p1096 0.0 0.0 0 0 ?
Z 01:42 0:00 [apache2] <defunct>
root@prem7:~# uname -a
Linux prem7 2.6.38.8-vs2.3.0.37-rc17-beng #1 SMP Wed Jun 15 11:06:07
BST 2011 x86_64 GNU/Linux
root@prem7:~# uptime
05:17:34 up 114 days, 18:15, 3 users, load average: 6.24, 6.20, 6.25
If i try to attach the process in gdb from the host it says "Operation
not permitted" for both processes, here is what i got from the guest (as
root) :
(gdb) attach 21291
Attaching to process 21291
ptrace: Operation not permitted.
(gdb) attach 21290
Attaching to process 21290
^C^C^C^C
It seems to lock gdb (^C are my control break attemps btw), if i do a
kill (to the gdb process) from another terminal :
^C^C^C^C/build/buildd/gdb-6.8/gdb/linux-nat.c:1072: internal-error:
linux_nat_detach: Assertion `num_lwps == 1' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.
Quit this debugging session? (y or n)
If you would need some other informations next time i encounter one of
those, could you tell me what else i could check?
ps: guests are on Debian 5.0 i386 and hosts are on Debian 6.0 amd64.
Regards.
Received on Fri Dec 23 04:30:14 2011