[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
find/updatedb difficulties
|
From: |
root |
|
Subject: |
find/updatedb difficulties |
|
Date: |
Mon, 12 Feb 2007 15:42:21 -0800 |
Mon Feb 12 2007
Mike McClain
address@hidden
To: address@hidden
Dear Sir:
For several months now my system has been locking up on me, usually
overnight. When I say locking up I mean that no command typed at the
command line will execute except Alt + Fn(change vt). Commands like ls,
shutdown or CtrlAltDel don't execute and the only thing I've found that
does is to hit the reset button on the PC. Kind of takes me back to the
good old days of DOS.
I've come to the conclusion that updatedb is the culprit though I'm
not quite sure how to prove it.
It has happened sporadically over the last couple of years and for
a while I thought a security script of my own might be the problem though
I could never get to happen when I ran the script from the command line.
Then when I ran 'updatedb' from the command line on a brand new
installation for Debian 3.1 I got the error:
'iput: inode 00:00/0 count wrapped'.
I'd seen this often enough before to recognize the symptom and shutdown
immediately only to receive this delightful message:
VFS: Busy inodes after unmount.
Self-destruct in 5 seconds. Have a nice day...
from /var/log/messages:
Jan 18 13:33:18 playground kernel: iput: inode 00:00/0 count wrapped
Jan 18 13:34:11 playground kernel: VFS: Busy inodes after unmount.
Self-destruct in 5 seconds. Have a nice day...
Jan 18 13:34:13 playground shutdown[3270]: shutting down for system reboot
---------------------------------------------------------------
I've quit seeing the problem since I put these lines in /etc/updatedb.conf:
hdaPRUNEPATHS=" /c /d /e /f"
hdcPRUNEPATHS=" /rh5 /rh6 /rh62 /deb30 /deb30b /deb30c /deb30d /deb31 /dsl
/slak70 /slak11"
# no spaces allowed in concatenation
PRUNEPATHS=$PRUNEPATHS$hdaPRUNEPATHS$hdcPRUNEPATHS
==========================================================================
/dev/hdc{6,8,15,17} are each Debian 3.0 Woody systems
Linux playground 2.2.20-idepci #1 Sat Apr 20 12:45:19 EST 2002 i586 unknown
/dev/hdc{10,14} are each Debian 3.1 Sarge systems
Linux playground 2.4.27 #3 Tue Feb 6 14:48:54 PST 2007 i586 GNU/Linux
These clipped from dmesg:
CPU: Intel Pentium MMX stepping 03
Memory: 257652k/262144k available
hda: WDC AC24300L, 4112MB w/256kB Cache, CHS=524/255/63
hdc: WDC WD400BB-00CAA0, 38166MB w/2048kB Cache, CHS=4865/255/63
hdb: ATAPI 52X CD-ROM CD-R/RW drive, 2048kB Cache
Adding Swap: 2048276k swap-space (priority -1)
swap was a smaller partition at the end of the drive but I moved it
after the crash on Dec. 7 thinking that might be the problem.
Eventually I moved it back.
-----------------------------------------------------------
# /deb30b/etc/fstab: static file system information.
#
# <file system> <mount point> <type> <options> <dump> <pass>
/dev/hdc8 / ext2 errors=remount-ro 0 1
proc /proc proc defaults 0 0
/dev/fd0 /floppy auto user,noauto 0 0
/dev/cdrom /cdrom iso9660 ro,user,noauto 0 0
# McClain's additions
# for 2nd drive on 40GB old machine w/ 4.3GB 1st
/dev/fd0 /a msdos owner,noauto 0 0
/dev/fd1 /b msdos owner,noauto 0 0
/dev/hda3 /c msdos defaults,ro 0 0
/dev/hda5 /d msdos defaults,ro 0 0
/dev/hda6 /dlnx umsdos defaults,noauto,ro 0 0
/dev/hda7 /e msdos defaults,ro 0 0
/dev/hda8 /f msdos defaults,ro 0 0
/dev/hdc1 /rh62 ext2 defaults,ro 0 0
/dev/hdc2 /slak70 ext2 defaults,ro 0 0
/dev/hdc3 /mc ext2 defaults 0 2
/dev/hdc5 /rh6 ext2 defaults,ro 0 0
/dev/hdc6 /deb30 ext2 defaults,ro 0 0
/dev/hdc7 /rh5 ext2 defaults,ro 0 0
/dev/hdc9 /opt ext2 defaults,ro 0 2
/dev/hdc10 /deb31 ext2 defaults,ro 0 0
/dev/hdc11 /dsl ext2 defaults,ro 0 0
/dev/hdc12 /slak11 ext2 defaults,ro 0 0
/dev/hdc13 /slak11CDs ext2 defaults,ro 0 0
/dev/hdc14 /deb31b ext2 defaults,ro 0 0
/dev/hdc15 /deb30c ext2 defaults,ro 0 0
/dev/hdc16 /deb31CDs ext2 defaults,ro 0 0
/dev/hdc17 /deb30d ext2 defaults,ro 0 0
/dev/hdc21 swap swap defaults 0 0
/dev/cdrom /CD iso9660 noauto,ro 0 0
#/dev/hda18 /freebsd ufs noauto,ufstype=44bsd,ro 0 0
#/dev/hda20 /fbsdusr ufs noauto,ufstype=44bsd,ro 0 0
#/dev/hda11 /solaris ufs noauto,ufstype=sun,ro 0 0
#/dev/hda12 /solopt ufs noauto,ufstype=sun,ro 0 0
#/dev/hda14 /solvar ufs noauto,ufstype=sun,ro 0 0
#/dev/hda16 /soldoc ufs noauto,ufstype=sun,ro 0 0
#/dev/hda17 /solusr ufs noauto,ufstype=sun,ro 0 0
-----------------------------------------------------------
/etc/cron.d/anacron runs at 03:30
-----------------------------------------------------------
excerpted from the logs:
from /var/log/syslog: 132 like this
Dec 24 03:35-46:xx playground kernel: \
iput: device {00:00,16:0{1-5,7-a,c} inode xxxxxx still has aliases!
----------------------------------------------------------
from /var/log/kern.log:
Dec 23 03:35:06 playground kernel: eth0: Setting promiscuous mode.
Dec 23 03:35:06 playground kernel: device eth0 entered promiscuous mode
Dec 23 03:40:16 playground kernel: iput: inode 00:00/0 count wrapped
Dec 23 06:49:01 playground kernel: VFS: Busy inodes after unmount.
Self-destruct in 5 seconds. Have a nice day...
from /var/log/syslog.0:
Dec 23 03:35:09 playground snort: Snort initialization completed successfully
Snort running
Dec 23 03:38:02 playground /USR/SBIN/CRON[7772]: (mail) CMD
( if [ -x /usr/sbin/exim -a -f /etc/exim/exim.conf ];
then /usr/sbin/exim -q ; fi)
Dec 23 03:40:16 playground kernel: iput: inode 00:00/0 count wrapped
-----------------------------------------------------------
from /var/log/kern.log
Dec 19 03:37:43 playground kernel: Unable to handle kernel NULL pointer
dereference at virtual address 00000020
Dec 19 03:37:43 playground kernel: current->tss.cr3 = 0d4dd000, %%cr3 = 0d4dd000
Dec 19 03:37:43 playground kernel: *pde = 00000000
Dec 19 03:37:43 playground kernel: Oops: 0000
Dec 19 03:37:43 playground kernel: CPU: 0
Dec 19 03:37:43 playground kernel: EIP: 0010:[iput+24/488]
Dec 19 03:37:43 playground kernel: EFLAGS: 00010202
Dec 19 03:37:43 playground kernel: eax: 00000008 ebx: 00000000 ecx:
cd379708 edx: cdffbbc8
Dec 19 03:37:43 playground kernel: esi: cdb796f8 edi: cdffbb90 ebp:
00000000 esp: ccadfe68
Dec 19 03:37:43 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 19 03:37:43 playground kernel: Process find (pid: 6593, process nr: 23,
stackpage=ccadf000)
Dec 19 03:37:43 playground kernel: Stack: cdffbb90 c0132f36 cdb796f8 ccadfeac
00038c83 00001004 cf6ab600 00001004
Dec 19 03:37:43 playground kernel: c0133ed0 fffffd87 00000d8b c0229128
00038c83 c0255da4 cf6ab600 c8fe3501
Dec 19 03:37:43 playground kernel: c013e9f4 ccadfeac ccadfeac c0133f38
00001004 c0229128 00038c83 c0255da4
Dec 19 03:37:43 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Dec 19 03:37:43 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Dec 19 03:37:43 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
These are clippings from /var/log/syslog:
Dec 14 03:01:01 playground /USR/SBIN/CRON[7729]: (root) CMD ( /mc/bin/secure
deb)
Dec 14 03:01:54 playground kernel: Unable to handle kernel paging request at
virtual address 6e65698a
Dec 14 03:01:54 playground kernel: current->tss.cr3 = 09901000, %%cr3 = 09901000
Dec 14 03:01:54 playground kernel: *pde = 00000000
Dec 14 03:01:54 playground kernel: Oops: 0000
Dec 14 03:01:54 playground kernel: CPU: 0
Dec 14 03:01:54 playground kernel: EIP: 0010:[iput+24/488]
Dec 14 03:01:54 playground kernel: EFLAGS: 00010206
Dec 14 03:01:54 playground kernel: eax: 6e656972 ebx: 00000000 ecx:
c96f2ac8 edx: c708c408
Dec 14 03:01:54 playground kernel: esi: c9ef2ab8 edi: c708c3d0 ebp:
00000000 esp: c4ddbe68
Dec 14 03:01:54 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 14 03:01:54 playground kernel: Process find (pid: 7763, process nr: 63,
stackpage=c4ddb000)
Dec 14 03:01:54 playground kernel: Stack: c708c3d0 c0132f36 c9ef2ab8 c4ddbeac
00000134 00001004 cffd0800 00001004
Dec 14 03:01:54 playground kernel: c0133ed0 fffff111 00000118 c0229128
00000134 c0255d84 cffd0800 c01290df
Dec 14 03:01:54 playground kernel: cd462670 c4ddbeac c4ddbeac c0133f38
00001004 c0229128 00000134 c0255d84
Dec 14 03:01:54 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Dec 14 03:01:54 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Dec 14 03:01:54 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
These are clippings from /var/log/kern.log:
Dec 7 03:01:06 playground kernel: Unable to handle kernel paging request at
virtual address ff1a7408
Dec 7 03:01:06 playground kernel: current->tss.cr3 = 032c3000, %%cr3 = 032c3000
Dec 7 03:01:06 playground kernel: *pde = 00000000
Dec 7 03:01:06 playground kernel: Oops: 0000
Dec 7 03:01:06 playground kernel: CPU: 0
Dec 7 03:01:06 playground kernel: EIP: 0010:[iput+37/488]
Dec 7 03:01:06 playground kernel: EFLAGS: 00010286
Dec 7 03:01:06 playground kernel: eax: ff1a7400 ebx: ff1a7400 ecx:
c09a18f8 edx: cd928ae8
Dec 7 03:01:06 playground kernel: esi: ce8e36f8 edi: cd928ab0 ebp:
00000000 esp: c3f7fe68
Dec 7 03:01:06 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 7 03:01:06 playground kernel: Process find (pid: 16679, process nr: 57,
stackpage=c3f7f000)
Dec 7 03:01:06 playground kernel: Stack: cd928ab0 c0132f36 ce8e36f8 c3f7feac
00037554 00001004 cffd0800 00001004
Dec 7 03:01:06 playground kernel: c0133ed0 ffffff5b 00000f6f c0229128
00037554 c0256224 cffd0800 cf6472c5
Dec 7 03:01:06 playground kernel: c013e9f4 c3f7feac c3f7feac c0133f38
00001004 c0229128 00037554 c0256224
Dec 7 03:01:06 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Dec 7 03:01:06 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Dec 7 03:01:06 playground kernel: Code: 8b 43 08 85 c0 74 06 56 ff d0 83 c4 04
8b 46 1c 8d 78 ff 89
-----------------------------------------------------------
Dec 1 09:50:15 playground kernel: Unable to handle kernel paging request at
virtual address eaaec9bc
Dec 1 09:50:15 playground kernel: current->tss.cr3 = 0901e000, %%cr3 = 0901e000
Dec 1 09:50:15 playground kernel: *pde = 00000000
Dec 1 09:50:15 playground kernel: Oops: 0000
Dec 1 09:50:15 playground kernel: CPU: 0
Dec 1 09:50:15 playground kernel: EIP: 0010:[sys_newlstat+38/96]
Dec 1 09:50:15 playground kernel: EFLAGS: 00010282
Dec 1 09:50:15 playground kernel: eax: eaaec970 ebx: c17c5060 ecx:
00000000 edx: c035bfe8
Dec 1 09:50:15 playground kernel: esi: c17c5060 edi: 0805658c ebp:
bfffed7c esp: c0a01fc0
Dec 1 09:50:15 playground kernel: ds: 0018 es: 0018 ss: 0018
Dec 1 09:50:15 playground kernel: Process find (pid: 3179, process nr: 30,
stackpage=c0a01000)
Dec 1 09:50:15 playground kernel: Stack: c010a1dc 0805658c bfffed3c 0805658c
401354ec 0805658c bfffed7c 0000006b
Dec 1 09:50:15 playground kernel: 0000002b 0000002b 0000006b 400db70e
00000023 00000202 bfffed10 0000002b
Dec 1 09:50:15 playground kernel: Call Trace: [system_call+52/56]
Dec 1 09:50:15 playground kernel: Code: 8b 40 4c 85 c0 74 0b 53 ff d0 89 c3 83
c4 04 eb 03 90 31 db
This is a Woody system on /dev/hdc6
Sat Nov 25 2006 9:51
several crashes, last 22 Nov - kernel paging request,
reboot failing requiring fsck to repair disk hdc6
========================================================================
Mon Nov 27 2006 10:42
re-installed Deb3.0
Mar 10 07:35:02 playground anacron[6691]: Job `cron.daily' started
Mar 10 07:35:02 playground anacron[6695]: Updated timestamp for job
`cron.daily' to 2006-03-10
Mar 10 07:37:58 playground kernel: Unable to handle kernel paging request at
virtual address e8e8e900
Mar 10 07:37:58 playground kernel: current->tss.cr3 = 0482c000, %%cr3 = 0482c000
Mar 10 07:37:58 playground kernel: *pde = 00000000
Mar 10 07:37:58 playground kernel: Oops: 0000
Mar 10 07:37:58 playground kernel: CPU: 0
Mar 10 07:37:58 playground kernel: EIP: 0010:[iput+24/488]
Mar 10 07:37:58 playground kernel: EFLAGS: 00010286
Mar 10 07:37:58 playground kernel: eax: e8e8e8e8 ebx: 00000000 ecx:
c927f708 edx: cfbdc208
Mar 10 07:37:58 playground kernel: esi: c9a7f6f8 edi: cfbdc1d0 ebp:
00000000 esp: ca939e68
Mar 10 07:37:58 playground kernel: ds: 0018 es: 0018 ss: 0018
Mar 10 07:37:58 playground kernel: Process find (pid: 6740, process nr: 74,
stackpage=ca939000)
Mar 10 07:37:58 playground kernel: Stack: cfbdc1d0 c0132f36 c9a7f6f8 ca939eac
0003e432 00001004 cffd0200 00001004
Mar 10 07:37:58 playground kernel: c0133ed0 fffff33d 00000341 c0229128
0003e432 c0255c5c cffd0200 c01290df
Mar 10 07:37:58 playground kernel: cce297d0 ca939eac ca939eac c0133f38
00001004 c0229128 0003e432 c0255c5c
Mar 10 07:37:58 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Mar 10 07:37:58 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Mar 10 07:37:58 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
Mar 6 07:30:01 playground anacron[19671]: Anacron 2.3 started on 2006-03-06
Mar 6 07:30:02 playground anacron[19671]: Will run job `cron.daily' in 5 min.
Mar 6 07:30:02 playground anacron[19671]: Jobs will be executed sequentially
Mar 6 07:35:01 playground anacron[19671]: Job `cron.daily' started
Mar 6 07:35:01 playground anacron[19675]: Updated timestamp for job `cron.dail
Mar 6 07:43:08 playground kernel: Unable to handle kernel paging request at
virtual address 56026b10
Mar 6 07:43:08 playground kernel: current->tss.cr3 = 0873b000, %%cr3 = 0873b000
Mar 6 07:43:08 playground kernel: *pde = 00000000
Mar 6 07:43:08 playground kernel: Oops: 0000
Mar 6 07:43:08 playground kernel: CPU: 0
Mar 6 07:43:08 playground kernel: EIP: 0010:[iput+24/488]
Mar 6 07:43:08 playground kernel: EFLAGS: 00010202
Mar 6 07:43:08 playground kernel: eax: 56026af8 ebx: 00000000 ecx:
ca2b3708 edx: cf96e248
Mar 6 07:43:08 playground kernel: esi: caab36f8 edi: cf96e210 ebp:
00000000 esp: c8d95e68
Mar 6 07:43:08 playground kernel: ds: 0018 es: 0018 ss: 0018
Mar 6 07:43:08 playground kernel: Process find (pid: 19809, process nr: 73,
stackpage=c8d95000)
Mar 6 07:43:08 playground kernel: Stack: cf96e210 c0132f36 caab36f8 c8d95eac
0000c89c 00001004 cf5cb400 00001004
Mar 6 07:43:08 playground kernel: c0133ed0 fffff9d1 000009d5 c0229128
0000c89c c025605c cf5cb400 c01290df
Mar 6 07:43:08 playground kernel: c6c03f10 c8d95eac c8d95eac c0133f38
00001004 c0229128 0000c89c c025605c
Mar 6 07:43:08 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Mar 6 07:43:08 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Mar 6 07:43:08 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
Feb 9 00:05:35 playground kernel: Unable to handle kernel paging request at vi
Feb 9 00:05:35 playground kernel: current->tss.cr3 = 0c629000, %%cr3 = 0c62900
Feb 9 00:05:35 playground kernel: *pde = 00000000
Feb 9 00:05:35 playground kernel: Oops: 0000
Feb 9 00:05:35 playground kernel: CPU: 0
Feb 9 00:05:35 playground kernel: EIP: 0010:[iput+24/488]
Feb 9 00:05:35 playground kernel: EFLAGS: 00010202
Feb 9 00:05:35 playground kernel: eax: 07200720 ebx: 00000000 ecx:
ce07b708 edx: c7eeebe8
Feb 9 00:05:35 playground kernel: esi: ce87b6f8 edi: c7eeebb0 ebp:
00000000 esp: c14bde68
Feb 9 00:05:35 playground kernel: ds: 0018 es: 0018 ss: 0018
Feb 9 00:05:35 playground kernel: Process find (pid: 23670, process nr: 63,
stackpage=c14bd000)
Feb 9 00:05:35 playground kernel: Stack: c7eeebb0 c0132f36 ce87b6f8 c14bdeac
00037ca9 00001004 cffd0800 00001004
Feb 9 00:05:35 playground kernel: c0133ed0 fffff23f 00000243 c0229128
00037ca9 c0255cc4 cffd0800 c00460b5
Feb 9 00:05:35 playground kernel: c013e9f4 c14bdeac c14bdeac c0133f38
00001004 c0229128 00037ca9 c0255cc4
Feb 9 00:05:35 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Feb 9 00:05:35 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Feb 9 00:05:35 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
from /var/log/syslog.0
Dec 30 03:30:02 playground /USR/SBIN/CRON[8012]: (root) CMD (test -x
/etc/init.d/anacron && /etc/init.d/anacron start >/dev/null)
Dec 30 03:30:02 playground anacron[8015]: Anacron 2.3 started on 2006-12-30
Dec 30 03:30:02 playground anacron[8015]: Will run job `cron.daily' in 5 min.
Dec 30 03:30:02 playground anacron[8015]: Jobs will be executed sequentially
Dec 30 03:35:02 playground anacron[8015]: Job `cron.daily' started
Dec 30 03:35:02 playground anacron[8019]: Updated timestamp for job
`cron.daily' to 2006-12-30
Dec 30 03:35:03 playground snort: Snort received signal 15, exiting
Dec 30 03:35:03 playground kernel: device eth0 left promiscuous mode
Dec 30 03:35:06 playground kernel: eth0: Setting promiscuous mode.
Dec 30 03:35:06 playground kernel: device eth0 entered promiscuous mode
Dec 30 03:35:06 playground snort: PID stat checked out ok, PID set to /var/run/
Dec 30 03:35:06 playground snort: Writing PID file to "/var/run/"
Dec 30 03:35:06 playground snort: Initializing daemon mode
Dec 30 03:35:06 playground snort: PID stat checked out ok, PID set to /var/run/
Dec 30 03:35:06 playground snort: Writing PID file to "/var/run/"
Dec 30 03:35:09 playground snort: Snort initialization completed successfully,
Snort running
Dec 30 03:38:01 playground /USR/SBIN/CRON[8136]: (mail) CMD ( if [ -x
/usr/sbin/exim -a -f /etc/exim/exim.conf ]; then /usr/sbin/exim -q ; fi)
Dec 30 03:39:31 playground kernel: iput: inode c3:c3/-1010580541 count wrapped
Dec 30 03:46:56 playground kernel: iput: inode 00:00/0 count wrapped
from /var/log/syslog
Dec 30 06:43:06 playground kernel: VFS: Busy inodes after unmount.
Self-destruct in 5 seconds. Have a nice day...
Dec 30 06:43:06 playground kernel: VFS: Busy inodes after unmount.
Self-destruct in 5 seconds. Have a nice day...
rebooted
-----------------------------------------------------------
from /var/log/syslog:
Jan 2 03:35:01 playground anacron[8749]: Job `cron.daily' started
Jan 2 03:35:02 playground anacron[8753]: Updated timestamp for job
`cron.daily' to 2007-01-02
Jan 2 03:35:02 playground snort: Snort received signal 15, exiting
Jan 2 03:35:02 playground kernel: device eth0 left promiscuous mode
Jan 2 03:35:06 playground kernel: eth0: Setting promiscuous mode.
Jan 2 03:35:06 playground kernel: device eth0 entered promiscuous mode
Jan 2 03:35:06 playground snort: PID stat checked out ok, PID set to /var/run/
Jan 2 03:35:06 playground snort: Writing PID file to "/var/run/"
Jan 2 03:35:06 playground snort: Initializing daemon mode
Jan 2 03:35:06 playground snort: PID stat checked out ok, PID set to /var/run/
Jan 2 03:35:06 playground snort: Writing PID file to "/var/run/"
Jan 2 03:35:09 playground snort: Snort initialization completed successfully,
Snort running
Jan 2 03:38:02 playground /USR/SBIN/CRON[8830]: (mail) CMD ( if [ -x
/usr/sbin/exim -a -f /etc/exim/exim.conf ]; then /usr/sbin/exim -q ; fi)
Jan 2 03:46:09 playground kernel: Unable to handle kernel NULL pointer
dereference at virtual address 00000040
Jan 2 03:46:09 playground kernel: current->tss.cr3 = 0eff9000, %%cr3 = 0eff9000
Jan 2 03:46:09 playground kernel: *pde = 00000000
Jan 2 03:46:09 playground kernel: Oops: 0000
Jan 2 03:46:09 playground kernel: CPU: 0
Jan 2 03:46:09 playground kernel: EIP: 0010:[iput+24/488]
Jan 2 03:46:09 playground kernel: EFLAGS: 00010206
Jan 2 03:46:09 playground kernel: eax: 00000028 ebx: 00000000 ecx:
c21eb708 edx: c53e9be8
Jan 2 03:46:09 playground kernel: esi: c29eb6f8 edi: c53e9bb0 ebp:
00000000 esp: c534de68
Jan 2 03:46:09 playground kernel: ds: 0018 es: 0018 ss: 0018
Jan 2 03:46:09 playground kernel: Process find (pid: 8922, process nr: 41,
stackpage=c534d000)
Jan 2 03:46:09 playground kernel: Stack: c53e9bb0 c0132f36 c29eb6f8 c534deac
00036c1a 00001004 cf6aa400 00001004
Jan 2 03:46:09 playground kernel: c0133ed0 fffffdea 00000dee c0229128
00036c1a c0255bcc cf6aa400 c01290df
Jan 2 03:46:09 playground kernel: c1323770 c534deac c534deac c0133f38
00001004 c0229128 00036c1a c0255bcc
Jan 2 03:46:09 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Jan 2 03:46:09 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Jan 2 03:46:09 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
Jan 12 03:30:01 playground anacron[2657]: Anacron 2.3 started on 2007-01-12
Jan 12 03:30:01 playground anacron[2657]: Will run job `cron.daily' in 5 min.
Jan 12 03:30:01 playground anacron[2657]: Will run job `cron.weekly' in 10 min.
Jan 12 03:30:01 playground anacron[2657]: Jobs will be executed sequentially
Jan 12 03:35:01 playground anacron[2657]: Job `cron.daily' started
Jan 12 03:35:02 playground anacron[2661]: Updated timestamp for job
`cron.daily' to 2007-01-12
Jan 12 03:38:02 playground /USR/SBIN/CRON[2707]: (mail) CMD ( if [ -x
/usr/sbin/exim -a -f /etc/exim/exim.conf ]; then /usr/sbin/exim -q ; fi)
Jan 12 03:38:59 playground kernel: Unable to handle kernel NULL pointer
dereference at virtual address 0000001a
Jan 12 03:38:59 playground kernel: current->tss.cr3 = 0cb19000, %%cr3 = 0cb19000
Jan 12 03:38:59 playground kernel: *pde = 00000000
Jan 12 03:38:59 playground kernel: Oops: 0000
Jan 12 03:38:59 playground kernel: CPU: 0
Jan 12 03:38:59 playground kernel: EIP: 0010:[iput+24/488]
Jan 12 03:38:59 playground kernel: EFLAGS: 00010202
Jan 12 03:38:59 playground kernel: eax: 00000002 ebx: 00000000 ecx:
cb0eaac8 edx: cdbf0208
Jan 12 03:38:59 playground kernel: esi: cb8eaab8 edi: cdbf01d0 ebp:
00000001 esp: ccb1be68
Jan 12 03:38:59 playground kernel: ds: 0018 es: 0018 ss: 0018
Jan 12 03:38:59 playground kernel: Process find (pid: 2705, process nr: 39,
stackpage=ccb1b000)
Jan 12 03:38:59 playground kernel: Stack: cdbf01d0 c0132f36 cb8eaab8 ccb1beac
0003dc02 00001004 cf6b3400 00001004
Jan 12 03:38:59 playground kernel: c0133ed0 fffff63b 0000063f c0229128
0003dc02 c025638c cf6b3400 c6ebd427
Jan 12 03:38:59 playground kernel: c013e9f4 ccb1beac ccb1beac c0133f38
00001004 c0229128 0003dc02 c025638c
Jan 12 03:38:59 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Jan 12 03:38:59 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Jan 12 03:38:59 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
Jan 13 03:30:01 playground /USR/SBIN/CRON[14809]: (root) CMD (test -x
/etc/init.d/anacron && /etc/init.d/anacron start >/dev/null)
Jan 13 03:30:01 playground anacron[14812]: Anacron 2.3 started on 2007-01-13
Jan 13 03:30:01 playground anacron[14812]: Will run job `cron.daily' in 5 min.
Jan 13 03:30:01 playground anacron[14812]: Jobs will be executed sequentially
Jan 13 03:35:01 playground anacron[14812]: Job `cron.daily' started
Jan 13 03:35:02 playground anacron[14816]: Updated timestamp for job
`cron.daily' to 2007-01-13
Jan 13 03:35:06 playground kernel: Unable to handle kernel paging request at
virtual address 07020c1b
Jan 13 03:35:06 playground kernel: current->tss.cr3 = 0269e000, %%cr3 = 0269e000
Jan 13 03:35:06 playground kernel: *pde = 00000000
Jan 13 03:35:06 playground kernel: Oops: 0000
Jan 13 03:35:06 playground kernel: CPU: 0
Jan 13 03:35:06 playground kernel: EIP: 0010:[iput+24/488]
Jan 13 03:35:06 playground kernel: EFLAGS: 00010206
Jan 13 03:35:06 playground kernel: eax: 07020c03 ebx: 00000000 ecx:
ce0ecac8 edx: ced768e8
Jan 13 03:35:06 playground kernel: esi: ce8ecab8 edi: ced768b0 ebp:
00000000 esp: c1c4be68
Jan 13 03:35:06 playground kernel: ds: 0018 es: 0018 ss: 0018
Jan 13 03:35:06 playground kernel: Process find (pid: 14850, process nr: 51,
stackpage=c1c4b000)
Jan 13 03:35:06 playground kernel: Stack: ced768b0 c0132f36 ce8ecab8 c1c4beac
0000cc46 00001004 cffd0800 00001004
Jan 13 03:35:06 playground kernel: c0133ed0 fffff27e 00000282 c0229128
0000cc46 c0255c2c cffd0800 c01290df
Jan 13 03:35:06 playground kernel: c54da900 c1c4beac c1c4beac c0133f38
00001004 c0229128 0000cc46 c0255c2c
Jan 13 03:35:06 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [__brelse+19/52] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Jan 13 03:35:06 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Jan 13 03:35:06 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
-----------------------------------------------------------
Jan 18 03:30:01 playground /USR/SBIN/CRON[6894]: (root) CMD (test -x
/etc/init.d/anacron && /etc/init.d/anacron start >/dev/null)
Jan 18 03:30:01 playground anacron[6897]: Anacron 2.3 started on 2007-01-18
Jan 18 03:30:01 playground anacron[6897]: Will run job `cron.daily' in 5 min.
Jan 18 03:30:01 playground anacron[6897]: Jobs will be executed sequentially
Jan 18 03:35:01 playground anacron[6897]: Job `cron.daily' started
Jan 18 03:35:02 playground anacron[6902]: Updated timestamp for job
`cron.daily' to 2007-01-18
Jan 18 03:35:31 playground kernel: Unable to handle kernel paging request at
virtual address 0004115e
Jan 18 03:35:31 playground kernel: current->tss.cr3 = 06401000, %%cr3 = 06401000
Jan 18 03:35:31 playground kernel: *pde = 00000000
Jan 18 03:35:31 playground kernel: Oops: 0000
Jan 18 03:35:31 playground kernel: CPU: 0
Jan 18 03:35:31 playground kernel: EIP: 0010:[iput+24/488]
Jan 18 03:35:31 playground kernel: EFLAGS: 00010202
Jan 18 03:35:31 playground kernel: eax: 00041146 ebx: 00000000 ecx:
c8dd0198 edx: cf5f0e08
Jan 18 03:35:31 playground kernel: esi: c8dd01c8 edi: cf5f0dd0 ebp:
00000000 esp: c6403e68
Jan 18 03:35:31 playground kernel: ds: 0018 es: 0018 ss: 0018
Jan 18 03:35:31 playground kernel: Process find (pid: 6946, process nr: 56,
stackpage=c6403000)
Jan 18 03:35:31 playground kernel: Stack: cf5f0dd0 c0132f36 c8dd01c8 c6403eac
00038063 00001004 cffd0800 00001004
Jan 18 03:35:31 playground kernel: c0133ed0 fffff1bb 000002ee c0229128
00038063 c02562f4 cffd0800 cf594605
Jan 18 03:35:31 playground kernel: c013e9f4 c6403eac c6403eac c0133f38
00001004 c0229128 00038063 c02562f4
Jan 18 03:35:31 playground kernel: Call Trace: [prune_dcache+198/308]
[try_to_free_inodes+188/252] [ext2_find_entry+416/684] [grow_inodes+32/408]
[get_new_inode+185/292] [iget4+109/120] [iget+17/24]
Jan 18 03:35:31 playground kernel: [ext2_lookup+90/140]
[real_lookup+77/160] [lookup_dentry+292/452] [__namei+38/88]
[sys_newlstat+13/96] [system_call+52/56]
Jan 18 03:35:31 playground kernel: Code: 8b 40 18 85 c0 74 02 89 c3 85 db 74 0d
8b 43 08 85 c0 74 06
==========================================================================
These are the captured outputs of e2fsck run after the crashes.
/deb30b/root/crash/fsck-f_hdc8.011907 <-- the date fsck was run
Fri Jan 19 2007 8:44 on /deb31
deb31:~> fsck -f /deb30b
fsck 1.37 (21-Mar-2005)
e2fsck 1.37 (21-Mar-2005)
Pass 1: Checking inodes, blocks, and sizes
Special (device/socket/fifo) inode 146181 has non-zero size. Fix<y>? yes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
/dev/hdc8: ***** FILE SYSTEM WAS MODIFIED *****
/dev/hdc8: 49485/256512 files (0.4% non-contiguous), 177474/512071 blocks
deb31:~>
-----------------------------------------------------------
/deb30b/root/crash/fsck.hdc8.011807 <-- the date fsck was run
deb31:~> fsck /dev/hdc8
fsck 1.37 (21-Mar-2005)
e2fsck 1.37 (21-Mar-2005)
/dev/hdc8 was not cleanly unmounted, check forced.
Pass 1: Checking inodes, blocks, and sizes
Deleted inode 96248 has zero dtime. Fix<y>? yes
Special (device/socket/fifo) inode 146181 has non-zero size. Fix<y>? yes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
Block bitmap differences: -(1565--1566) -(76458--76464) -(99672--99678)
-(197253--197260) -(297546--297550) -(297986--297991) -(298307--298312)
-(300116--300120) -(300125--300128) -(361138--361141) -(361162--361168)
-(361170--361176) -362877
Fix<y>? yes
Free blocks count wrong for group #0 (22136, counted=22138).
Fix<y>? yes
Free blocks count wrong for group #2 (12527, counted=12534).
Fix<y>? yes
Free blocks count wrong for group #3 (8149, counted=8156).
Fix<y>? yes
Free blocks count wrong for group #6 (20529, counted=20537).
Fix<y>? yes
Free blocks count wrong for group #9 (14390, counted=14416).
Fix<y>? yes
Free blocks count wrong for group #11 (26378, counted=26397).
Fix<y>? yes
Free blocks count wrong (308795, counted=308864).
Fix<y>? yes
Inode bitmap differences: -96248
Fix<y>? yes
Free inodes count wrong for group #6 (11984, counted=11985).
Fix<y>? yes
Free inodes count wrong (201518, counted=201519).
Fix<y>? yes
/dev/hdc8: ***** FILE SYSTEM WAS MODIFIED *****
/dev/hdc8: 54993/256512 files (0.4% non-contiguous), 203207/512071 blocks
deb31:~>
-----------------------------------------------------------
/deb30b/root/crash/fsck_hdc8_120107 <-- the date fsck was run
rh62:~> fsck /dev/hdc8
Parallelizing fsck version 1.18 (11-Nov-1999)
e2fsck 1.18, 11-Nov-1999 for EXT2 FS 0.5b, 95/08/09
/dev/hdc8 was not cleanly unmounted, check forced.
Pass 1: Checking inodes, blocks, and sizes
Deleted inode 96248 has zero dtime. Fix<y>? yes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
Block bitmap differences: -1611 -1612 -1613 -1614 -1615 -1616 -1617 -5352
-5353 -5354 -5355 -5356 -5357 -99672 -99673 -99674 -99675 -99676 -99677
-99678 -197256 -197257 -197258 -197259 -197260 -197261 -197262 -197263
-296353 -297253 -297254 -297255 -297256 -297257 -297258 -297260 -297261
-297262 -297263 -297264 -297265 -297266 -298960
Fix<y>? yes
Free blocks count wrong for group #0 (22988, counted=23001).
Fix<y>? yes
Free blocks count wrong for group #3 (8529, counted=8536).
Fix<y>? yes
Free blocks count wrong for group #6 (20520, counted=20528).
Fix<y>?
Free blocks count wrong for group #9 (14384, counted=14399).
Fix<y>? yes
Free blocks count wrong (313395, counted=313438).
Fix<y>? yes
Inode bitmap differences: -96248
Fix<y>? yes
Free inodes count wrong for group #6 (11982, counted=11983).
Fix<y>? yes
Free inodes count wrong (201468, counted=201469).
Fix<y>? yes
/dev/hdc8: ***** FILE SYSTEM WAS MODIFIED *****
/dev/hdc8: 55043/256512 files (0.4% non-contiguous), 198633/512071 blocks
rh62:~>
-----------------------------------------------------------
/deb30b/root/crash/fsck_hdc8_130107 <-- the date fsck was run
rh62:~> fsck /dev/hdc8
Parallelizing fsck version 1.18 (11-Nov-1999)
e2fsck 1.18, 11-Nov-1999 for EXT2 FS 0.5b, 95/08/09
/dev/hdc8 was not cleanly unmounted, check forced.
Pass 1: Checking inodes, blocks, and sizes
Deleted inode 96257 has zero dtime. Fix<y>? yes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
Block bitmap differences: -76362 -76363 -76364 -76365 -76366 -76367 -76368
-99672 -99673 -99674 -99675 -99676 -99677 -99678 -197320 -197321 -197322
-197323 -197324 -197325 -197326 -197327 -296228 -296229 -296230 -296231
-296232 -296233 -296234 -297279 -297280 -297281 -297282 -297283 -297284
-297338 -297339 -297364 -297365 -297366 -297367 -297369 -297370 -297371
-297372 -297373 -297374 -297375 -298278 -298279 -298360 -298361 -298362
-298363 -298364 -298365 -298366 -298384 -298385 -298386 -298387 -298388
-361166 -361167 -361168 -361170 -361171 -361172 -361173 -361174 -361175
-361176 -361178 -361179 -361180 -361181 -361182 -361183 -361184 -373412
-373413 -373414 -373415 -432975 -432976 -432977 -432978 -432979
Fix<y>? yes
Free blocks count wrong for group #2 (12570, counted=12577).
Fix<y>? yes
Free blocks count wrong for group #3 (8400, counted=8407).
Fix<y>? yes
Free blocks count wrong for group #6 (20520, counted=20528).
Fix<y>? yes
Free blocks count wrong for group #9 (14378, counted=14418).
Fix<y>? yes
Free blocks count wrong for group #11 (25352, counted=25373).
Fix<y>? yes
Free blocks count wrong for group #13 (24872, counted=24877).
Fix<y>? yes
Free blocks count wrong (308568, counted=308656).
Fix<y>? yes
Inode bitmap differences: -96257
Fix<y>? yes
Free inodes count wrong for group #6 (11982, counted=11983).
Fix<y>? yes
Free inodes count wrong (200657, counted=200658).
Fix<y>? yes
/dev/hdc8: ***** FILE SYSTEM WAS MODIFIED *****
/dev/hdc8: 55854/256512 files (0.4% non-contiguous), 203415/512071 blocks
rh62:~>
-----------------------------------------------------------
deb30/fsck-f_hdc6.012407 <-- the date fsck was run
deb31:~> fsck -f /deb30
fsck 1.37 (21-Mar-2005)
e2fsck 1.37 (21-Mar-2005)
Pass 1: Checking inodes, blocks, and sizes
Special (device/socket/fifo) inode 1807 has non-zero size. Fix<y>? yes
Special (device/socket/fifo) inode 2088 has non-zero size. Fix<y>? yes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
/dev/hdc6: ***** FILE SYSTEM WAS MODIFIED *****
/dev/hdc6: 43739/256512 files (0.3% non-contiguous), 142438/512071 blocks
deb31:~>
-----------------------------------------------------------
- find/updatedb difficulties,
root <=