FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > Redhat > EXT3 Users

 
 
LinkBack Thread Tools
 
Old 12-04-2007, 05:52 PM
Ross Boylan
 
Default Ancient Very slow directory traversal thread

On Mon, 2007-12-03 at 14:37 -0500, Rashkae wrote:
> I just came across your message to a mailing list here:
[message concerned it taking hours to go through directories in a mail
spool on ext3]
>
> https://www.redhat.com/archives/ext3-users/2007-October/msg00019.html
>
> This might be a problem you resolved for yourself a long time ago, but I
> thought you might be interested to know that Theodore's spd_readdir
> library works great with star (even though I also cannot get it to work
> with tar or even du).
That's interesting. Since I couldn't get it to work with tar, got no
response, and wasn't sure how or if to get it to work with the daemon to
that really needed it, I haven't made and progress.

I wonder what determines whether the library helps or hurts.
>
> star with spd_readdir is what I use to back up maildir spools, and
> something I consider absolutely necessary for any such storage on ext3
> or reiserfs filesystems.
I hadn't noticed this was an issue with reiser.

I also just noticed that e2fsck has an option, -D, to optimize
directories. The man page says this will reindex directories. Does
anyone know if that could help?

Ross

_______________________________________________
Ext3-users mailing list
Ext3-users@redhat.com
https://www.redhat.com/mailman/listinfo/ext3-users
 
Old 12-05-2007, 10:47 PM
Andreas Dilger
 
Default Ancient Very slow directory traversal thread

On Dec 04, 2007 10:52 -0800, Ross Boylan wrote:
> On Mon, 2007-12-03 at 14:37 -0500, Rashkae wrote:
> > I just came across your message to a mailing list here:
> [message concerned it taking hours to go through directories in a mail
> spool on ext3]
> >
> > https://www.redhat.com/archives/ext3-users/2007-October/msg00019.html
> >
> > This might be a problem you resolved for yourself a long time ago, but I
> > thought you might be interested to know that Theodore's spd_readdir
> > library works great with star (even though I also cannot get it to work
> > with tar or even du).
>
> That's interesting. Since I couldn't get it to work with tar, got no
> response, and wasn't sure how or if to get it to work with the daemon to
> that really needed it, I haven't made and progress.
>
> I wonder what determines whether the library helps or hurts.

Maybe it depends if the app is using normal readdir() calls, or is
maybe implementing the directory traversal itself?

> I also just noticed that e2fsck has an option, -D, to optimize
> directories. The man page says this will reindex directories. Does
> anyone know if that could help?

That will compress empty space from directories and rebuild the hash
table for directories that are not indexed (e.g. older dirs created
before DIR_INDEX feature was enabled in fs).

It will keep them in hash order so it won't help this issue.

Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.

_______________________________________________
Ext3-users mailing list
Ext3-users@redhat.com
https://www.redhat.com/mailman/listinfo/ext3-users
 

Thread Tools




All times are GMT. The time now is 07:15 AM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright 2007 - 2008, www.linux-archive.org