Linux Archive

Linux Archive (http://www.linux-archive.org/)
-   Gentoo Alt (http://www.linux-archive.org/gentoo-alt/)
-   -   Prefix rsync now includes full gentoo-x86 repo (http://www.linux-archive.org/gentoo-alt/651401-prefix-rsync-now-includes-full-gentoo-x86-repo.html)

Fabian Groffen 04-01-2012 02:59 PM

Prefix rsync now includes full gentoo-x86 repo
 
All,

This is a headsup mostly for developers. The (good) news for users is
that all packages from regular Gentoo are now also available for Prefix
albeit being masked by missing keywords.

Because of a growing whitelist.txt, and the tiresome process of adding
to whitelist.txt what is necessary, then waiting around an hour to sync
and find the next missing package, I decided to include all packages
from gx86 in the Prefix rsync tree.

Of course "each advantage has its disadvantage", to quote Cruyff. In
the attached figure, the most prominent disadvantage is made visual:
generation time has increased from ~12 to ~17 minutes. For the 30
minutes rotation this obviously makes no difference.

Notice the bump of time necessary by egencache around 20:00, that is the
time Zac committed "cache-formats = md5-dict pms" to
metadata/layout.conf. In the Prefix tree, there now is a
metadata/md5-cache directory that should ultimately fix the bug we
observed in the past [1], but gentoo-x86 people have been affected by
now too [2]. That sort of is a proof that I was correctly not
convinced in comment #17 of said Prefix bug [1].

In the near future, we (Prefix) might jump ahead and stop distributing
the old metadata/cache, but for now we have both, like gx86.

Because the Prefix overlay now "overshadows" the gx86 tree, I've removed
whitelist.txt, since it's obviously no longer used. Nothing is
necessary any more to "include" something in Prefix, as everything there
is, should be there now.


[1] https://bugs.gentoo.org/show_bug.cgi?id=388345
[2] https://bugs.gentoo.org/show_bug.cgi?id=409445

--
Fabian Groffen
Gentoo on a different level

04-02-2012 02:09 AM

Prefix rsync now includes full gentoo-x86 repo
 
Fabian Groffen <grobian@gentoo.org> writes:

> This is a headsup mostly for developers. The (good) news for users is
> that all packages from regular Gentoo are now also available for Prefix
> albeit being masked by missing keywords.

Oh, I thought it was an April joke yesterday -_-bb

Great to hear this. This is milestone and a hard boost to Prefix.

The ambition of Prefix is that someday there is no "Gentoo Prefix".

Now we can feel it at the corner. Hooray!

Regards,
--
XU Benda
Research Center for Neutrino Science
Tohoku University
JAPAN

http://www.awa.tohoku.ac.jp/~benda

Richard Yao 04-02-2012 03:48 AM

Prefix rsync now includes full gentoo-x86 repo
 
On 04/01/12 10:59, Fabian Groffen wrote:
> All,
>
> This is a headsup mostly for developers. The (good) news for users is
> that all packages from regular Gentoo are now also available for Prefix
> albeit being masked by missing keywords.
>
> Because of a growing whitelist.txt, and the tiresome process of adding
> to whitelist.txt what is necessary, then waiting around an hour to sync
> and find the next missing package, I decided to include all packages
> from gx86 in the Prefix rsync tree.
>
> Of course "each advantage has its disadvantage", to quote Cruyff. In
> the attached figure, the most prominent disadvantage is made visual:
> generation time has increased from ~12 to ~17 minutes. For the 30
> minutes rotation this obviously makes no difference.
>
> Notice the bump of time necessary by egencache around 20:00, that is the
> time Zac committed "cache-formats = md5-dict pms" to
> metadata/layout.conf. In the Prefix tree, there now is a
> metadata/md5-cache directory that should ultimately fix the bug we
> observed in the past [1], but gentoo-x86 people have been affected by
> now too [2]. That sort of is a proof that I was correctly not
> convinced in comment #17 of said Prefix bug [1].
>
> In the near future, we (Prefix) might jump ahead and stop distributing
> the old metadata/cache, but for now we have both, like gx86.
>
> Because the Prefix overlay now "overshadows" the gx86 tree, I've removed
> whitelist.txt, since it's obviously no longer used. Nothing is
> necessary any more to "include" something in Prefix, as everything there
> is, should be there now.
>
>
> [1] https://bugs.gentoo.org/show_bug.cgi?id=388345
> [2] https://bugs.gentoo.org/show_bug.cgi?id=409445
>

While this is awesome, the longer sync times seems to have overloaded
the server. It might be necessary to increase the number of mirrors.

Fabian Groffen 04-02-2012 06:39 AM

Prefix rsync now includes full gentoo-x86 repo
 
On 01-04-2012 23:48:52 -0400, Richard Yao wrote:
> While this is awesome, the longer sync times seems to have overloaded
> the server. It might be necessary to increase the number of mirrors.

Around 2:00 backups are stored (which cause disk write I/O, hence slow
down all operations that need it, such as cvs update), at 5:00 a backup
is made of the server, this gives a lot of read I/O, hence affects other
operations much less.

The master rsync0 server is only accessible by rsync1, and rsync1 only
by slaves, rsync4 and rsync5 at the moment. They pick up the
client-sync load. See also:
http://stats.prefix.freens.org/rsync-usage-last4weeks.png


--
Fabian Groffen
Gentoo on a different level

Fabian Groffen 04-02-2012 06:49 AM

Prefix rsync now includes full gentoo-x86 repo
 
On 02-04-2012 11:09:52 +0900, heroxbd@gmail.com wrote:
> Fabian Groffen <grobian@gentoo.org> writes:
>
> > This is a headsup mostly for developers. The (good) news for users is
> > that all packages from regular Gentoo are now also available for Prefix
> > albeit being masked by missing keywords.
>
> Oh, I thought it was an April joke yesterday -_-bb

Ah, yeah, bad timing on my part ;)


--
Fabian Groffen
Gentoo on a different level


All times are GMT. The time now is 08:31 AM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.