On Fri, Jun 22, 2012 at 2:02 AM, Raphael Geissert <geissert@debian.org> wrote:
> Hi,
Dear Raphael,
> After several iterations to solve problems related to Debian's mirrors
> network, I am happy to announce a fully-functional solution that solves many
> of the shortcomings of previous iterations: http://http.debian.net
>
> http.debian.net works as the key component of a content distribution
> network. For a given requested file, it uses several factors to choose one or
> multiple mirrors that can serve the request. Those factors include the
> freshness of the mirror, the network and geographic location, etc.
nice.
> How can you use it?
> An entry in /etc/apt/sources.list for stable would look like:
>
> deb http://http.debian.net/debian stable main
>
> It supports backports mirrors and others. Except CD image mirrors, they are
> *not* supported.
>
> More details, comparison to other approaches, and more information can be
> found at:
> http://http.debian.net/
I *think* it should be also beneficial for jigdo stuff as well.
> Oh, and, please help package and maintain mirrorbrain, which would allow a
> similar service to be provided for CD images.
>
> Thanks for reading.
>
>
> P.S. contrary to wheezy, http.debian.net's development will not freeze. It
> is under continuous development, and more users and developers are welcome!
umm.... I know it's early days and it's really cool to have a service
like it. There have been times where either the main server has had
congestion or the mirror I was using is switched or isn't working
properly for one thing or the other.
There is one thing though, for some reason it takes much more
bandwidth when updating the index then my previous way.
This is my /etc/apt/sources.list :-
$ cat /etc/apt/sources.list
# Debian Unstable (SID) using now
deb http://http.debian.net/debian/ unstable main contrib non-free
deb-src http://http.debian.net/debian/ unstable main contrib non-free
# Debian experimental repository - needs to be careful here
deb http://http.debian.net/debian/ experimental main
# Debian Testing (Wheezy)
deb http://http.debian.net/debian/ testing main contrib non-free
deb-src http://http.debian.net/debian/ testing main contrib non-free
# Debian Stable
deb http://http.debian.net/debian/ stable main non-free contrib
deb-src http://http.debian.net/debian/ stable main contrib non-free
# Debian-Multimedia.org Repository
#deb http://www.deb-multimedia.org sid main non-free
#deb-src http://www.deb-multimedia.org sid main non-free
# Debian-Multimedia.org Experimental Repository -need to be careful here
#deb http://www.deb-multimedia.org experimental main non-free
Note :- I am on Debian sid.
Previously I was using ftp.debian.org in my /etc/apt/sources.list
This is the first run with the new mirror re-director :-
As can be seen while there is a saving, still a substantial amount of
bandwidth is used for an update.
Previously when I was using a single mirror, most of the time the diff
between two runs was at the most 750 kB in the index update run. I can
recall there is something call .pdiff which made it easier and smaller
to have the index updated.
Another thing which is puzzling is that stable inRelease is ignored. I
dunno if this was before and I'm realizing it now or it's due to the
use of mirror redirector or something else. I do recall stable
inRelease doing well. Anyways, this is what I'm a bit concerned about
as well.
--
* * * * * Regards,
* * * * * Shirish Agarwal* शिरीष अग्रवाल
* My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3* 8D70 950D 53FB 729A 8B17
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: http://lists.debian.org/CADdDZR=SWUn3onTOdfXNgmQa_07_yYRS6E+FST0LJFUb6EFBf g@mail.gmail.com
am Fri, Jun 22, 2012 at 09:33:34AM +0530 hast du folgendes geschrieben:
> Another thing which is puzzling is that stable inRelease is ignored. I
> dunno if this was before and I'm realizing it now or it's due to the
> use of mirror redirector or something else. I do recall stable
> inRelease doing well. Anyways, this is what I'm a bit concerned about
> as well.
there should be no InRelease for stable. It's not needed given that stable
basically doesn't change and didn't support two signatures at some point.
> After several iterations to solve problems related to Debian's mirrors
> network, I am happy to announce a fully-functional solution that
> solves many
> of the shortcomings of previous iterations:
> http://http.debian.net
Is there other developer involved in development?
Mind to share data how many 'redirect' were served?
Why do you think redirects is a good idea at all?
Am I understand code properly and you spawn perl cgi script per each
file requested ?
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: http://lists.debian.org/1340387682.19149.2.camel@ph-01.local
> After several iterations to solve problems related to Debian's mirrors
> network, I am happy to announce a fully-functional solution that solves many
> of the shortcomings of previous iterations: http://http.debian.net
> http.debian.net works as the key component of a content distribution
> network. For a given requested file, it uses several factors to choose one or
> multiple mirrors that can serve the request. Those factors include the
> freshness of the mirror, the network and geographic location, etc.
> How can you use it?
> An entry in /etc/apt/sources.list for stable would look like:
> deb http://http.debian.net/debian stable main
> It supports backports mirrors and others. Except CD image mirrors, they are
> *not* supported.
> More details, comparison to other approaches, and more information can be
> found at:
> http://http.debian.net/
> Oh, and, please help package and maintain mirrorbrain, which would allow a
> similar service to be provided for CD images.
> Thanks for reading.
> P.S. contrary to wheezy, http.debian.net's development will not freeze. It
> is under continuous development, and more users and developers are welcome!
I've tried to use the service. 2/3 requests - 501 error.
unusable.
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: http://lists.debian.org/js4vve$h58$1@dough.gmane.org
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: http://lists.debian.org/js6iaf$j4s$1@dough.gmane.org
On Thursday 21 June 2012 23:03:34 shirish शिरीष wrote:
> > More details, comparison to other approaches, and more information can
> > be found at:
> > http://http.debian.net/
>
> I *think* it should be also beneficial for jigdo stuff as well.
Yes. Not sure how the downloader used by jigdo handles redirections, but it
should work nevertheless.
> There is one thing though, for some reason it takes much more
> bandwidth when updating the index then my previous way.
[...]
> Previously when I was using a single mirror, most of the time the diff
> between two runs was at the most 750 kB in the index update run. I can
> recall there is something call .pdiff which made it easier and smaller
> to have the index updated.
For some reason, there no longer are "pdiff"s for stable, so it has to
download the whole files on every update.
Unless the files really changed, the Last-Modified-Since headers should have
prevented the download. Will have to check if they are correctly preserved,
it might be that.
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: 201206260013.05179.geissert@debian.org">http://lists.debian.org/201206260013.05179.geissert@debian.org
On Tue, Jun 26, 2012 at 10:43 AM, Raphael Geissert <geissert@debian.org> wrote:
> Hi,
Hi again,
> On Thursday 21 June 2012 23:03:34 shirish शिरीष wrote:
>> > More details, comparison to other approaches, and more information can
>> > be found at:
>> > http://http.debian.net/
>>
>> I *think* it should be also beneficial for jigdo stuff as well.
>
> Yes. Not sure how the downloader used by jigdo handles redirections, but it
> should work nevertheless.
>
>> There is one thing though, for some reason it takes much more
>> bandwidth when updating the index then my previous way.
> [...]
>> Previously when I was using a single mirror, most of the time the diff
>> between two runs was at the most 750 kB in the index update run. I can
>> recall there is something call .pdiff which made it easier and smaller
>> to have the index updated.
>
> For some reason, there no longer are "pdiff"s for stable, so it has to
> download the whole files on every update.
This seems to happen only via the re-director. For instance this is
from my second run with having a single server in
/etc/apt/sources.list :-
As can be seen pdiffs are generated if you use the same server.
> Unless the files really changed, the Last-Modified-Since headers should have
> prevented the download. Will have to check if they are correctly preserved,
> it might be that.
Please look into it.
> Cheers,
> --
> Raphael Geissert - Debian Developer
> www.debian.org - get.debian.net
Thanx again for replying asap.
Look forward to hearing from you.
--
* * * * * Regards,
* * * * * Shirish Agarwal* शिरीष अग्रवाल
* My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3* 8D70 950D 53FB 729A 8B17
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: http://lists.debian.org/CADdDZR 5RjXYXjYxPQOOxKYT7q56EsCZRh_j+GoYWKDy6-YA@mail.gmail.com
On Tue, Jun 26, 2012 at 3:45 PM, shirish शिरीष <shirishag75@gmail.com> wrote:
> $ aptu
just for clarity aptu is an alias :-
$ alias aptu
alias aptu='sudo aptitude update;sleep 5;sudo aptitude safe-upgrade;
sleep 5; sudo apt-file update; sleep 5'
--
* * * * * Regards,
* * * * * Shirish Agarwal* शिरीष अग्रवाल
* My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3* 8D70 950D 53FB 729A 8B17
--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
Archive: http://lists.debian.org/CADdDZRnT12-qMHS=QFnEDuuNxC138VJcyA-v5aMSSN-GcFU4UA@mail.gmail.com
Introducing http.debian.net, Debian's mirrors redirector
