On Sat, Oct 11, 2008 at 08:10:06AM -0700, John Reiser wrote:
> Young torrents on http://torrent.fedoraproject.org/ spread data too slowly.
> At 0500 UTC on Sat.Oct.11, there was 1 seed and 14 leeches, all at 13% done.
> At 1300 UTC on Sat.Oct.11, there was 1 seed and 31 leeches, all at 55% done.
> This is for F10-Snap1-x86_64-Live.
> I turned my machine off for the night (US PDT), powered on in the morning,
> and within half an hour had caught up to all leeches at 57% done.
> I use tranmsissionbt, and I saw that the seed was sending pieces of 256 KiB
> to me at 2.5 KiB/s, taking almost two minutes per piece (and then "pausing.")

To be honest, I'm less interested in downloading a snapshot that
doesn't have an installer that works. The whole point of using a
snapshot rather than say, a daily rawhide, is to test the installer on
media rather than a network install. Perhaps others feel the same way
which is why there isn't much contribution to this torrent.

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, 2008-10-11 at 11:36 -0400, Chuck Anderson wrote:
> To be honest, I'm less interested in downloading a snapshot that
> doesn't have an installer that works. The whole point of using a
> snapshot rather than say, a daily rawhide, is to test the installer on
> media rather than a network install. Perhaps others feel the same way
> which is why there isn't much contribution to this torrent.

However testing a live image, which isn't created nightly with rawhide,
does have a lot of value.

--
Jesse Keating
Fedora -- Freedom² is a feature!
identi.ca: http://identi.ca/jkeating
--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, Oct 11, 2008 at 09:07:35AM -0700, Jesse Keating wrote:
> However testing a live image, which isn't created nightly with rawhide,
> does have a lot of value.

Good point. I'm torrenting now :-)

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, Oct 11, 2008 at 12:20:49PM -0400, Chuck Anderson wrote:
> On Sat, Oct 11, 2008 at 09:07:35AM -0700, Jesse Keating wrote:
> > However testing a live image, which isn't created nightly with rawhide,
> > does have a lot of value.
>
> Good point. I'm torrenting now :-)

If only 45 people are interested in downloading the torrent, why have
a torrent at all? This is much slower than a FTP or HTTP download
would be. For snapshots whose useful lifespan is maybe only a week
and whose demand may be rather low, it might make more sense to
provide un-mirrored direct HTTP downloads. Or distribute the .iso's
to a few willing mirrors who the seed the content via bittorrent. I'm
volunteering to do this. I'll certainly leave my client seeding once
it gets the whole file, but by then the weekend may be over and I
won't have time for testing anymore :-(

file: F10-Snap1-i686-Live
seeds: 1 seen now, plus 0 distributed copies(1:60.1%, 2:60.1%, 3:60.1%)
peers: 45 seen now

file: F10-Snap1-x86_64-Live
seeds: 1 seen now, plus 0 distributed copies(1:76.1%, 2:75.9%, 3:75.9%)
peers: 43 seen now

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, 11 Oct 2008, John Reiser wrote:

> Young torrents on http://torrent.fedoraproject.org/ spread data too slowly.
> At 0500 UTC on Sat.Oct.11, there was 1 seed and 14 leeches, all at 13% done.
> At 1300 UTC on Sat.Oct.11, there was 1 seed and 31 leeches, all at 55% done.
> This is for F10-Snap1-x86_64-Live.
> I turned my machine off for the night (US PDT), powered on in the morning,
> and within half an hour had caught up to all leeches at 57% done.
> I use tranmsissionbt, and I saw that the seed was sending pieces of 256 KiB
> to me at 2.5 KiB/s, taking almost two minutes per piece (and then "pausing.")
>
> It seems to me that torrent.fedoraproject.org is overloaded, and that a change
> in policy would give sooner completion to everybody, even without more
> resources.

I wouldn't say overloaded. Throttled is the right word, and we do have it
throttled. Although even throttled on one machine I was able to download
the latest live beta in roughly 10 minutes on my slicehost.com host, and
closer to 9 hours on my workstation at home. Its always difficult to tell
where the slowness happens but I suspect in my slow case it was because my
ISP was limiting my traffic and slicehost.com was not.

-Mike

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, Oct 11, 2008 at 01:49:57PM -0500, Mike McGrath wrote:
> On Sat, 11 Oct 2008, John Reiser wrote:
>
> > Young torrents on http://torrent.fedoraproject.org/ spread data too slowly.
> > At 0500 UTC on Sat.Oct.11, there was 1 seed and 14 leeches, all at 13% done.
> > At 1300 UTC on Sat.Oct.11, there was 1 seed and 31 leeches, all at 55% done.
> > This is for F10-Snap1-x86_64-Live.
> > I turned my machine off for the night (US PDT), powered on in the morning,
> > and within half an hour had caught up to all leeches at 57% done.
> > I use tranmsissionbt, and I saw that the seed was sending pieces of 256 KiB
> > to me at 2.5 KiB/s, taking almost two minutes per piece (and then "pausing.")
> >
> > It seems to me that torrent.fedoraproject.org is overloaded, and that a change
> > in policy would give sooner completion to everybody, even without more
> > resources.
>
> I wouldn't say overloaded. Throttled is the right word, and we do have it
> throttled. Although even throttled on one machine I was able to download
> the latest live beta in roughly 10 minutes on my slicehost.com host, and
> closer to 9 hours on my workstation at home. Its always difficult to tell
> where the slowness happens but I suspect in my slow case it was because my
> ISP was limiting my traffic and slicehost.com was not.

I'm on multiple gig links, unrestricted, and it is taking an eternity
to download the Snap1 images.

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat October 11 2008, Mike McGrath wrote:

> I wouldn't say overloaded. Throttled is the right word, and we do have it
> throttled. Although even throttled on one machine I was able to download
> the latest live beta in roughly 10 minutes on my slicehost.com host, and
> closer to 9 hours on my workstation at home. Its always difficult to tell
> where the slowness happens but I suspect in my slow case it was because my
> ISP was limiting my traffic and slicehost.com was not.

For me surely torrent1.fedoraproject.org is the bottleneck, because it only
seeds at around 0.2 KB/s and is the only seed at all. Something is strange,
because given the time the torrent is already online, there should be several
other seeds, but nearly all peers have the same percentage of the files, so
they redistribute whatever they got, but nobody gets the missing chunks
reasonable fast to redistribute them.

Regards,
Till
--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Till Maas wrote:
For me surely torrent1.fedoraproject.org is the bottleneck, because it only
seeds at around 0.2 KB/s and is the only seed at all. Something is strange,
because given the time the torrent is already online, there should be several
other seeds, but nearly all peers have the same percentage of the files, so
they redistribute whatever they got, but nobody gets the missing chunks
reasonable fast to redistribute them.


Exactly the same thing here. Somebody kicks that bitorrent server...

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, Oct 11, 2008 at 10:03:31PM +0200, Till Maas wrote:
> On Sat October 11 2008, Mike McGrath wrote:
>
> > I wouldn't say overloaded. Throttled is the right word, and we do have it
> > throttled. Although even throttled on one machine I was able to download
> > the latest live beta in roughly 10 minutes on my slicehost.com host, and
> > closer to 9 hours on my workstation at home. Its always difficult to tell
> > where the slowness happens but I suspect in my slow case it was because my
> > ISP was limiting my traffic and slicehost.com was not.
>
> For me surely torrent1.fedoraproject.org is the bottleneck, because it only
> seeds at around 0.2 KB/s and is the only seed at all. Something is strange,
> because given the time the torrent is already online, there should be several
> other seeds, but nearly all peers have the same percentage of the files, so
> they redistribute whatever they got, but nobody gets the missing chunks
> reasonable fast to redistribute them.

Yes, it seems like the seeder isn't handing out "random enough" chunks
of the file to various clients--like all the clients have to go back
to the single seeder for the missing chunks instead of getting them
from other clients. I would think there should be at least one
distributed copy by now, but my client says there are 0 (not even
fractional distributed copies...).

I'm using "bittorrent-curses". I increased my max_upload_rate to 600
KB/sec (is that bits or bytes by the way?) and enabled UDP 6881-6889
through the host's firewall (in addition to TCP 6881-6889) since I
hadn't realized that UDP is used now.

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Sat, 11 Oct 2008, Chuck Anderson wrote:

> On Sat, Oct 11, 2008 at 01:49:57PM -0500, Mike McGrath wrote:
> > On Sat, 11 Oct 2008, John Reiser wrote:
> >
> > > Young torrents on http://torrent.fedoraproject.org/ spread data too slowly.
> > > At 0500 UTC on Sat.Oct.11, there was 1 seed and 14 leeches, all at 13% done.
> > > At 1300 UTC on Sat.Oct.11, there was 1 seed and 31 leeches, all at 55% done.
> > > This is for F10-Snap1-x86_64-Live.
> > > I turned my machine off for the night (US PDT), powered on in the morning,
> > > and within half an hour had caught up to all leeches at 57% done.
> > > I use tranmsissionbt, and I saw that the seed was sending pieces of 256 KiB
> > > to me at 2.5 KiB/s, taking almost two minutes per piece (and then "pausing.")
> > >
> > > It seems to me that torrent.fedoraproject.org is overloaded, and that a change
> > > in policy would give sooner completion to everybody, even without more
> > > resources.
> >
> > I wouldn't say overloaded. Throttled is the right word, and we do have it
> > throttled. Although even throttled on one machine I was able to download
> > the latest live beta in roughly 10 minutes on my slicehost.com host, and
> > closer to 9 hours on my workstation at home. Its always difficult to tell
> > where the slowness happens but I suspect in my slow case it was because my
> > ISP was limiting my traffic and slicehost.com was not.
>
> I'm on multiple gig links, unrestricted, and it is taking an eternity
> to download the Snap1 images.
>

Seriously, this is a devel list, not an end-user list. Quantitative
values will get taken seriously, "eternity" won't unless you're actually
telling me they're failing to download.

-Mike

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list