FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > Debian > Debian Development

 
 
LinkBack Thread Tools
 
Old 02-17-2008, 09:53 AM
ARAKI Yasuhiro
 
Default Debian mirror CDN had launched.

Hi all,
I am a member of debian mirror administration team in Japan.

I announce I start cdn.debian.net.

At 2008-Feb-05, we had started "cdn.debian.org" on global Debian Mirrors.

This CDN checks your hosts DNS query to retrive your national location.
- If your located country has Debian Mirror, return this mirror site IP address.
- If your located continent has Debian Mirror, return this mirror site IP address.
- If CDN can not find your location, return one of Japan mirror.
- This CDN checks debian rsync mirror process. If mirror site is mirroring, CDN hides this site.

Usage:

Please use following apt line in /etc/apt/sources.list.

deb http://cdn.debian.net/debian/ sid main contrib non-free
deb-src http://cdn.debian.net/debian/ sid main contrib non-free

Of course, you can change from 'sid' to etch/lenny/stable/unstable....

Technology and Codes:
At first, CDN find requester IP's location by Max-mind DB.
Max-mind DB is same DB file for geoip-bin.deb package.

At 2nd, CDN checks nation/continent rsync footprint on each mirrors.
In order to avoid dead/old/partial mirror.

At last, CDN return nation/continent IP address by DNS-balance (http://openlab.jp/dns_balance/dns_balance.html)

History:
- From July 2007, cdn.debian.or.jp was distributing debian mirror by
With dead/alive chcked wighted Round-Robin CDN in some
debian mirroring sites in Japan.
- From Oct 2007, ftp.jp.debian.org use this.
- Feb. 2008, ftp.jp.debian.org return your world nearest site by MaxMind.

Call for Paticipate:

Now only three DD (these three are Japan residents only) write code and
manage system.
Actually, we don't have kowledge of all resion/country/continent networks.
Please help us and all of Debian APT users!

If you have some idea, question and suggestion, please contact me.
Of course, I welcome to talk about this in debian-devel!.

All codes are maintained by SVN at https://osdn.debian.or.jp/repos/cdn/trunk/.
Code licence is GPL. I think these codes are usable for other purposes.

Contact:
ARAKI Yasuhiro <ar@debian.org> as leader.
MUTO Kenshi <kmuto@debian.org> as coordinator of debian-installer.
ISHIKAWA Mutsumi <ishikawa@debian.org> as Debian mirror coordinator.


Thanks all.

ARAKI Yasuhiro <ar@debian.org>


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 
Old 02-17-2008, 11:08 AM
Vincent Bernat
 
Default Debian mirror CDN had launched.

OoO En cette fin de matinée radieuse du dimanche 17 février 2008, vers
11:53, ARAKI Yasuhiro <ar@debian.org> disait:

> Technology and Codes:
> At first, CDN find requester IP's location by Max-mind DB.
> Max-mind DB is same DB file for geoip-bin.deb package.

> At 2nd, CDN checks nation/continent rsync footprint on each mirrors.
> In order to avoid dead/old/partial mirror.

> At last, CDN return nation/continent IP address by DNS-balance
> (http://openlab.jp/dns_balance/dns_balance.html)

I just try with host:
cdn.debian.net is an alias for deb.cdn.araki.net.
deb.cdn.araki.net has address 61.115.118.67
deb.cdn.araki.net has address 133.5.166.3
deb.cdn.araki.net has address 133.5.166.3
deb.cdn.araki.net has address 61.206.119.174
deb.cdn.araki.net has address 133.50.218.117
deb.cdn.araki.net has address 130.54.59.159
deb.cdn.araki.net has address 133.50.218.117
deb.cdn.araki.net has address 133.50.218.117

61.115.118.67 is ftp.de.debian.org. I am located in France with an IP
address of one of the largest ISP here. This ISP is hosting an official
Debian mirror.

geoiplookup gives me:
GeoIP Country Edition: FR, France

Instead of giving Japan mirrors as secondary choices, you could try
nearby countries?

Thanks.
--
#ifdef STUPIDLY_TRUST_BROKEN_PCMD_ENA_BIT
2.4.0-test2 /usr/src/linux/drivers/ide/cmd640.c


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 
Old 02-17-2008, 11:46 AM
Kurt Roeckx
 
Default Debian mirror CDN had launched.

On Sun, Feb 17, 2008 at 01:08:39PM +0100, Vincent Bernat wrote:
>
> I just try with host:
> cdn.debian.net is an alias for deb.cdn.araki.net.
> deb.cdn.araki.net has address 61.115.118.67
> deb.cdn.araki.net has address 133.5.166.3
> deb.cdn.araki.net has address 133.5.166.3
> deb.cdn.araki.net has address 61.206.119.174
> deb.cdn.araki.net has address 133.50.218.117
> deb.cdn.araki.net has address 130.54.59.159
> deb.cdn.araki.net has address 133.50.218.117
> deb.cdn.araki.net has address 133.50.218.117
>
> 61.115.118.67 is ftp.de.debian.org. I am located in France with an IP
> address of one of the largest ISP here. This ISP is hosting an official
> Debian mirror.

61.115.118.67 is hanzubin.st.wakwak.ne.jp. I think the whole lists
you show there are Japanese servers. ftp.de.debian.org is 141.76.2.4
which is the one I get while being in .be.


Kurt


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 
Old 02-17-2008, 11:54 AM
Michal ÄŒihaÅ™
 
Default Debian mirror CDN had launched.

Dne Sun, 17 Feb 2008 13:46:47 +0100
Kurt Roeckx <kurt@roeckx.be> napsal(a):

> On Sun, Feb 17, 2008 at 01:08:39PM +0100, Vincent Bernat wrote:
> >
> > I just try with host:
> > cdn.debian.net is an alias for deb.cdn.araki.net.
> > deb.cdn.araki.net has address 61.115.118.67
> > deb.cdn.araki.net has address 133.5.166.3
> > deb.cdn.araki.net has address 133.5.166.3
> > deb.cdn.araki.net has address 61.206.119.174
> > deb.cdn.araki.net has address 133.50.218.117
> > deb.cdn.araki.net has address 130.54.59.159
> > deb.cdn.araki.net has address 133.50.218.117
> > deb.cdn.araki.net has address 133.50.218.117
> >
> > 61.115.118.67 is ftp.de.debian.org. I am located in France with an IP
> > address of one of the largest ISP here. This ISP is hosting an official
> > Debian mirror.
>
> 61.115.118.67 is hanzubin.st.wakwak.ne.jp. I think the whole lists
> you show there are Japanese servers. ftp.de.debian.org is 141.76.2.4
> which is the one I get while being in .be.

I get it also here in .cz...

--
Michal ÄŒihaÅ™ | http://cihar.com | http://blog.cihar.com
 
Old 02-17-2008, 11:58 AM
William Pitcock
 
Default Debian mirror CDN had launched.

Hi,

On Sun, 2008-02-17 at 13:08 +0100, Vincent Bernat wrote:
> 61.115.118.67 is ftp.de.debian.org. I am located in France with an
> IP
> address of one of the largest ISP here. This ISP is hosting an
> official
> Debian mirror.

61.115.118.67 is assigned to ASNIC, so there is no possible way it is in
Germany.

nenolod@carpathia:~$ host 61.115.118.67
67.118.115.61.in-addr.arpa domain name pointer hanzubin.st.wakwak.ne.jp.

I think it is giving you all Japanese servers.

William
 
Old 02-17-2008, 12:06 PM
Vincent Bernat
 
Default Debian mirror CDN had launched.

OoO Peu avant le début de l'après-midi du dimanche 17 février 2008, vers
13:58, William Pitcock <nenolod@sacredspiral.co.uk> disait:

>> 61.115.118.67 is ftp.de.debian.org. I am located in France with an
>> IP address of one of the largest ISP here. This ISP is hosting an
>> official Debian mirror.

> 61.115.118.67 is assigned to ASNIC, so there is no possible way it is in
> Germany.

You are right. The first IP was 141.76.2.4, in fact.
--
BOFH excuse #309:
firewall needs cooling


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 
Old 02-17-2008, 12:08 PM
Vincent Bernat
 
Default Debian mirror CDN had launched.

OoO Peu avant le début de l'après-midi du dimanche 17 février 2008, vers
13:46, Kurt Roeckx <kurt@roeckx.be> disait:

> 61.115.118.67 is hanzubin.st.wakwak.ne.jp. I think the whole lists
> you show there are Japanese servers. ftp.de.debian.org is 141.76.2.4
> which is the one I get while being in .be.

I did get 141.76.2.4 on the first request. Now, I only get japanese
servers.

Well, now, I get some french servers:
194.2.0.36: ftp.oleane.net
193.54.19.19: debian.mines.inpl-nancy.fr

deb.cdn.araki.net has address 194.2.0.36
deb.cdn.araki.net has address 193.54.19.19
deb.cdn.araki.net has address 194.2.0.36
deb.cdn.araki.net has address 193.54.19.19
deb.cdn.araki.net has address 194.2.0.36
deb.cdn.araki.net has address 193.54.19.19
deb.cdn.araki.net has address 193.54.19.19
deb.cdn.araki.net has address 193.54.19.19

I suppose there is still work in progress.
--
Keep it simple to make it faster.
- The Elements of Programming Style (Kernighan & Plauger)


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 
Old 02-17-2008, 12:16 PM
ARAKI Yasuhiro
 
Default Debian mirror CDN had launched.

Hi Vincent,

Thank you for your testing.

Do you like cdn.debian.net's idea and implementation?
I would like you to notice your impression for cdn.debian.net to me!
If possible, I hope you to update EU/Fr mirror list for cdn.debian.net
in near future. (please see last part of this mail..)

At Sun, 17 Feb 2008 13:08:39 +0100,
Vincent Bernat wrote:
>
> 61.115.118.67 is ftp.de.debian.org. I am located in France with an IP
> address of one of the largest ISP here. This ISP is hosting an official
> Debian mirror.

OK. However, your received result is right.
Because currentrly, I have not set for Debian Mirror on France!
Then cdn.debian.net returned german mirror as continental mirror of EU.

> geoiplookup gives me:
> GeoIP Country Edition: FR, France
>
> Instead of giving Japan mirrors as secondary choices, you could try
> nearby countries?

In Technically, Yes, we can.
I know, using http://www.debian.org/mirror/list might be easy answer.

However, I have no knowledge in each resional mirror policy/status.
Then I have added Japan/Korea national mirrors and AF/AS/EU/NA/OC/SA continents mirrors.
If anybody want to add national miror configuration,
I have to add file to 'svn add (to https://osdn.debian.or.jp/repos/cdn/trunk/country)'.

To manage by all of DD, I will propose to use SVN on alioth(?).debian.org in near future.

Thanks all,

ARAKI Yasuhiro <ar@debian.org>




--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 
Old 02-17-2008, 01:35 PM
"Leo "costela" Antunes"
 
Default Debian mirror CDN had launched.

[No need to CC me, I'm subscribed. Keeping the other CCs since I don't
know about their subscription status.]

Hi

ARAKI Yasuhiro wrote:
> I announce I start cdn.debian.net.

You could have announced work on this before, we could have joined
forces! :-)

But I wonder, how do you guys deal with partial mirrors (in terms of
provided archs)? Do you support only full mirrors?
You don't have any architecture information, so I assume you can only
use mirrors which could provide all archs, right?

> This CDN checks your hosts DNS query to retrive your national location.
> - If your located country has Debian Mirror, return this mirror site IP address.
> - If your located continent has Debian Mirror, return this mirror site IP address.

I don't think this is a good logic for many situations.
For instance: Brazil is in South America, but it doesn't have good links
to any other South American country. You'd most probably get better
results from a North American mirror instead of any other South American
mirror outside Brazil.
I think this situation might occur too often in other countries.

> - If CDN can not find your location, return one of Japan mirror.
> - This CDN checks debian rsync mirror process. If mirror site is mirroring, CDN hides this site.

This is a good idea. I had intended to plug this information into my
solution as well, though I'm not sure about hiding current mirroring
sites...
Though I couldn't find where you get this info from, and how. Is it in
the SVN you supplied?

Furthermore, why don't you guys use the info from the
Mirrors.masterlist[0] file to generate your country/continent
information? This way you can work closely with the mirror-admins to
keep your info up-to-date.

Cheers

--
Leo "costela" Antunes
[insert a witty retort here]
 
Old 02-17-2008, 02:50 PM
Kurt Roeckx
 
Default Debian mirror CDN had launched.

On Sun, Feb 17, 2008 at 03:35:08PM +0100, Leo costela Antunes wrote:
> [No need to CC me, I'm subscribed. Keeping the other CCs since I don't
> know about their subscription status.]
>
> Hi
>
> ARAKI Yasuhiro wrote:
> > I announce I start cdn.debian.net.
>
> You could have announced work on this before, we could have joined
> forces! :-)
>
> But I wonder, how do you guys deal with partial mirrors (in terms of
> provided archs)? Do you support only full mirrors?
> You don't have any architecture information, so I assume you can only
> use mirrors which could provide all archs, right?

And it looks to me like the mirror should also be available via
"/debian".


Kurt


--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
 

Thread Tools




All times are GMT. The time now is 09:41 AM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright ©2007 - 2008, www.linux-archive.org