FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > CRUX > CRUX

 
 
LinkBack Thread Tools
 
Old 06-16-2010, 04:12 AM
Alan
 
Default Sourceforge URLs for ports

We have many ports with sourceforge URLs that don't work reliably (for
whatever reason), and its always a pain to build these ports.

So I propose that everybody change their URLs to the one that has always
worked for me:

http://prdownloads.sf.net/projectname/file-version.tar.gz

Example:

[root@ares2 libid3tag]# sudo -H -u pkgmk fakeroot pkgmk -do
=======> Downloading 'http://dl.sourceforge.net/mad/libid3tag-0.15.1b.tar.gz'.
--2010-06-16 13:05:11--
http://dl.sourceforge.net/mad/libid3tag-0.15.1b.tar.gz
Resolving dl.sourceforge.net... 216.34.181.138
Connecting to dl.sourceforge.net|216.34.181.138|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://sourceforge.net/downloads/mad/libid3tag-0.15.1b.tar.gz
[following]
--2010-06-16 13:05:11--
http://sourceforge.net/downloads/mad/libid3tag-0.15.1b.tar.gz
Resolving sourceforge.net... 216.34.181.60
Connecting to sourceforge.net|216.34.181.60|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2010-06-16 13:05:11 ERROR 404: Not Found.

=======> ERROR: Downloading
'http://dl.sourceforge.net/mad/libid3tag-0.15.1b.tar.gz' failed.

[root@ares2 libid3tag]# sed -i -e 's|http://dl.sourceforge.net/|
http://prdownloads.sf.net/|g' Pkgfile

[root@ares2 libid3tag]# sudo -H -u pkgmk fakeroot pkgmk -do
=======> Downloading 'http://prdownloads.sf.net/mad/libid3tag-0.15.1b.tar.gz'.
=======> Partial download found, trying to resume
--2010-06-16 13:05:28--
http://prdownloads.sf.net/mad/libid3tag-0.15.1b.tar.gz
Resolving prdownloads.sf.net... 216.34.181.129
Connecting to prdownloads.sf.net|216.34.181.129|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location:
http://downloads.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
[following]
--2010-06-16 13:05:28--
http://downloads.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
Resolving downloads.sourceforge.net... 216.34.181.59
Connecting to downloads.sourceforge.net|216.34.181.59|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location:
http://hivelocity.dl.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
[following]
--2010-06-16 13:05:29--
http://hivelocity.dl.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
Resolving hivelocity.dl.sourceforge.net... 74.50.111.26
Connecting to hivelocity.dl.sourceforge.net|74.50.111.26|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 338143 (330K) [application/x-gzip]
Saving to: `/usr/ports/dist/libid3tag-0.15.1b.tar.gz.partial'

100%[================================================== =====>] 338,143
115K/s in 2.9s

2010-06-16 13:05:32 (115 KB/s) -
`/usr/ports/dist/libid3tag-0.15.1b.tar.gz.partial' saved [338143/338143]


--
Alan
_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 06-17-2010, 06:28 PM
Bernd Eggink
 
Default Sourceforge URLs for ports

Am 16.06.2010 06:12, schrieb Alan:

We have many ports with sourceforge URLs that don't work reliably (for
whatever reason), and its always a pain to build these ports.


For this reason I wrote myself a modified pkgmk script which works (for
me) with all kinds of URLs, especially those in the form
http://sourceforge.net/projects/blah/.../download.


If anybody wants to try it, you can download it here:

http://sudrala.de/en_d/crux.html

Regards,
Bernd

--
Bernd Eggink
http://sudrala.de
_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 06-27-2010, 08:09 AM
Juergen Daubert
 
Default Sourceforge URLs for ports

On Wed, Jun 16, 2010 at 01:12:26PM +0900, Alan wrote:

Hi Alan,

> We have many ports with sourceforge URLs that don't work reliably (for
> whatever reason), and its always a pain to build these ports.
>
> So I propose that everybody change their URLs to the one that has always
> worked for me:
>
> http://prdownloads.sf.net/projectname/file-version.tar.gz

thanks for your suggestion, but as you can see in your example below,
this only redirects to a different URL which seems to be the 'new'
layout of sourceforge:

http://downloads.sourceforge.net/project/<project_name>/<sub_project_name>/<version>/<file_name>

I've noticed the first time yesterday that the pattern we are currently
using in most of our ports dosn't work anymore, though your suggestion
still does.
Dunno why, but one point is that prdownloads.sf.net, which is a CNAME to
downloads.sf.net, is a different server (216.34.181.129) than
downloads.sourceforge.net (216.34.181.59) or dl.sourceforge.net (216.34.181.138)

The mirror has finally a URL like http://heanet.dl.sourceforge.net/...

At all I'm against to change everything to a different URL, which
is quite a lot of work, and in a few months we have to do that again.
I'd suggest we try to get reliable informations from the sourceforge
admins how to do it best. Volunteers?

Best regards
Juergen

>
> Example:
>
> [root@ares2 libid3tag]# sudo -H -u pkgmk fakeroot pkgmk -do
> =======> Downloading 'http://dl.sourceforge.net/mad/libid3tag-0.15.1b.tar.gz'.
> --2010-06-16 13:05:11--
> http://dl.sourceforge.net/mad/libid3tag-0.15.1b.tar.gz
> Resolving dl.sourceforge.net... 216.34.181.138
> Connecting to dl.sourceforge.net|216.34.181.138|:80... connected.
> HTTP request sent, awaiting response... 302 Found
> Location: http://sourceforge.net/downloads/mad/libid3tag-0.15.1b.tar.gz
> [following]
> --2010-06-16 13:05:11--
> http://sourceforge.net/downloads/mad/libid3tag-0.15.1b.tar.gz
> Resolving sourceforge.net... 216.34.181.60
> Connecting to sourceforge.net|216.34.181.60|:80... connected.
> HTTP request sent, awaiting response... 404 Not Found
> 2010-06-16 13:05:11 ERROR 404: Not Found.
>
> =======> ERROR: Downloading
> 'http://dl.sourceforge.net/mad/libid3tag-0.15.1b.tar.gz' failed.
>
> [root@ares2 libid3tag]# sed -i -e 's|http://dl.sourceforge.net/|
> http://prdownloads.sf.net/|g' Pkgfile
>
> [root@ares2 libid3tag]# sudo -H -u pkgmk fakeroot pkgmk -do
> =======> Downloading 'http://prdownloads.sf.net/mad/libid3tag-0.15.1b.tar.gz'.
> =======> Partial download found, trying to resume
> --2010-06-16 13:05:28--
> http://prdownloads.sf.net/mad/libid3tag-0.15.1b.tar.gz
> Resolving prdownloads.sf.net... 216.34.181.129
> Connecting to prdownloads.sf.net|216.34.181.129|:80... connected.
> HTTP request sent, awaiting response... 301 Moved Permanently
> Location:
> http://downloads.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
> [following]
> --2010-06-16 13:05:28--
> http://downloads.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
> Resolving downloads.sourceforge.net... 216.34.181.59
> Connecting to downloads.sourceforge.net|216.34.181.59|:80... connected.
> HTTP request sent, awaiting response... 302 Found
> Location:
> http://hivelocity.dl.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
> [following]
> --2010-06-16 13:05:29--
> http://hivelocity.dl.sourceforge.net/project/mad/libid3tag/0.15.1b/libid3tag-0.15.1b.tar.gz
> Resolving hivelocity.dl.sourceforge.net... 74.50.111.26
> Connecting to hivelocity.dl.sourceforge.net|74.50.111.26|:80... connected.
> HTTP request sent, awaiting response... 200 OK
> Length: 338143 (330K) [application/x-gzip]
> Saving to: `/usr/ports/dist/libid3tag-0.15.1b.tar.gz.partial'
>
> 100%[================================================== =====>] 338,143
> 115K/s in 2.9s
>
> 2010-06-16 13:05:32 (115 KB/s) -
> `/usr/ports/dist/libid3tag-0.15.1b.tar.gz.partial' saved [338143/338143]
>
>
> --
> Alan
> _______________________________________________
> CRUX mailing list
> CRUX@lists.crux.nu
> http://lists.crux.nu/mailman/listinfo/crux

--
Juergen Daubert | mailto:jue@jue.li
Korb, Germany | http://jue.li/crux

_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 06-27-2010, 10:56 AM
Juergen Daubert
 
Default Sourceforge URLs for ports

On Sun, Jun 27, 2010 at 10:09:40AM +0200, Juergen Daubert wrote:
> On Wed, Jun 16, 2010 at 01:12:26PM +0900, Alan wrote:
>
> Hi Alan,
>
> > We have many ports with sourceforge URLs that don't work reliably (for
> > whatever reason), and its always a pain to build these ports.
> >
> > So I propose that everybody change their URLs to the one that has always
> > worked for me:
> >
> > http://prdownloads.sf.net/projectname/file-version.tar.gz
>
> thanks for your suggestion, but as you can see in your example below,
> this only redirects to a different URL which seems to be the 'new'
> layout of sourceforge:
>
> http://downloads.sourceforge.net/project/<project_name>/<sub_project_name>/<version>/<file_name>
>
> I've noticed the first time yesterday that the pattern we are currently
> using in most of our ports dosn't work anymore, though your suggestion
> still does.

looks like I've selected a half-broken mirror, which is currently not
able to do the correct redirects. Using heanet (193.1.193.66) works but
I'd suggest to use 216.34.181.129, which is the IP of downloads.sf.net
in /etc/hosts or where else you are doing your DNS resolution. See [1].

http://d23ae2aa8a67444e.paste.se/ shows the response for heanet,
http://6e124b629ed6dcd5.paste.se/ for downloads.sf.net. Thanks to Tilman
for providing the pastes.


Greetings
Juergen

[1] http://crux.nu/Wiki/FaqPortsSystem#ntoc8

--
Juergen Daubert | mailto:jue@jue.li
Korb, Germany | http://jue.li/crux

_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 06-29-2010, 01:23 PM
Danny Rawlins
 
Default Sourceforge URLs for ports

Juergen Daubert wrote:
> On Sun, Jun 27, 2010 at 10:09:40AM +0200, Juergen Daubert wrote:
>
>> On Wed, Jun 16, 2010 at 01:12:26PM +0900, Alan wrote:
>>
>> Hi Alan,
>>
>>
>>> We have many ports with sourceforge URLs that don't work reliably (for
>>> whatever reason), and its always a pain to build these ports.
>>>
>>> So I propose that everybody change their URLs to the one that has always
>>> worked for me:
>>>
>>> http://prdownloads.sf.net/projectname/file-version.tar.gz
>>>
>> thanks for your suggestion, but as you can see in your example below,
>> this only redirects to a different URL which seems to be the 'new'
>> layout of sourceforge:
>>
>> http://downloads.sourceforge.net/project/<project_name>/<sub_project_name>/<version>/<file_name>
>>
>> I've noticed the first time yesterday that the pattern we are currently
>> using in most of our ports dosn't work anymore, though your suggestion
>> still does.
>>
>
> looks like I've selected a half-broken mirror, which is currently not
> able to do the correct redirects. Using heanet (193.1.193.66) works but
> I'd suggest to use 216.34.181.129, which is the IP of downloads.sf.net
> in /etc/hosts or where else you are doing your DNS resolution. See [1].
>
> http://d23ae2aa8a67444e.paste.se/ shows the response for heanet,
> http://6e124b629ed6dcd5.paste.se/ for downloads.sf.net. Thanks to Tilman
> for providing the pastes.
>
>
> Greetings
> Juergen
>
> [1] http://crux.nu/Wiki/FaqPortsSystem#ntoc8
>
>
If you look over the git change I did a long time ago in contrib, I have
not had any issues with using this format;

http://downloads.sourceforge.net/sourceforge/xine/$name-$version.tar.bz2

But now I use my own mirror://sourceforge format that I hacked in
pkgutils, perhaps you would be keen on this patch but someone else can
implement it it took over a year for the last patch for new files in
footprint.

Regards,
Danny
_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 06-29-2010, 08:08 PM
James Mills
 
Default Sourceforge URLs for ports

On Tue, Jun 29, 2010 at 11:23 PM, Danny Rawlins
<monster.romster@gmail.com> wrote:
> But now I use my own mirror://sourceforge format that I hacked in
> pkgutils, perhaps you would be keen on this patch but someone else can
> implement it it took over a year for the last patch for new files in
> footprint.

Do you have a port of this that others like myself in the CRUX
Community may try out ?

cheers
James

--
-- James Mills
--
-- "Problems are solved by method"
_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 06-30-2010, 02:56 AM
Danny Rawlins
 
Default Sourceforge URLs for ports

James Mills wrote:
> On Tue, Jun 29, 2010 at 11:23 PM, Danny Rawlins
> <monster.romster@gmail.com> wrote:
>
>> But now I use my own mirror://sourceforge format that I hacked in
>> pkgutils, perhaps you would be keen on this patch but someone else can
>> implement it it took over a year for the last patch for new files in
>> footprint.
>>
>
> Do you have a port of this that others like myself in the CRUX
> Community may try out ?
>
> cheers
> James
>
>
I sure do, currently it's at:

httpup sync
http://romster.dyndns.org:8080/linux/ports/hvlinux/core/#pkgutils pkgutils

You will need the *.mirror files out of
http://romster.dyndns.org:8080/linux/ports/hvlinux/core/ports/ that go
in /etc/ports/mirrors/ for the mirror:// metaname to work.

One line per a URL.

And is still compatible for CRUX.

Like I did say earlier .

sed -i -e
"s|http://dl.sourceforge.net|http://downloads.sourceforge.net|g"
/usr/ports/*/*/Pkgfile

Problem solved for sourceforge.

PS you emailed me directly when I am on the ML.
Regards,
Danny

_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 12-14-2010, 12:20 PM
Wawrzyniec Niewodniczański
 
Default Sourceforge URLs for ports

Hi,

I asked about the link on sourceforge IRC and below responses I got:

<niewod> I wonder if it possible to have a generic download patch for
project hosted on SF in the form:
<niewod> http://downloads.sourceforge.net/projects/$name/$version/$name$version.tar.gz

<evaluate> niewod, if you mean download path, it should normally look
like: http://sourceforge.net/projects/PROJECTNAME/files/FILENAME.tar.gz/download

<niewod> Thanks - I'll test it

<evaluate> niewod, sure.

<niewod> evaluate, The suggested link works (at least for my initial
test), howerver I needed to drop /download from the end. Otherwise I
have file called 'download' rather then i.e. 'expect5.45.tar.gz' (I'm
creating ports (packages) for CRUX Linux)

<evaluate> niewod, not sure if SF has direct download links, as they
are working with multiple mirrors to distribute the load, ctsai-sf
might have more info on this though...
<evaluate> niewod, btw, there's also
http://downloads.sourceforge.net/PROJECTNAME/FILENAME.tar.gz , maybe
that'll work for you...

<niewod> The first link works, so I'll give it more extensive try

<ctsai-sf> niewod: we do allow downloads via script or cli. The link
evaluate provided is the recommended link format for this, you do want
to make sure that download function can follow 302 redirects and that
it does not provide a browser-like User-Agent (otherwise, we'll serve
up an html page).
<ctsai-sf> And by "the link", I mean the first one.
<ctsai-sf> And, as you suggest dropping the /download usually works,
though I'm not certain that it's "officially" supported.

<niewod> ctsai-sf, thanks for explenation



Cheers,
Wawrzek
--
┬*Wawrzyniec Niewodnicza┼äski┬* ┬* ┬* vel Wawrzek Larry or LarryN
┬* ┬* Linux User #177124┬* ┬* ┬* ┬* ┬* ┬* ┬* E-MAIL: wawrzek@gmail.com
┬*PhD in Quantum Chemistry┬* ┬* ┬* ┬* ┬* ┬* WWW: http://wawrzek.name
┬*MSc in Molecular Engineering┬* ┬* ┬* ┬* ┬*┬* JID: wawrzek@jabber.wroc.pl
_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 
Old 12-15-2010, 10:38 AM
Danny Rawlins
 
Default Sourceforge URLs for ports

Wawrzyniec Niewodniczański wrote:
> Hi,
>
> I asked about the link on sourceforge IRC and below responses I got:
>
> <niewod> I wonder if it possible to have a generic download patch for
> project hosted on SF in the form:
> <niewod> http://downloads.sourceforge.net/projects/$name/$version/$name$version.tar.gz
>
> <evaluate> niewod, if you mean download path, it should normally look
> like: http://sourceforge.net/projects/PROJECTNAME/files/FILENAME.tar.gz/download
>
> <niewod> Thanks - I'll test it
>
> <evaluate> niewod, sure.
>
> <niewod> evaluate, The suggested link works (at least for my initial
> test), howerver I needed to drop /download from the end. Otherwise I
> have file called 'download' rather then i.e. 'expect5.45.tar.gz' (I'm
> creating ports (packages) for CRUX Linux)
>
> <evaluate> niewod, not sure if SF has direct download links, as they
> are working with multiple mirrors to distribute the load, ctsai-sf
> might have more info on this though...
> <evaluate> niewod, btw, there's also
> http://downloads.sourceforge.net/PROJECTNAME/FILENAME.tar.gz , maybe
> that'll work for you...
>
> <niewod> The first link works, so I'll give it more extensive try
>
> <ctsai-sf> niewod: we do allow downloads via script or cli. The link
> evaluate provided is the recommended link format for this, you do want
> to make sure that download function can follow 302 redirects and that
> it does not provide a browser-like User-Agent (otherwise, we'll serve
> up an html page).
> <ctsai-sf> And by "the link", I mean the first one.
> <ctsai-sf> And, as you suggest dropping the /download usually works,
> though I'm not certain that it's "officially" supported.
>
> <niewod> ctsai-sf, thanks for explenation
>
>
>
> Cheers,
> Wawrzek
>

http://downloads.sourceforge.net/PROJECTNAME/FILENAME.tar.gz

Works fine except for a few ports like boost-jam where sourceforge broke the url that I had to update.

http://crux.nu/gitweb/?p=ports/contrib.git;a=commitdiff;h=eec37626809b0d10bfbaf48 8983a1ef41dc2831a

As

downloads.sourceforge.net/PROJECTNAME/FILENAME/VERSIONBRANCH/FILENAME.tar.gz

Regards,
Danny

_______________________________________________
CRUX mailing list
CRUX@lists.crux.nu
http://lists.crux.nu/mailman/listinfo/crux
 

Thread Tools




All times are GMT. The time now is 07:07 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright ę2007 - 2008, www.linux-archive.org