FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > CentOS > CentOS Development

 
 
LinkBack Thread Tools
 
Old 08-29-2012, 12:18 PM
Lamar Owen
 
Default Interested in IA64 build.

On Tuesday, August 28, 2012 06:24:02 PM Karanbir Singh wrote:
> On 08/28/2012 04:32 PM, Lamar Owen wrote:
> > We finally got the electrical up (Mitsubishi 9900B 500KVA UPS woo hoo....) in our research building's data center, and have a 20 CPU Altix 3700 up, running, and available to do this. I know about and am pulling the 'c5-wip' tree Karanbir built a while back, and have allocated 1.4TB of disk on our Clariions here to the effort. Now, I know the last time this was brought up it didn't go very far; but I'm still interested in doing this, even if for private use here on our three Altix systems.
>
> *fear*

Fear? I'm afraid you lost me there, Karanbir. In any case, I mention 'private' simply that, even if there isn't any other interest, I'm still likely to do this myself, regardless, just not as a 'signed and sealed' CentOS distribution, just a private rebuild since I want to fully utilize this donated box for science, and I don't have a cluster of x86_64 boxes available. If there's other interest, then, well that's a different story and would need a 'signed and sealed' CentOS. But my needs are more modest. I know when I e-mail the CERN SLC-ia64 maintainer a while back he said that they had stopped supporting SLC5.x on ia64 (the last DVD ISO I found of SLC5 wouldn't boot, unfortunately).

> > James, did you get very far? Karanbir, what would be the chances of a 'refresh' of the ia64 c5-wip tree to 5.8?
> >
>
> it should be fairly straightforward - the yum ( mx actually ) issues
> that i ran into way back when, are also resolved now. But, is there any
> interest ?

Probably just from me. :-) IA64 has never been a very popular arch, but it's what I have to work with at the moment.

Just need to get bootstrapped to do the builds if there isn't any other interest; the ideal, at least from my point of view, is a CentOS5.x ISO to at least get a minimal install up for building, and initializing the build environment so that I can pull the source RPM's and do the rebuild for our use (again, assuming no other interest from the wider CentOS community). I'm willing to work from a 'less than ideal' point; having the 5.8 binaries at the moment would be a fantastic second place, and working through the pointers to the build environment that have been posted in the past is my fallback.

The machine came with some older SLES and RHEL DVD's along with SGI's ProPack of fairly recent vintage (last version that supported RHEL5, in fact), so I can get the box booted (in fact it is booted and running now.....). There is one EL5 rebuild for IA64 for which an older version is actually freely downloadable and could be used to bootstrap the process. (I'm trying to not use the 'O' word....).

I'm perfectly fine just pulling the source RPMs and working through what I know will not be a trivial process building my own once I get the thing bootstrapped up to a CentOS 5.8 equivalent level and a buildsystem set up, assuming that there's no wider interest in the CentOS community. And I might even look at going to EL6, but as painful as that build was for everyone, it would probably take a while, and I honestly don't know if I could get that done. At least an EL6 on IA64 wouldn't have to pass upstream binary compatibility testing for the IA64 side, just the ia32el side for the few things that would need it. EL5 is sufficient for what I want that box to do. And Debian 6 is too unstable on that hardware, and everything else on site is CentOS anyway, so Debian isn't really a solid option.

Anyway, thanks for the reply, it is appreciated. I'm not going to kid myself into thinking that this will be easy if I roll my own; since you already have the buildsystem set up it would be easier for you, but if there's no other interest I'll just have to slog through it myself. And I expect that it may take some time to get it just to rebuild. And I'm not even going to try to do a 'binary compatibility' test; I'll be rebuilding what we need from source anyway, so just having a reasonably close base is sufficient.

_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 08-29-2012, 06:44 PM
Lamar Owen
 
Default Interested in IA64 build.

On Tuesday, August 28, 2012 06:24:02 PM Karanbir Singh wrote:
> [rebuidling c5 on ia64] should be fairly straightforward - the yum ( mx actually ) issues
> that i ran into way back when, are also resolved now. But, is there any
> interest ?

FWIW, I now have a working mock setup on the Altix box, and have generated a few 'bootstrapping' RPMs starting with straight normal user rpmbuilds, then getting mock set up with the right local repos for bootstrapping, then getting the 'smock.pl' script running (see http://git.annexia.org/?p=fedora-mingw.git;a=tree;f=smock;hb=HEAD ) (this script was referenced in a thread a ways back; I can dig out the subject if anyone wants it), and building a couple of test cases, which worked fine. Getting the current mock running appeared to be a troublesome thing, at first, since the python-setuptools in C5 are fairly old, and the EPEL mock (1.0.28) has a requirement that needs a newer version... then I remembered that 'noarch' means just exactly what it says, and installed the various 'noarch' dependencies, rebuilding just the pieces that needed compiled code. Yeah, directly installing mock from EPEL-5-386's noarch works a treat, thanks to mock being pure python and purely noarch....

The first 'smock.pl' test case was a rebuild of a package I know quite well - postgresql. Only took 7 minutes to build, including populating the buildroot, and produced the expected set of packages. Hrmph, I remember building sets back in postgresql 7.0 days that took several hours on my build boxes back then....

So, time to feed smock a bigger set of packages, and see where I hit hangups.... and then time to do some testing.

Once I have a full tree built from the bootstrapping environment, I'll point mock at those repos and use them as the buildroot sources, and build it again. (Does that sound reasonable for bootstrapping from a 'foreign' system (where 'foreign' just means 'can't redistribute it but it's really close to CentOS in nature....')?

Anyway, getting ready to feed the box a fuller build package set.....
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 08-30-2012, 12:19 AM
Patrick Lists
 
Default Interested in IA64 build.

On 08/29/2012 08:44 PM, Lamar Owen wrote:
> On Tuesday, August 28, 2012 06:24:02 PM Karanbir Singh wrote:
>> [rebuidling c5 on ia64] should be fairly straightforward - the yum ( mx actually ) issues
>> that i ran into way back when, are also resolved now. But, is there any
>> interest ?
>
> FWIW, I now have a working mock setup on the Altix box

Have a look at mockchain. Quite helpful when building a large amount of
SRPMs:

https://skvidal.wordpress.com/2012/04/20/mockchain-use-cases-and-examples/

http://fedorapeople.org/cgit/skvidal/public_git/scripts.git/tree/mock

Regards,
Patrick

_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 08-31-2012, 07:09 PM
Lamar Owen
 
Default Interested in IA64 build.

On Wednesday, August 29, 2012 08:19:36 PM Patrick Lists wrote:
> On 08/29/2012 08:44 PM, Lamar Owen wrote:
> > On Tuesday, August 28, 2012 06:24:02 PM Karanbir Singh wrote:
> >> [rebuidling c5 on ia64] should be fairly straightforward - the yum ( mx actually ) issues
> >> that i ran into way back when, are also resolved now. But, is there any
> >> interest ?
> >
> > FWIW, I now have a working mock setup on the Altix box
>
> Have a look at mockchain. Quite helpful when building a large amount of
> SRPMs:

Thanks for the pointer, I will.

I'm still in the testing phase and haven't attempted to kick off a large build yet; making sure the building is going to be consistent, tracking down errors, etc. The most disconcerting error I've received was a Segfault from the compiler while attempting to rebuild glibc (with -j16, since I have more than 16 CPUs in the box) which I'm rebuilding with -j1 to make sure I'm not hitting some odd race condition(s). And I'm getting some odd errors while trying to rebuild the kernel; I may need to tweak the rpm options (the errors are of the form "Error: junk at the end of line" so not sure what to make of that.

It may be some hardware diagnostics will be in order; but before I kick off a large set of builds I want to make sure the system is going to be solid doing those builds.

I may try to build the set of updates first, and then try to respin C5.8 after that. It will probably take some time....
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 09-01-2012, 06:27 AM
Karanbir Singh
 
Default Interested in IA64 build.

On 08/31/2012 08:09 PM, Lamar Owen wrote:
> I may try to build the set of updates first, and then try to respin C5.8 after that. It will probably take some time....


happy to help..


--
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
ICQ: 2522219 | Yahoo IM: z00dax | Gtalk: z00dax
GnuPG Key : http://www.karan.org/publickey.asc
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 09-05-2012, 03:48 PM
Lamar Owen
 
Default Interested in IA64 build.

On Saturday, September 01, 2012 02:27:01 AM Karanbir Singh wrote:
> On 08/31/2012 08:09 PM, Lamar Owen wrote:
> > I may try to build the set of updates first, and then try to respin C5.8 after that. It will probably take some time....
>
>
> happy to help..

I'll shoot you an e-mail a little later today or tomorrow about what I've found thus far, and a couple of questions; that is, once I get caught up from a long weekend.... :-)

Thanks for the offer, it is most appreciated...

_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 09-24-2012, 12:36 PM
Lamar Owen
 
Default Interested in IA64 build.

On Wednesday, September 05, 2012 11:48:41 AM Lamar Owen wrote:
> I'll shoot you an e-mail a little later today or tomorrow about what I've found thus far, and a couple of questions; that is, once I get caught up from a long weekend.... :-)

> Thanks for the offer, it is most appreciated...

An update for the -devel list.... I've been keeping Karanbir updated, but this might have a little wider interest, now that I'm actually getting somewhere.

After having a difficult time getting a build started on our 20 CPU Altix 3700, I punted and tried doing the same builds on our smaller 2 CPU Altix 3200 (same basic machine as the 3700, just smaller). Using the last Scientific Linux CERN 5.4 IA64 build as my base, once installed I was able to successfully build the kernel, which I had not been able to do on the larger box. This pointed to either an SMP/NUMA issue with IA64 Linux, or an issue with the 20 CPU's box's hardware.

Since we have another large box (30 CPU Altix 350) that was successfully running tests on Debian 6, and since I'd really prefer not to use Debian (but I can go back to it if I have to) I put SLC 5.4 on it, which was a little more of an adventure due to the partitioning.... after getting the build environment set up, I was indeed able to successfully build the CentOS 5.8 updated kernel, which I had not been able to do on the 20 CPU box, but had done, much more slowly, on the 2 CPU box (many hours on the 2 CPU box; less than 2 hours on the 30 CPU box, and most of that time was disk I/O writing out the binary RPMs). Hmm, something is wrong, hardware-wise, with the 20 CPU box, it seems.

After a few false starts, I got mock up and running, version 1.0.28 from EPEL (it's a noarch RPM; installing the RPM out of EPEL's x86_64 repo worked fine, just had to rebuild a couple of its dependencies). I then rolled smock.pl over to it; mockchain, while it looks like a good piece of software, apparently is too new for mock 1.0.28, so it's smock for now.

Now, the 5.8 glibc doesn't want to build using the SLC 5.4 binary RPMs as 'seed' for the buildroot; so after careful thought, and understanding how long this might take, I mirrored the SRPMS for CentOS 5.5, 5.6, and 5.7 (already have 5.8 down). Test builds of both the 5.5 kernel and glibc were successful, and so I set the box to building the full 'os' repo of the CentOS 5.5 SRPMS, using the SLC 5.4 binaries to 'seed' the buildroot. Once the 5.5 set is built, I'll re-seed the build root with the 5.5 binaries, and either rebuild 5.5 or 5.6, and then step up one rev at a time until I get 5.8 to rebuild. At that point, I plan to do an actual iso spin of 5.8 (internal use only at the moment, unless there is wider interest), and try to install it on the 2 CPU Altix 3200. Maybe 5.9 will be out by that time (I figure it will take at least a month to build things stepwise).

In any case, the local rebuild of CentOS 5.5 using the SLC5.4 binaries as 'seed' started Saturday evening; as of 8:20A today it has successfully rebuilt 443 source RPMS, producing 1243 binary RPMS, and have seen 35 packages fail thus far. I think most of those failures are due to my forgetting that m4 version 1.4.8 is required, and m4 1.4.5 is provided in the SLC54 repos, so once this first pass completes I'll retry the failed packages (very easy to do with smock).

The biggest help was having SLC 5.4 available in an installable form, even though I had to do it as a network install; the install DVD didn't boot on the Altix systems, but the small boot.iso did, and serving up the packages on a webserver here an HTTP install was quick and painless. The CERN folk, especially Jaroslaw Polok, did the biggest part of the grunt work there, and I thank the CERN team.

Oh, and if you're interested in this sort of thing, pics of both the 30 CPU and the 2 CPU boxen (they occupy the same rack) can be seen a little way down the page at:
http://forums.nekochan.net/viewtopic.php?f=14&t=16725868
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 09-24-2012, 02:00 PM
Matthew Patton
 
Default Interested in IA64 build.

In the interest of time why not build just the 250 or so packages that comprise a minimal system plus compiler support?
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 09-24-2012, 02:50 PM
Lamar Owen
 
Default Interested in IA64 build.

On Monday, September 24, 2012 10:00:39 AM Matthew Patton wrote:
> In the interest of time why not build just the 250 or so packages that comprise a minimal system plus compiler support?

In the interest of completeness, I'd like to build everything.

Further, this is secondarily serving as the commissioning tests for this machine.

So while I understand the sentiment, it will work out better for us to build everything.

And then I'm going to rebuild some third-part repo SRPMs.
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 
Old 09-24-2012, 04:35 PM
Karanbir Singh
 
Default Interested in IA64 build.

On 09/24/2012 03:00 PM, Matthew Patton wrote:
> In the interest of time why not build just the 250 or so packages that comprise a minimal system plus compiler support?

Also worth noting that doing the installer builds need more than 250
packages on its own. ok, so maybe there is no real need to get a GUI
installer going etc, but its still a worthwhile effort.



--
Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
ICQ: 2522219 | Yahoo IM: z00dax | Gtalk: z00dax
GnuPG Key : http://www.karan.org/publickey.asc
_______________________________________________
CentOS-devel mailing list
CentOS-devel@centos.org
http://lists.centos.org/mailman/listinfo/centos-devel
 

Thread Tools




All times are GMT. The time now is 04:08 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright 2007 - 2008, www.linux-archive.org