Hello everyone,

There is talk of creating a HPC SIG that will focus on making Fedora HPC/Grid/Cluster ready. It would be great to find out who in Fedora is interested in beginning some discussions.

Here's some of my own questions to add to the mix:

- How can we make Anaconda support different interconnects?

- How do we handle HPC/Grid needs which differ from traditional systems? Using puppet, others?
* Should we provide 'sane' defaults needed within a HPC environment out of the box?
* Addon packages to modify configurations of other packages?

- Which job submission/batch schedulers? more choice is better.

- Full OFED integration (Doug Ledford has been working on this)

- Provisioning: Multiple methods for provisioning?
* Cobbler, Spacewalk, other open source mechanisms?

- Packaging of HPC applications/libs
* Open MPI, MPICH1/MPICH2?, MVAPICH1/MVAPICH2?
* Directory structure - FHS
* Using environment-modules or alternatives to allow users to switch between different MPIs etc.

- Package Optimization
* A lot of people tend to want highly optimized packages such as ATLAS and usually will recompile them against their
new processors. Do we just settle on defaults, can't satisfy all people.

There are many more questions and getting some initial discussions going will be beneficial to Fedora.

--
Shawn Starr
Software Developer, Open Source Grid Development Center (OSGDC)
Platform Computing
3760 14th Avenue
Markham, ON L3R3T7
direct: 905.948.4229
http://www.platform.com

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Thu, 17 Jul 2008 16:07:15 -0400, Shawn Starr wrote:
> There are many more questions and getting some initial discussions
> going will be beneficial to Fedora.

I'm interested in HPC. My nits to pick:
- hierarchical storage management
- petabyte storage management
- billions of files
- cluster file systems

Cheers,
Christian

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Sounds good,

That makes four people so far.

If other people are interested, let's figure out the best way to keep the community informed. We can setup a Fedora meeting on IRC, but there's no formal SIG yet.

Thanks,
Shawn.

> -----Original Message-----
> From: Bryan Che
> Sent: Friday, July 18, 2008 9:52 AM
> To: fedora-nightlife-list; Shawn Starr
> Subject: Re: [Fedora-nightlife-list] Some initial discussions of a
> Fedora HPC SIG
>
>
> Hi Shawn, I'd be interested.
>
> Bryan
>
> Shawn Starr wrote:
> > (This was also sent to fedora-devel-list)
> >
> > Hello everyone,
> >
> > There is talk of creating a HPC SIG that will focus on
> making Fedora HPC/Grid/Cluster ready. It would be great to
> find out who in Fedora is interested in beginning some discussions.
> >
> > Here's some of my own questions to add to the mix:
> >
> > - How can we make Anaconda support different interconnects?
> >
> > - How do we handle HPC/Grid needs which differ from
> traditional systems? Using puppet, others?
> > * Should we provide 'sane' defaults needed within a HPC
> environment out of the box?
> > * Addon packages to modify configurations of other packages?
> >
> > - Which job submission/batch schedulers? more choice is better.
> >
> > - Full OFED integration (Doug Ledford has been working on this)
> >
> > - Provisioning: Multiple methods for provisioning?
> > * Cobbler, Spacewalk, other open source mechanisms?
> >
> > - Packaging of HPC applications/libs
> > * Open MPI, MPICH1/MPICH2?, MVAPICH1/MVAPICH2?
> > * Directory structure - FHS
> > * Using environment-modules or alternatives to allow
> users to switch between different MPIs etc.
> >
> > - Package Optimization
> > * A lot of people tend to want highly optimized packages
> such as ATLAS and usually will recompile them against their
> > new processors. Do we just settle on defaults, can't
> satisfy all people.
> >
> > There are many more questions and getting some initial
> discussions going will be beneficial to Fedora.
> >
> > --
> > Shawn Starr
> > Software Developer, Open Source Grid Development Center (OSGDC)
> > Platform Computing
> > 3760 14th Avenue
> > Markham, ON L3R3T7
> > direct: 905.948.4229
> > http://www.platform.com
> >
> > _______________________________________________
> > Fedora-nightlife-list mailing list
> > Fedora-nightlife-list
> > https://www.redhat.com/mailman/listinfo/fedora-nightlife-list
>
> --
> Bryan Che
> Red Hat, Inc.
> 314 Littleton Rd
> Westford, MA 01886
> 978-392-3107
> bche at redhat d0t com
>

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Fri, 18 Jul 2008 11:05:45 -0400 "Shawn Starr" wrote:
>
> That makes four people so far.
>
> If other people are interested, let's figure out the best way to keep
> the community informed. We can setup a Fedora meeting on IRC, but
> there's no formal SIG yet.


Please count me in. I'm very interested in Fedora for scientific
computing and HPC purposes and have used it to build a number of
small to mid-sized clusters.

And, as much as free time allows, I'd like to see Fedora improve for
cluster builders, users, etc...

Ed

--
Edward H. Hill III, PhD | ed@eh3.com | http://eh3.com/
--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

On Thu, 2008-07-17 at 23:05 +0200, Christian Iseli wrote:
> On Thu, 17 Jul 2008 16:07:15 -0400, Shawn Starr wrote:
> > There are many more questions and getting some initial discussions
> > going will be beneficial to Fedora.
>
> I'm interested in HPC. My nits to pick:
> - hierarchical storage management
> - petabyte storage management
> - billions of files
> - cluster file systems

I maintain a few packages related to cluster filesystems (cman/gfs etc)
and I'd be happy to work with you guys if there are changes in my
packages required to make your life simpler.

Fabio

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Hello everyone,

It would be great if we can kick off the SIG.

1) Which day and time would be good for the meetings in #fedora-meeting

The available times are here: http://fedoraproject.org/wiki/Communicate/FedoraMeetingChannel

2) Let's come up with an initial agenda.

Thanks,

--
Shawn Starr
Software Developer, Open Source Grid Development Center (OSGDC)
Platform Computing
3760 14th Avenue
Markham, ON L3R3T7
direct: 905.948.4229
http://www.platform.com

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list