FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > Redhat > Fedora Build System

 
 
LinkBack Thread Tools
 
Old 03-11-2010, 02:23 PM
Doug Reiland
 
Default koji spin-livecd issues

I got a minimal livecd to build (not tested yet) but a to make some
kojid changes. Are these really bugs or should be handled elsewhere?

I had to include '/dev/shm' in bind_opts
Also, livecd-creator (imgcreator python package) was calling
os.random() and that wanted '/dev/urandom', so I had to a mknod for
that where loop? nodes are created.

Also, I had to include device-mapper in the livecd-build group.

Doug
--
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 
Old 03-11-2010, 02:38 PM
Jay Greguske
 
Default koji spin-livecd issues

They are bugs, and a patch was submitted upstream not long ago:

https://fedorahosted.org/koji/changeset?old_path=builder&old=3deb8358e67ff901f14 7900c2b230d5e0f3a8e0b&new_path=builder&new=06a885f e47f10742c0616799bcee727f93628a88

You'll also want to move the broot.expire() later in the task too. There is a race condition where the output is getting cleaned up before it is moved to a final resting place. The patch I sited above fixes that too.

This code hasn't seen too much exposure, so don't hesitate to ask questions here or to me directly. I'm hanging out on Freenode IRC as jgreguske in #koji or #fedora-devel as well.

Thanks for checking in!

- Jay


----- "Doug Reiland" <dreiland@gmail.com> wrote:

> I got *a minimal livecd to build (not tested yet) but a to make some
> kojid changes. Are these really bugs or should be handled elsewhere?
>
> I had to include '/dev/shm' in bind_opts
> Also, livecd-creator (imgcreator python package) was calling
> os.random() and that wanted '/dev/urandom', so I had to a mknod for
> that where loop? nodes are created.
>
> Also, I had to include device-mapper in the livecd-build group.
>
> Doug
> --
> buildsys mailing list
> buildsys@lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/buildsys
> --
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 
Old 03-11-2010, 06:42 PM
Doug Reiland
 
Default koji spin-livecd issues

OK, thanks.
FYI, I noticed the loop devices weren't being cleaned up when it
fails. I noticed because I eventually ran out.
I checked after my successful run and everything was OK there.


On Thu, Mar 11, 2010 at 10:38 AM, Jay Greguske <jgregusk@redhat.com> wrote:
> They are bugs, and a patch was submitted upstream not long ago:
>
> https://fedorahosted.org/koji/changeset?old_path=builder&old=3deb8358e67ff901f14 7900c2b230d5e0f3a8e0b&new_path=builder&new=06a885f e47f10742c0616799bcee727f93628a88
>
> You'll also want to move the broot.expire() later in the task too. There is
> a race condition where the output is getting cleaned up before it is moved
> to a final resting place. The patch I sited above fixes that too.
>
> This code hasn't seen too much exposure, so don't hesitate to ask questions
> here or to me directly. I'm hanging out on Freenode IRC as jgreguske in
> #koji or #fedora-devel as well.
>
> Thanks for checking in!
>
> - Jay
>
>
> ----- "Doug Reiland" <dreiland@gmail.com> wrote:
>> I got *a minimal livecd to build (not tested yet) but a to make some
>> kojid changes. Are these really bugs or should be handled elsewhere?
>>
>> I had to include '/dev/shm' in bind_opts
>> Also, livecd-creator (imgcreator python package) was calling
>> os.random() and that wanted '/dev/urandom', so I had to a mknod for
>> that where loop? nodes are created.
>>
>> Also, I had to include device-mapper in the livecd-build group.
>>
>> Doug
>> --
>> buildsys mailing list
>> buildsys@lists.fedoraproject.org
>> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>>
> --
> buildsys mailing list
> buildsys@lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>
--
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 
Old 03-11-2010, 07:15 PM
Doug Reiland
 
Default koji spin-livecd issues

Sorry, one more thing.
More of my initial errors was kojid needing topurl set in kojid.conf
and it looks like kojid doesn't like topdir and topurl both set.
Does this imply that no host can belong to both createrepo and livecd channel?

Doug


On Thu, Mar 11, 2010 at 10:38 AM, Jay Greguske <jgregusk@redhat.com> wrote:
> They are bugs, and a patch was submitted upstream not long ago:
>
> https://fedorahosted.org/koji/changeset?old_path=builder&old=3deb8358e67ff901f14 7900c2b230d5e0f3a8e0b&new_path=builder&new=06a885f e47f10742c0616799bcee727f93628a88
>
> You'll also want to move the broot.expire() later in the task too. There is
> a race condition where the output is getting cleaned up before it is moved
> to a final resting place. The patch I sited above fixes that too.
>
> This code hasn't seen too much exposure, so don't hesitate to ask questions
> here or to me directly. I'm hanging out on Freenode IRC as jgreguske in
> #koji or #fedora-devel as well.
>
> Thanks for checking in!
>
> - Jay
>
>
> ----- "Doug Reiland" <dreiland@gmail.com> wrote:
>> I got *a minimal livecd to build (not tested yet) but a to make some
>> kojid changes. Are these really bugs or should be handled elsewhere?
>>
>> I had to include '/dev/shm' in bind_opts
>> Also, livecd-creator (imgcreator python package) was calling
>> os.random() and that wanted '/dev/urandom', so I had to a mknod for
>> that where loop? nodes are created.
>>
>> Also, I had to include device-mapper in the livecd-build group.
>>
>> Doug
>> --
>> buildsys mailing list
>> buildsys@lists.fedoraproject.org
>> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>>
> --
> buildsys mailing list
> buildsys@lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>
--
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 
Old 03-11-2010, 07:17 PM
Jay Greguske
 
Default koji spin-livecd issues

Yeah I've seen that as well, but it depends on when livecd-creator fails. Generally if it fails in a totally unexpected way (like /dev/urandom being missing) it won't clean up. But if it fails in an expected way, one that has been coded for, then it will.

I'll talk with the livecd-tools upstream maintainers to find out if they know more about the issue and are working on it. If active research/development isn't happening in that space I'll contribute a patch to Koji that forcibly gets it to clean up. It's not an easy problem though: I'm not aware of a good way to identify which mounts are specific to a given task. Do you have any ideas?

- Jay

----- "Doug Reiland" <dreiland@gmail.com> wrote:

> OK, thanks.
> FYI, I noticed the loop devices weren't being cleaned up when it
> fails. I noticed because I eventually ran out.
> I checked after my successful run and everything was OK there.
>
>
> On Thu, Mar 11, 2010 at 10:38 AM, Jay Greguske <jgregusk@redhat.com> wrote:
> > They are bugs, and a patch was submitted upstream not long ago:
> >
> > https://fedorahosted.org/koji/changeset?old_path=builder&old=3deb8358e67ff901f14 7900c2b230d5e0f3a8e0b&new_path=builder&new=06a885f e47f10742c0616799bcee727f93628a88
> >
> > You'll also want to move the broot.expire() later in the task too. There is
> > a race condition where the output is getting cleaned up before it is moved
> > to a final resting place. The patch I sited above fixes that too.
> >
> > This code hasn't seen too much exposure, so don't hesitate to ask questions
> > here or to me directly. I'm hanging out on Freenode IRC as jgreguske in
> > #koji or #fedora-devel as well.
> >
> > Thanks for checking in!
> >
> > - Jay
> >
> >
> > ----- "Doug Reiland" <dreiland@gmail.com> wrote:
> >> I got *a minimal livecd to build (not tested yet) but a to make some
> >> kojid changes. Are these really bugs or should be handled elsewhere?
> >>
> >> I had to include '/dev/shm' in bind_opts
> >> Also, livecd-creator (imgcreator python package) was calling
> >> os.random() and that wanted '/dev/urandom', so I had to a mknod for
> >> that where loop? nodes are created.
> >>
> >> Also, I had to include device-mapper in the livecd-build group.
> >>
> >> Doug
> >> --
> >> buildsys mailing list
> >> buildsys@lists.fedoraproject.org
> >> https://admin.fedoraproject.org/mailman/listinfo/buildsys
> >>
> > --
> > buildsys mailing list
> > buildsys@lists.fedoraproject.org
> > https://admin.fedoraproject.org/mailman/listinfo/buildsys
> >
> --
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 
Old 03-11-2010, 07:24 PM
Jay Greguske
 
Default koji spin-livecd issues

They certainly can because I'm doing that right now on my test system. Having topurl set is a requirement, but I see I neglected to put that in the wiki HowTo... I'll fix that now. I'm not sure why you're having difficulties with topdir though. Can you describe the error your were seeing and how you worked around it?

- Jay


----- "Doug Reiland" <dreiland@gmail.com> wrote:

> Sorry, one more thing.
> More of my initial errors was kojid needing topurl set in kojid.conf
> and it looks like kojid doesn't like topdir and topurl both set.
> Does this imply that no host can belong to both createrepo and livecd channel?
>
> Doug
>
>
> On Thu, Mar 11, 2010 at 10:38 AM, Jay Greguske <jgregusk@redhat.com> wrote:
> > They are bugs, and a patch was submitted upstream not long ago:
> >
> > https://fedorahosted.org/koji/changeset?old_path=builder&old=3deb8358e67ff901f14 7900c2b230d5e0f3a8e0b&new_path=builder&new=06a885f e47f10742c0616799bcee727f93628a88
> >
> > You'll also want to move the broot.expire() later in the task too. There is
> > a race condition where the output is getting cleaned up before it is moved
> > to a final resting place. The patch I sited above fixes that too.
> >
> > This code hasn't seen too much exposure, so don't hesitate to ask questions
> > here or to me directly. I'm hanging out on Freenode IRC as jgreguske in
> > #koji or #fedora-devel as well.
> >
> > Thanks for checking in!
> >
> > - Jay
> >
> >
> > ----- "Doug Reiland" <dreiland@gmail.com> wrote:
> >> I got *a minimal livecd to build (not tested yet) but a to make some
> >> kojid changes. Are these really bugs or should be handled elsewhere?
> >>
> >> I had to include '/dev/shm' in bind_opts
> >> Also, livecd-creator (imgcreator python package) was calling
> >> os.random() and that wanted '/dev/urandom', so I had to a mknod for
> >> that where loop? nodes are created.
> >>
> >> Also, I had to include device-mapper in the livecd-build group.
> >>
> >> Doug
> >> --
> >> buildsys mailing list
> >> buildsys@lists.fedoraproject.org
> >> https://admin.fedoraproject.org/mailman/listinfo/buildsys
> >>
> > --
> > buildsys mailing list
> > buildsys@lists.fedoraproject.org
> > https://admin.fedoraproject.org/mailman/listinfo/buildsys
> >
> --
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 
Old 03-11-2010, 07:43 PM
Mike Bonnet
 
Default koji spin-livecd issues

On 03/11/2010 03:15 PM, Doug Reiland wrote:
> Sorry, one more thing.
> More of my initial errors was kojid needing topurl set in kojid.conf
> and it looks like kojid doesn't like topdir and topurl both set.
> Does this imply that no host can belong to both createrepo and livecd channel?

Setting both topdir and topurl should be fine. topurl will be preferred
for most things, but topdir will be used for createrepo tasks. What
error are you seeing?

> Doug
>
>
> On Thu, Mar 11, 2010 at 10:38 AM, Jay Greguske <jgregusk@redhat.com> wrote:
>> They are bugs, and a patch was submitted upstream not long ago:
>>
>> https://fedorahosted.org/koji/changeset?old_path=builder&old=3deb8358e67ff901f14 7900c2b230d5e0f3a8e0b&new_path=builder&new=06a885f e47f10742c0616799bcee727f93628a88
>>
>> You'll also want to move the broot.expire() later in the task too. There is
>> a race condition where the output is getting cleaned up before it is moved
>> to a final resting place. The patch I sited above fixes that too.
>>
>> This code hasn't seen too much exposure, so don't hesitate to ask questions
>> here or to me directly. I'm hanging out on Freenode IRC as jgreguske in
>> #koji or #fedora-devel as well.
>>
>> Thanks for checking in!
>>
>> - Jay
>>
>>
>> ----- "Doug Reiland" <dreiland@gmail.com> wrote:
>>> I got a minimal livecd to build (not tested yet) but a to make some
>>> kojid changes. Are these really bugs or should be handled elsewhere?
>>>
>>> I had to include '/dev/shm' in bind_opts
>>> Also, livecd-creator (imgcreator python package) was calling
>>> os.random() and that wanted '/dev/urandom', so I had to a mknod for
>>> that where loop? nodes are created.
>>>
>>> Also, I had to include device-mapper in the livecd-build group.
>>>
>>> Doug
>>> --
>>> buildsys mailing list
>>> buildsys@lists.fedoraproject.org
>>> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>>>
>> --
>> buildsys mailing list
>> buildsys@lists.fedoraproject.org
>> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>>
> --
> buildsys mailing list
> buildsys@lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/buildsys

--
buildsys mailing list
buildsys@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/buildsys
 

Thread Tools




All times are GMT. The time now is 06:54 AM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright 2007 - 2008, www.linux-archive.org