Linux Archive

Linux Archive (http://www.linux-archive.org/)
-   Fedora Infrastructure (http://www.linux-archive.org/fedora-infrastructure/)
-   -   bastion03 outage this afternoon (http://www.linux-archive.org/fedora-infrastructure/575318-bastion03-outage-afternoon.html)

Kevin Fenzi 09-13-2011 11:32 PM

bastion03 outage this afternoon
 
We had an outage of bastion03 this afternoon.

Because it's the vpn hub, lots of services were affected.

It looks like it's running into
https://bugzilla.redhat.com/show_bug.cgi?id=725332

So, if this re-occurs, we should either:

a) switch it to use e1000 instead of virtio network devices.

or

b) switch back to bastion02 (which is still there and rhel5).

So, keep an eye out for outages of services where you see a lot of ping
loss or not answer at all from bastion.fedoraproject.org.

For the record, the outage started at 22:45 and ran until 22:55 or so.

kevin
_______________________________________________
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Tristan Santore 09-14-2011 05:01 AM

bastion03 outage this afternoon
 
On 14/09/11 00:32, Kevin Fenzi wrote:
> We had an outage of bastion03 this afternoon.
>
> Because it's the vpn hub, lots of services were affected.
>
> It looks like it's running into
> https://bugzilla.redhat.com/show_bug.cgi?id=725332
>
> So, if this re-occurs, we should either:
>
> a) switch it to use e1000 instead of virtio network devices.
>
> or
>
> b) switch back to bastion02 (which is still there and rhel5).
>
> So, keep an eye out for outages of services where you see a lot of ping
> loss or not answer at all from bastion.fedoraproject.org.
>
> For the record, the outage started at 22:45 and ran until 22:55 or so.
>
> kevin
>
>
>
> _______________________________________________
> infrastructure mailing list
> infrastructure@lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/infrastructure
How about creating a failover VPN, which is doable in OpenVPN.

Regards,

Tristan

--
Tristan Santore BSc MBCS
TS4523-RIPE
Network and Infrastructure Operations
InterNexusConnect
Mobile +44-78-55069812
Tristan.Santore@internexusconnect.net

Former Thawte Notary
(Please note: Thawte has closed its WoT programme down,
and I am therefore no longer able to accredit trust)

For Fedora related issues, please email me at:
TSantore@fedoraproject.org
_______________________________________________
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

seth vidal 09-14-2011 02:18 PM

bastion03 outage this afternoon
 
On Wed, 2011-09-14 at 06:01 +0100, Tristan Santore wrote:


> How about creating a failover VPN, which is doable in OpenVPN.
>

After being woken up this morning by pages I'm looking into just that.

I'm trying to figure out why we've been doing cold-failover all this
time when it seems to handle hot failover just fine.

-sv




_______________________________________________
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Kevin Fenzi 09-14-2011 03:13 PM

bastion03 outage this afternoon
 
On Wed, 14 Sep 2011 10:18:28 -0400
seth vidal <skvidal@fedoraproject.org> wrote:

> On Wed, 2011-09-14 at 06:01 +0100, Tristan Santore wrote:
>
>
> > How about creating a failover VPN, which is doable in OpenVPN.
> >
>
> After being woken up this morning by pages I'm looking into just
> that.
>
> I'm trying to figure out why we've been doing cold-failover all this
> time when it seems to handle hot failover just fine.

It may be possible, but currently only the active node runs the openvpn
server. This is to avoid the case of some machines on one and some on
the other both using the same network. ;(

I think we can improve the setup here, but it's not as simple as
running the server on the secondary node. ;(

kevin

_______________________________________________
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure


All times are GMT. The time now is 08:44 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.