Linux Archive

Linux Archive (http://www.linux-archive.org/)
-   CentOS (http://www.linux-archive.org/centos/)
-   -   How to size an email server to handle 5 million emails per day (http://www.linux-archive.org/centos/27825-how-size-email-server-handle-5-million-emails-per-day.html)

"Jean-Yves Avenard" 01-03-2008 03:27 PM

How to size an email server to handle 5 million emails per day
 
Hi

> > about 5 million emails a day.

5 million emails a day? What are they doing? send spam?
_______________________________________________
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos

Joshua Gimer 01-03-2008 09:40 PM

How to size an email server to handle 5 million emails per day
 
I can only talk from experience; we are currently doing spam and anti-
virus checks in our inbound flow of around 600,000 messages per day.
To do this we have three inbound SMTP gateways running Sophos
Puremessage with Sendmail as the MTA.. These systems are quad proc
systems with 6 to 8 GB of ram. This is still not enough to handle the
inbound flow efficiently at our organization.


We are currently looking into Ironport, which should be able to handle
our entire inbound and outbound flow on one system. They say that they
have the ability to drop around 98% of traffic that is coming in using
reputation filtering, anti-spam checks and anti-virus checks. We have
been demoing the device for a couple of months and I am really happy
with it, it has been doing what was promised.


Josh G.

On Jan 3, 2008, at 9:21 AM, Ugo Bellavance wrote:


Erick Perez wrote:

I have no idea as to how to size an email server. I was approached by
a customer that wanted a single server with RAID 1 disks to handle
about 5 million emails a day.
In general terms, what parameters should I take into account to size
the hardware specs when the average email is about 10kb, the smalles
email is 2kb and the largest email is about 5meg (with attachment)
thanks,


I don't know if you have done it yet, but Fort System's new
offering, BarricadeMX, could help you cut spam.


http://www.fsl.com/barricademx.html

It is closed-source, but FSL gives a lot to open-source communities,
especially MailScanner's.


Ugo

_______________________________________________
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


_______________________________________________
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos

Bill Campbell 01-04-2008 06:15 AM

How to size an email server to handle 5 million emails per day
 
On Thu, Jan 03, 2008, Joshua Gimer wrote:
>I can only talk from experience; we are currently doing spam and anti-
>virus checks in our inbound flow of around 600,000 messages per day.
>To do this we have three inbound SMTP gateways running Sophos
>Puremessage with Sendmail as the MTA.. These systems are quad proc
>systems with 6 to 8 GB of ram. This is still not enough to handle the
>inbound flow efficiently at our organization.

We have a system that handles similar quantities of incoming mail with a
single incoming MX server running postfix, amavisd, and clamav to do anti-
virus checking only, passing clean messages to a cluster of five machines
which do spamassassin checking and delivery into Maildir folders NFS
mounted on a central machine using LDAP authentication on the cluster
machines.

The incoming MX server has an Intel(R) Pentium(R) 4 CPU 3.20GHz with 2GB
RAM running SLES9, and rarely has a load average above 1.00.

The cluster servers have similar processors with 1GB RAM, running SLES9 and
SLES10 (new ones will be CentOS :-).

The main file server that has all the home directories is rather ancient by
comparison, running SuSE 9.2 Pro on an Intel(R) Pentium(R) 4 CPU 3.00GHz
with 2GB RAM and lots of hard disk space.

>We are currently looking into Ironport, which should be able to handle
>our entire inbound and outbound flow on one system. They say that they
>have the ability to drop around 98% of traffic that is coming in using
>reputation filtering, anti-spam checks and anti-virus checks. We have
>been demoing the device for a couple of months and I am really happy
>with it, it has been doing what was promised.

The border server rejects several million attempts a day using a
combination of DNSRBLs, and other checks. It also has no users, accepting
mail for valid users with rather large postfix virtual tables that map all
incoming addresses to the internal servers.

I like this distributed architecture as all the machines in the cluster are
pretty much vanilla boxes that are easily built and replaced if necessary.
The only machine that's critical is the one containing all the user's home
directories. Even that one has been replaced with a new machine with
minimal down time by bringing up a replacement, syncing the users from the
old machine to the new one, doing a bit of DNS editing to point to the new
machine, then rsync'ing the user's Maildir folders as new mail is delivered
to the new machine. Each of the cluster machines needs to remount the home
directories with the new DNS. We were able to make the switch with less
than 15 minutes of down time while making the DNS changes and remounting
cluster machines. It took about an hour to complete the home rsyncs with
about 10,000 users.

Even considering the relatively puny public MX server, it would be able to
handle quite a bit more mail easily. The cluster machines scale close to
linearly. They're also running on a 10/100 switch, and going to a gigabit
switch should speed up mail delivery.

Bill
--
INTERNET: bill@celestial.com Bill Campbell; Celestial Software LLC
URL: http://www.celestial.com/ PO Box 820; 6641 E. Mercer Way
FAX: (206) 232-9186 Mercer Island, WA 98040-0820; (206) 236-1676

Government is actually the worst failure of civilized man. There has
never been a really good one, and even those that are most tolerable
are arbitrary, cruel, grasping and unintelligent. -- H. L. Mencken
_______________________________________________
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos

Christopher Chan 01-04-2008 07:24 AM

How to size an email server to handle 5 million emails per day
 
Bill Campbell wrote:

On Thu, Jan 03, 2008, Joshua Gimer wrote:
I can only talk from experience; we are currently doing spam and anti-
virus checks in our inbound flow of around 600,000 messages per day.
To do this we have three inbound SMTP gateways running Sophos
Puremessage with Sendmail as the MTA.. These systems are quad proc
systems with 6 to 8 GB of ram. This is still not enough to handle the
inbound flow efficiently at our organization.


We have a system that handles similar quantities of incoming mail with a
single incoming MX server running postfix, amavisd, and clamav to do anti-
virus checking only, passing clean messages to a cluster of five machines
which do spamassassin checking and delivery into Maildir folders NFS
mounted on a central machine using LDAP authentication on the cluster
machines.


I wonder if you have tried postfix + clamav via clamav-milter in any
testing for potential system upgrades?



_______________________________________________
CentOS mailing list
CentOS@centos.org
http://lists.centos.org/mailman/listinfo/centos


All times are GMT. The time now is 09:31 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.