Inbound Email Processing Delay

tim

Posted by tim at October 20th, 2011

Due to our recent downtime issues, we have added more types of realtime and statistical monitoring to the Tender system so that we can get better forewarning of potential problems before they become critical. As a part of this, we started reviewing the statistical speed of incoming emails (specifically the standard deviation and mean round trip times in heartbeat emails). From this new monitoring, we found saw some discrepancies start to pop up in our inbound email processing -- specifically we were finding today that some heartbeat emails simply didn't make it all the way back to Tender. We contacted our mail provider, and discovered quite a few emails that they had not forwarded. They've sent those emails now, and we're processing and routing those emails into Tender, so you may see some emails come in that are several hours old. In order to have even better monitoring of the roundtrip email times, we are increasing the rate of heartbeat emails to be hourly rather than every 6 to 12 hours as they are currently configured. If you do not have heartbeat emails enabled for your Tender site, please do so in your dashboard. It will help us find potential problems and delays even faster when we have a larger data set for our statistics.

Make your voice heard

We value freedom of speech, but please don't be an asshat. You can use Textile in your comments. Surround code in a <macro:jscode lang="LANG"> block.