Update on Outages
As you know, we had a brief outage this past Saturday, and then a shorter occurrence of the same problem on Monday afternoon. For the issue on Monday, we could not update this status blog because Tumblr was experiencing issues as well. Between the two days, we had approximately 45 minutes of downtime, and we apologize for that.
We do our best to keep Wufoo running as smoothly as possible, so whenever an issue arises we try to find the core problem. It turns out that our recent PHP upgrade, which was required for security compliance, was the beginning of the problems. There was an incompatibility between our deployment system and our patch that caused silent memory issues. Primarily, a memory leak in Apache was triggered. Each time we deployed code to production, the problem escalated causing the web servers to eventually fail.
Now that we know the issues are tied to deployment, we will be able to avoid this particular type of outage in the future. Thanks for your understanding and patience.
