Marketing Matrix: Drive Failures Affecting Some Customers' Rankings and Reports

Sunday, May 6, 2012

Drive Failures Affecting Some Customers' Rankings and Reports

Late Sunday night through Monday, the harddrives responsible for most of our rankings system failed. These failures have resulted in slower rankings collection, but has not resulted in lost data.

Update for 5/6/2012-
The past week is all collected, and we began Sunday's collection only 8 hours late- we will be on track before midnight tonight!
April monthly reports are re-generated, as are this weeks reports for Monday,Tuesday,Wednesday and Thursday. Friday and Saturday are now being generated now and we are on-track to be back to normal by Sunday night.

We will update this post again tomorrow.

What does this mean for customers?

The main features that have been affected are Web App Rankings and Reports. In the Web App, rankings may not update on the same day that they’ve historically updated. You’ll know when your rankings were last updated by going to the “Rankings” tab and looking underneath the “Keyword Rankings” subtitle.

Keyword rankings

If you’ve set up a customized report, you might not have received your report as soon as you expected to receive it. If you did receive a report and it included a rankings section, one or more of the subsections might have been blank:

blank reports

These features were intermittently failing because the data was on the affected drives, but as of right now, these should now be functioning, albeit possibly more slowly than normal:

Campaign ranking history
Campaign ranking history CSV exports
The Keyword Analysis Tool
Custom Reports that include rankings data

For more technical details, please see this post on the dev blog.

When will it be fixed?

We are currently prioritizing the collection of keywords in the order they would normally be collected, which means all rankings collection will be delayed for customers this week. We expect this catch-up process to complete by the end of the week, returning us to normal at that point. Our current expectation is that rankings will be delayed 2-3 days for all campaigns, until we can catch up this weekend.

We are still working to resolve this issue and will update this post every morning until the issue is resolved. We sincerely apologize if these failures affect your work as we know how much you depend on our tools. If you have any questions, please leave a comment below and we’ll try to respond quickly.

Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!