Dec 2, 12:37 PST
Resolved - We've caught up with all data processing.
Dec 2, 11:06 PST
Monitoring - Additional resources have been provisioned and we're now catching up on the backlog.
Dec 2, 09:41 PST
Identified - The issue has been identified and a fix is being implemented.
Dec 2, 09:41 PST
Investigating - A subset of our applications are experiencing a small delay in data processing. We will be provisioning additional resources shortly.
Dec 5, 18:47 PST
Resolved - We caught up with processing a number of hours ago, and the primary issue is resolved. We are continuing to work on some further improvements to avoid this problem in the future.
Dec 5, 09:44 PST
Update - While it took longer than originally anticipated, we are well on our way to catching up with the backlog.
Dec 4, 21:27 PST
Monitoring - We're catching up on data processing. We're continuing to monitor the situation to see if we need to take additional steps.
Dec 4, 18:43 PST
Investigating - We are experiencing data processing delays for a small subset of our customers.
Jan 13, 13:05 PST
Resolved - We've caught up but are continuing to investigate underlying causes to avoid future issues.
Jan 13, 12:34 PST
Monitoring - We've nearly caught up on processing. We're continuing to monitor the situation.
Jan 13, 11:12 PST
Investigating - We are experiencing a delay processing data for a subset of our customers. We are working to identify the cause and provision additional resources as necessary.
Jan 15, 15:42 PST
Resolved - We've caught up with processing. We're continuing further investigation to avoid ongoing recurrence of this issue.
Jan 15, 10:08 PST
Investigating - We are experiencing a delay in data processing for a subset of applications. We've rolled out improved logging to better identify the cause.
Feb 22, 19:55 PST
Resolved - We caught up with processing a few hours ago.
Feb 22, 13:21 PST
Monitoring - We're catching up on the processing backlog. We expect the issue to resolve over the new few hours.
Feb 22, 12:02 PST
Identified - We've resolved the issue and we're processing data again.
Feb 22, 11:52 PST
Investigating - We're experiencing a data processing delay for a subset of customers.
May 15, 10:20 PDT
Resolved - This incident has been resolved.
May 15, 02:08 PDT
Monitoring - We have resumed processing data on all workers.
May 15, 01:51 PDT
Identified - The network issue has been resolved. We have determined that the data sent during the outage period is not recoverable, and have proceeded to unblock processing new data instead.
May 15, 00:16 PDT
Investigating - We are experiencing a major network outage on AWS affecting most of our EC2 instances. Due to the scale of this outage, we are expecting connectivity issues from agent and potential loss of report data submitted during this time.
Jul 1, 12:19 PDT
Resolved - We have resolved the issue and are processing data again.
Jul 1, 12:02 PDT
Update - We have identified and correct the root cause of the issue. Unfortunately at this time we do not believe we will be able to process data that was reported during the outage.
Jul 1, 10:50 PDT
Investigating - We are currently investigating a delay in data processing.
Sep 11, 12:48 PDT
Resolved - This incident has been resolved.
Sep 10, 17:00 PDT
Update - We are back to processing data at a satisfactory rate. The majority of our customers will see their data in Skylight with less than 10 minutes of processing delay. We expect the delay to reduce further and will continue to monitor the situation and deploy additional capacity as needed.
Sep 10, 16:57 PDT
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 10, 11:36 PDT
Investigating - We are currently investigating this issue.
Jan 4, 17:15 PST
Resolved - We've caught up with processing.
Jan 4, 09:46 PST
Monitoring - Data is processing again. We will continue to keep an eye on the situation.
Jan 4, 09:01 PST
Identified - We believe we have identified the underlying cause and have put a temporary fix in place to resume processing data.
Jan 4, 06:22 PST
Investigating - We are currently investigating a delay in processing data for some customers. No data loss is anticipated.
Mar 4, 16:40 PST
Completed - The scheduled maintenance has been completed.
Mar 4, 16:25 PST
Verifying - We've completed the upgrade.
Mar 4, 16:02 PST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 4, 15:48 PST
Scheduled - We'll have a brief downtime to upgrade to the latest database version.