Data and Alert Delays in the US Region

Incident Report for New Relic

Resolved

Between 19:17 UTC and 20:37 UTC on January 8th, some customers in the US region may have experienced delays for multiple data types in queries, charts, and dashboards as well as delayed or missing alert notifications for related data.

To prevent our customers from receiving a high volume of false positive alert notifications, notifications for affected data were temporarily suppressed during this time.
Posted Jan 08, 2024 - 20:38 UTC

Monitoring

Data and alert processing has largely recovered for customers in the US region. Some customers may still be experiencing delays for infrastructure metric data only at this time, as well as delayed or missing alert notifications for this data.
Posted Jan 08, 2024 - 20:32 UTC

Update

We are continuing to investigate issues contributing to data and alerts delays. Some customers in the US region may be experiencing delayed data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.
Posted Jan 08, 2024 - 20:09 UTC

Update

Some customers in the US region may be experiencing delayed data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data.
Posted Jan 08, 2024 - 19:38 UTC

Investigating

We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.
Posted Jan 08, 2024 - 19:35 UTC
This incident affected: Alert Notifications : US (APM : US, Browser : US, Infrastructure : US, Logs : US, Mobile : US, NRQL : US, Serverless : US, Synthetics : US) and Data Ingest : US (APM Agent : US, Browser Agent : US, Event API : US, Incident Intelligence API : US, Infrastructure Agent : US, Log API : US, Metric API : US, Mobile Agent : US, OTLP API : US, Trace API : US, Synthetics : US).