NR1 and Alerts Irregularities for US and EU Regions
Resolved
Between 22:40 and 00:30 UTC, customers experienced a loss of connectivity to New Relic endpoints, loss of data consumption resulting in gaps in charts/graphs, and missed alert notifications. Notifications were impacted for customers between 23:04 and 01:10 UTC.
We’ve resolved the issue with all products in the US and EU regions. Services have returned to their normal operation.
Posted Sep 30, 2021 - 01:12 UTC
Update
We’ve resolved the issue with all products in the EU region. Services have returned to their normal operation.
The US region is continuing to recover. Most services have returned to their normal operation, but alerts are still affected as the backlogged data is consumed. We are continuing to work on the issue.
Posted Sep 30, 2021 - 00:40 UTC
Monitoring
We are beginning to see recovery of the issue affecting all products and alert notifications in the US and EU region. Services are starting to return to their normal operation.
Posted Sep 30, 2021 - 00:04 UTC
Update
We have identified a widespread issue related to data collection for all products and alerts in the US and EU regions. Notifications are impacted for all customers. We’re working to resolve it.
Posted Sep 29, 2021 - 23:28 UTC
Investigating
Some customers are experiencing Errors when submitting data, Gaps in Charts and Graphs in NR1, and Alerts irregularities in the US and EU regions. We will update this page as we resolve the issue.
Posted Sep 29, 2021 - 23:14 UTC
This incident affected: Alert Notifications : US (APM : US, Browser : US, Infrastructure : US, Logs : US, Mobile : US, NRQL : US, Serverless : US, Synthetics : US), Alert Notifications : Europe (APM : Europe, Browser : Europe, Infrastructure : Europe, Logs : Europe, Mobile : Europe, NRQL : Europe, Serverless : Europe, Synthetics : Europe), Data Ingest : Europe (APM Agent : Europe, Browser Agent : Europe, Event API : Europe, Infrastructure Agent : Europe, Log API : Europe, Metric API : Europe, Mobile Agent : Europe, OTLP API : Europe, Trace API : Europe), UI : Europe (Alerts : Europe, APM : Europe, Auto-Telemetry with Pixie : Europe, AWS Lambda Integration : Europe, Browser : Europe, Dashboards : Europe, Incident Intelligence : Europe, Infrastructure : Europe, Logs : Europe, Lookout : Europe, Mobile : Europe, Open Instrumentation : Europe, Proactive Detection : Europe, Serverless : Europe, Synthetics : Europe), Data Ingest : US (Event API : US, Log API : US, Metric API : US, OTLP API : US, Trace API : US), and UI : US (Incident Intelligence : US, Proactive Detection : US).
