tag:status.newrelic.com,2005:/historyNew Relic Status - Incident History2024-03-29T03:55:07ZNew Relictag:status.newrelic.com,2005:Incident/201855442024-03-07T22:23:29Z2024-03-07T22:23:29ZAlerts UI Irregularities<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>22:23</var> UTC</small><br><strong>Resolved</strong> - Between 13:00 UTC on March 6th and 20:00 UTC on March 7th, some customers in the US region may have intermittently experienced out-of-date views for dashboards and UIs which rely on entity tags. Existing alert notifications were not impacted; however, some customers may have been unable to edit or view alert conditions related to entity tags.<br /><br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>18:13</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with entity tag processing. Updates will be provided upon significant change in status.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>17:06</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with entity tag processing. Some customers in the US region may experience out-of-date views for dashboards and UIs which rely on entity tags. Existing alert notifications are functioning as expected; however, some customers may be unable to edit or view alert conditions related to entity tags.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>16:06</var> UTC</small><br><strong>Update</strong> - We are investigating an issue with entity tag processing. Some customers in the US region may experience out-of-date views for dashboards and UIs which rely on entity tags. Existing alert notifications are functioning as expected; however, some customers may be unable to edit or view alert conditions related to entity tags.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>15:08</var> UTC</small><br><strong>Identified</strong> - Some customers in the US region may experience issues when using the using filters in the Alerts UI. Alerts notifications are not affected.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>14:51</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/200591892024-02-23T17:45:53Z2024-03-06T21:31:13ZNRQL Query Errors in US Region<p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>17:45</var> UTC</small><br><strong>Resolved</strong> - Between 16:15 UTC and 17:25 UTC on February 23rd, some customers in the US region may have experienced errors when running NRQL queries or when accessing reports or parts of the New Relic UI.<br /><br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>17:31</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/199877722024-02-14T23:48:32Z2024-03-06T21:30:31ZFalse alarm<p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>23:48</var> UTC</small><br><strong>Resolved</strong> - After investigation, our teams have determined that there has not been a service interruption and services should be operating normally. We strive to balance customer notification speed and investigation into events.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>23:41</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/199856352024-02-14T18:50:10Z2024-02-14T18:50:10ZNew Relic UI Delays and Irregularities in the EU and US Regions<p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>18:50</var> UTC</small><br><strong>Resolved</strong> - Between 16:47 UTC and 17:57 UTC on February 14, some customers in the US and EU regions may have experienced New Relic UI Delays and Irregularities <br /> <br />We have investigated and resolved this service interruption and impacted services have returned to normal operations.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>18:18</var> UTC</small><br><strong>Update</strong> - We are investigating an issue that may impact New Relic UI for customer accounts in the US and EU regions.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>18:07</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/199762452024-02-13T18:20:48Z2024-02-13T18:20:48ZAlert Delays in US Region<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>18:20</var> UTC</small><br><strong>Resolved</strong> - Between 15:30 UTC and 17:52 UTC on February 13th, some customers in the US region may have experienced delayed or false alert notifications for all data types.<br /> <br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>17:58</var> UTC</small><br><strong>Monitoring</strong> - We are seeing some recovery for impacted services and are monitoring for stability. Some customers in the US region may see improved alert notification performance at this time.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>17:23</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate alert processing latency contributing to some customers in the US region experiencing delayed or false alert notifications for all data types.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:51</var> UTC</small><br><strong>Update</strong> - We are investigating alert processing latency contributing to some US customers experiencing delayed or false alert notifications for all data types.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:20</var> UTC</small><br><strong>Update</strong> - Some customers in the US region may experience delayed alert notifications for all data types.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>16:17</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/199726532024-02-13T07:44:19Z2024-03-06T22:06:12ZNew Relic UI Irregularities in US Region<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>07:44</var> UTC</small><br><strong>Resolved</strong> - Between 06:07 UTC and 06:35 UTC on February 13th, some customers in the US region may have experienced the New Relic One UI returning errors or not loading as expected.<br /><br />We have investigated and resolved this service interruption and impacted services have returned to normal operations.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>06:58</var> UTC</small><br><strong>Monitoring</strong> - We are seeing recovery of impacted services and monitoring for stability of the environment.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>06:46</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>06:37</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>06:33</var> UTC</small><br><strong>Investigating</strong> - Some customers in the US region may be experiencing the New Relic One UI returning errors or not loading as expected.</p>tag:status.newrelic.com,2005:Incident/198691152024-02-10T06:05:56Z2024-02-10T06:05:56ZScheduled Maintenance for Support Center - February 10th from 06:00 UTC<p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>06:05</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>06:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>18:25</var> UTC</small><br><strong>Scheduled</strong> - Our Support Center at support.newrelic.com is undergoing maintenance February 9th from 10:00PM PST - 10:05PM PST New Relic documentation can be accessed at docs.newrelic.com. For updates visit status.newrelic.com.</p>tag:status.newrelic.com,2005:Incident/198681582024-01-30T17:15:09Z2024-01-30T17:15:09ZLogin and UI Irregularities in US Region<p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>17:15</var> UTC</small><br><strong>Resolved</strong> - Between 15:55 UTC and 16:22 UTC on January 30th, some customers in the US region may have experienced errors during login and intermittent permissions or account-related errors when navigating the UI. <br /><br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>16:41</var> UTC</small><br><strong>Identified</strong> - We are continuing to investigate issues contributing to login and UI errors. Some customers in the US region may experience errors when attempting to login and intermittent permissions or account-related errors when navigating the UI. <br /><br />We are seeing recovery for affected services at this time and will continue to provide updates as they become available.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>16:24</var> UTC</small><br><strong>Update</strong> - We are investigating issues contributing to login and UI errors. Some customers in the US region may experience errors when attempting to login as well as intermittent errors when navigating the UI.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>16:17</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/198178542024-01-24T14:42:46Z2024-01-24T14:42:46ZEntity Data Delayed for US/EU Region<p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>14:42</var> UTC</small><br><strong>Resolved</strong> - Between 11:50 UTC - 13:24 UTC on January 24th, some customers in the US and EU regions may have experienced a delay in the display of data for new Entities reporting data to New Relic for the first time.<br />We have investigated and resolved this service interruption and impacted services have returned to normal operations.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>14:24</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>14:23</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor the recovery.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>14:05</var> UTC</small><br><strong>Monitoring</strong> - We are continuing to monitor the recovery.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>13:39</var> UTC</small><br><strong>Identified</strong> - We have identified the issue and working to resolve</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>13:36</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/197814982024-01-21T08:00:10Z2024-01-21T08:00:10ZAzure Integrations Data and Alerts Missing or Delayed in US and EU Regions<p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>08:00</var> UTC</small><br><strong>Resolved</strong> - Between 01:00 UTC and 08:00 UTC on January 21st, some customers in the US and EU regions may have experienced missing or delayed infra-metrics for Azure integrations as well as delayed or missing alert notifications for related data. <br /><br />To prevent our customers from receiving a high volume of false positive alert notifications, notifications for affected data were temporarily suppressed during this time.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>07:20</var> UTC</small><br><strong>Update</strong> - Azure integration data and alerts have recovered for the EU region. The US region is recovering.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>06:56</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor the recovery. Alert notifications for infra-metrics are still impacted.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>06:18</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor the recovery. Alert notifications for infra-metrics are still impacted.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>05:44</var> UTC</small><br><strong>Monitoring</strong> - Azure integrations are recovering, alert notifications still impacted.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>05:34</var> UTC</small><br><strong>Update</strong> - Some customers in the US and EU regions may experience delayed alert notifications and missing or delayed infra-metrics from Azure integrations.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>05:29</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/196802742024-01-11T07:30:00Z2024-01-11T18:07:07ZAlerts Irregularities in the EU Region<p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>07:30</var> UTC</small><br><strong>Resolved</strong> - Between 08:23 UTC and 13:44 UTC on January 11th, some customers in the EU region may have experienced delayed, false-positive, or missing alert notifications for all alertable data types. We have investigated and resolved this interruption and the above services have returned to normal operation.</p>tag:status.newrelic.com,2005:Incident/196495422024-01-08T20:38:29Z2024-01-08T20:40:05ZData and Alert Delays in the US Region<p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>20:38</var> UTC</small><br><strong>Resolved</strong> - Between 19:17 UTC and 20:37 UTC on January 8th, some customers in the US region may have experienced delays for multiple data types in queries, charts, and dashboards as well as delayed or missing alert notifications for related data. <br /><br />To prevent our customers from receiving a high volume of false positive alert notifications, notifications for affected data were temporarily suppressed during this time.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>20:32</var> UTC</small><br><strong>Monitoring</strong> - Data and alert processing has largely recovered for customers in the US region. Some customers may still be experiencing delays for infrastructure metric data only at this time, as well as delayed or missing alert notifications for this data.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>20:09</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate issues contributing to data and alerts delays. Some customers in the US region may be experiencing delayed data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>19:38</var> UTC</small><br><strong>Update</strong> - Some customers in the US region may be experiencing delayed data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>19:35</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/193356402023-12-05T22:48:28Z2023-12-05T22:48:28ZData Irregularities in the EU Region<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>22:48</var> UTC</small><br><strong>Resolved</strong> - Between 15:23 UTC and 22:07 UTC on December 5th, some customers in the EU region may have experienced errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data. To prevent our customers from receiving a high volume of false positive alert notifications, we temporarily suppressed notifications for affected data intermittently during this timeframe. <br /><br />We have investigated and resolved this service interruption and impacted services have returned to normal operations.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>22:08</var> UTC</small><br><strong>Monitoring</strong> - Our teams are continuing to investigate issues with data ingest for multiple data types. Some customers in the EU region may experience intermittent errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data. <br /><br />We are seeing recovery of affected services at this time and have disabled alert notification suppression as a result. We're monitoring as services recover and will provide an additional update once we've fully validated that all affected services have returned to normal operation.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>21:28</var> UTC</small><br><strong>Update</strong> - Our teams are continuing to investigate issues with data ingest for multiple data types. Some customers in the EU region may experience intermittent errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.<br /><br />Updates for this interruption are suspended for one hour pending significant change in status as our teams continue their investigation.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>20:28</var> UTC</small><br><strong>Update</strong> - Customers may continue to see improvement of impacted services as we work to investigate issues impacting ingested infrastructure data in the EU region. To prevent our customers from receiving a high volume of false positive alert notifications, notifications for impacted data will remain temporarily suppressed. Updates for this interruption are suspended for one hour pending significant change in status as our teams continue their investigation.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>19:15</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with data ingest for infrastructure data. Updates for this interruption are suspended for one hour pending significant change in status as our teams continue their investigation. <br /><br />Some customers in the EU region may continue to experience errors when sending infrastructure data to New Relic, issues viewing real time infrastructure data, and delayed or missing alert notifications related to real time infrastructure data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>18:42</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with data ingest for infrastructure data. Some customers in the EU region may experience errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time infrastructure data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.<br /><br />Customers may continue to see improvement as we work to recover impacted services.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>18:00</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with data ingest for infrastructure data. Some customers in the EU region may experience errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time infrastructure data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>17:28</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with data ingest for multiple data types. Some customers in the EU region may experience errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.<br /><br />Infrastructure and metric data remain impacted, but customers may now see recovery for all other ingested data types.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>17:10</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with data ingest for multiple data types. Some customers in the EU region may experience errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.<br /><br />Some customers may begin seeing the recovery of impacted services as we continue working to resolve this interruption.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>16:40</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue with data ingest for multiple data types. Some customers in the EU region may experience errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>16:09</var> UTC</small><br><strong>Update</strong> - We are investigating an issue with data ingest for multiple data types. Some customers in the EU region may experience errors when sending data to New Relic, issues viewing real time data, and delayed or missing alert notifications related to real time data.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>16:03</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/191843832023-12-03T06:00:01Z2023-12-03T06:00:01ZScheduled Maintenance for Support Center - December 3rd from 03:00 - 06:00 UTC<p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>06:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>00:19</var> UTC</small><br><strong>Scheduled</strong> - Our Support Center at support.newrelic.com is undergoing maintenance December 3rd from 03:00 - 06:00 UTC (Dec 2 7:00PM PST - 10:00PM PST). New Relic documentation can be accessed at docs.newrelic.com. For updates visit status.newrelic.com.</p>tag:status.newrelic.com,2005:Incident/189920502023-11-12T06:36:47Z2023-11-12T06:36:47ZScheduled Maintenance for the US/EU Regions - November 12th from 06:00 UTC to 06:30 UTC<p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>06:36</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>06:31</var> UTC</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>06:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>18:13</var> UTC</small><br><strong>Scheduled</strong> - We intend to perform maintenance for New Relic sign-up services on Sunday, November 12th from 06:00 UTC to 06:30 UTC (or Saturday, November 11th from 22:00 PST to 22:30 PST). During this maintenance, customers in the US and EU regions may experience issues creating new organizations, authentication domains, users, and grants. <br /><br />All further updates will be posted here on our status page.</p>tag:status.newrelic.com,2005:Incident/190600002023-11-08T17:03:07Z2023-11-08T17:03:07ZData Ingest Irregularities in EU and US Regions<p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>17:03</var> UTC</small><br><strong>Resolved</strong> - Between 16:05 UTC and 16:47 UTC on November 8th, some customers in the EU region as well as a small percentage of US customers may have experienced errors when sending data to New Relic, issues in viewing data in real time, and delayed or missing alert notifications related to real time data. <br /><br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>16:52</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue affecting data ingest for all data types. Some customers in the EU region as well as a small percentage of US customers may experience errors when sending data to New Relic, issues in viewing data in real time, and delayed or missing alert notifications related to real time data.</p>tag:status.newrelic.com,2005:Incident/190532442023-11-08T05:13:01Z2023-11-08T05:13:01ZData Irregularities in the EU Region<p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>05:13</var> UTC</small><br><strong>Resolved</strong> - Between 04:15 UTC and 04:20 UTC on November 8, some customers in the EU region may have experienced errors when sending data to New Relic, issues in viewing data in real time, and delayed or missing alert notifications related to real time data.<br /><br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>05:08</var> UTC</small><br><strong>Identified</strong> - Some customers in the EU region may experience errors when sending data to New Relic, issues in viewing data in real time, and delayed or missing alert notifications related to real time data.</p>tag:status.newrelic.com,2005:Incident/190388382023-11-06T19:00:00Z2023-11-06T21:05:35ZAlerts Delays in US Region<p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Resolved</strong> - Between 20:05 UTC and 21:02 UTC on November 6th, some customers in the US region may have experienced delayed or missing alert notifications related for all data types. <br /><br />We have investigated and resolved this service interruption and impacted services have returned to normal operations.</p>tag:status.newrelic.com,2005:Incident/188443872023-10-18T20:23:13Z2023-10-18T20:23:13ZBrowser Data and Alert Irregularities in the US Region<p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>20:23</var> UTC</small><br><strong>Resolved</strong> - Between 18:04 UTC and 18:20 UTC and again from 19:04 UTC to 19:36 UTC on October 18th, some customers in the US regions may have experienced delayed browser data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data. To prevent our customers from receiving a high volume of false positive alert notifications, notifications for affected data were temporarily suppressed between 19:49 UTC and 20:01 UTC. <br /> <br />We have investigated and resolved this interruption and the above services have returned to normal operation.</p><p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>19:49</var> UTC</small><br><strong>Investigating</strong> - Some customers in the US region may be experiencing delayed browser data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data. To prevent our customers from receiving a high volume of false positive alert notifications, we have temporarily suppressed notifications for affected data.</p>tag:status.newrelic.com,2005:Incident/187096562023-10-14T05:05:08Z2023-10-14T05:05:08ZScheduled Maintenance for the Support Center - October 14th from 05:00 - 05:05 UTC<p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>05:05</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>05:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>15:13</var> UTC</small><br><strong>Scheduled</strong> - Our Support Center at support.newrelic.com is undergoing maintenance October 14th from 05:00 - 05:05 UTC (October 13th from 10:00PM PDT - 10:05PM PDT). New Relic documentation can be accessed at docs.newrelic.com. For updates visit status.newrelic.com.</p>tag:status.newrelic.com,2005:Incident/187491242023-10-11T01:16:43Z2023-10-11T01:16:43ZData and Alert Irregularities in the US Region<p><small>Oct <var data-var='date'>11</var>, <var data-var='time'>01:16</var> UTC</small><br><strong>Resolved</strong> - Between 22:00 UTC October 10 and 00:55 October 11 UTC, some customers experienced irregularities in query results and dashboards. Notifications were impacted for some customers between 00:05 UTC and 00:55 October 11 UTC.<br />We’ve resolved the issue in the US region. Services have returned to their normal operation.</p><p><small>Oct <var data-var='date'>11</var>, <var data-var='time'>00:53</var> UTC</small><br><strong>Investigating</strong> - Some customers in the US region may be experiencing delayed data in queries, charts, and dashboards as well as delayed or missing alert notifications for related data.<br /><br />We have identified an issue with Alerts in the US region that may cause false-positive alert notifications. To reduce noise, alert notifications are being temporarily suppressed for applicable customers. We are working to resolve the underlying issue and will re-enable alert notifications upon resolution.</p>tag:status.newrelic.com,2005:Incident/185393342023-09-24T06:00:59Z2023-09-24T06:00:59ZScheduled Maintenance for the US and EU Region - Synthetics - September 24th<p><small>Sep <var data-var='date'>24</var>, <var data-var='time'>06:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>24</var>, <var data-var='time'>05:51</var> UTC</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Sep <var data-var='date'>24</var>, <var data-var='time'>05:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>21:26</var> UTC</small><br><strong>Scheduled</strong> - We intend to perform maintenance on Sunday, September 24th from 05:00 UTC to 06:00 UTC (or Saturday, September 23rd from 22:00 PDT to 23:00 PDT). Customers in the US and EU regions may experience delayed or missing synthetics checks during this maintenance. Please note, we do not anticipate impact to alert notifications except those that rely on synthetics checks during the outlined window.</p>tag:status.newrelic.com,2005:Incident/185599932023-09-20T22:40:52Z2023-09-20T22:40:52ZDelays for Data Processing in US Region<p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>22:40</var> UTC</small><br><strong>Resolved</strong> - Between 21:08 UTC to 22:12 UTC on September 20th, some customers in the US region may have experienced delays for data and for related alert notifications. <br /><br />The service interruption has been resolved and impacted services have returned to normal operations.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>21:48</var> UTC</small><br><strong>Update</strong> - We are investigating delays for data processing related to multiple data types. Some customers in the US region may be experiencing delays for data and for related alert notifications.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>21:40</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/184720772023-09-11T22:29:25Z2023-09-11T22:29:25ZAlert Irregularities in US and EU Regions<p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>22:29</var> UTC</small><br><strong>Resolved</strong> - Between 17:48 UTC and 22:27 UTC on Monday, September 11, 2023, some customers in the US and EU region may have experienced missing alert notifications and errors accessing the Alerts UI. We have investigated and resolved a service interruption and impacted services have returned to normal operations.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>22:18</var> UTC</small><br><strong>Monitoring</strong> - Alert notifications and errors in the UI are recovering. We will notify once all services have completely returned to normal operation.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>22:01</var> UTC</small><br><strong>Update</strong> - New Relic is continuing to work to restore services to normal operation.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>21:31</var> UTC</small><br><strong>Update</strong> - New Relic is continuing to work to restore services to normal operation.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>21:03</var> UTC</small><br><strong>Update</strong> - New Relic is continuing to work to restore services to normal operation.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>20:29</var> UTC</small><br><strong>Update</strong> - New Relic has concluded the investigation with our cloud provider and are now working and investigating on how to return our services back to normal operation.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>19:36</var> UTC</small><br><strong>Update</strong> - New Relic teams are continuing to investigate the issue with our cloud provider.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>19:07</var> UTC</small><br><strong>Identified</strong> - New Relic teams are continuing to investigate this issue with our cloud provider. We have identified the root cause and are working to resolve the issue. <br /><br />Customers in the US and EU region may be experiencing issues accessing various portions of the New Relic UI and missing alert notifications. Data ingest does not appear to be impacted at this time</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>18:48</var> UTC</small><br><strong>Update</strong> - We are investigating an issue impacting alerting. Some customers in the US and EU regions may experience missing alert notifications for all data sources. Additionally customers may experience errors accessing the Alerts UI.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>18:32</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>18:30</var> UTC</small><br><strong>Investigating</strong> - We are investigating a potential service interruption that may impact some customers. Please continue to monitor this page for updates.</p>tag:status.newrelic.com,2005:Incident/184027102023-09-06T06:37:13Z2023-09-06T06:37:13ZData Ingest and Alert Delays in US Region<p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>06:37</var> UTC</small><br><strong>Resolved</strong> - Between 02:03 UTC and 05:45 UTC on Wednesday, September 6, 2023, some customers in the US region may have experienced an impact to data collection and delayed or missing alert notifications. To prevent our customers from receiving a high volume of false-positive alert notifications during this interruption, alerts were temporarily suppressed for applicable customers between 02:20 UTC and 04:52 UTC.<br /><br />We have investigated and resolved a service interruption with our Cloud Service Provider and impacted services have returned to normal operations.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>05:57</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>04:56</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results. Some customers in the US region have reported recovery from the impact to data collection and delayed or missing alert notifications.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>04:20</var> UTC</small><br><strong>Update</strong> - We have engaged our Cloud provider to assist with further investigation and are evaluating additional mitigation efforts. Some customers in the US region may experience impact to data collection and delayed or missing alert notifications.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>03:49</var> UTC</small><br><strong>Update</strong> - We have engaged our Cloud provider to assist with further investigation and are evaluating additional mitigation efforts. Some customers in the US region may experience impact to data collection and delayed or missing alert notifications.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>03:18</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate an issue. Some customers in the US region may experience impact to data collection and delayed or missing alert notifications.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>02:31</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>02:24</var> UTC</small><br><strong>Investigating</strong> - Some customers in the US region may be experiencing delayed or missing alert notifications. We have engaged all necessary resources as we investigate this issue.</p>