Corrupted Splunk APM Monitoring MetricSets

Incident Report for Splunk Observability Cloud US0

Resolved

A degradation in the performance of the Splunk APM metrics processing pipeline caused trace-level and workflow-level Monitoring MetricSets to be corrupted and represent only a portion of the traffic and activity they are meant to measure between 2:08am and 2:13am US/Pacific. Charts and detectors built from those Monitoring MetricSets may have been impacted or fired incorrectly. Service and endpoint-level metrics were not impacted, and no trace data was lost during the incident window.

Posted Feb 25, 2021 - 02:30 PST