Why am I getting so many "No Data" Alerts for my Metric Monitor

No Data Alerts are a great way to be notified when an Integration/application is no longer submitting metrics to Datadog. When utilizing a Metric Monitor for a metric that isn't always reported at the same frequency or is reported with a timestamp slightly in the past, such as a metric from the AWS Integration, you may receive No Data alerts despite seeing these values in Datadog. There are a couple Monitor configuration options that can be edited to properly evaluate over these types of metrics. 

 

AWS_Monitor_Config.png

 

1) The first section of this image displays that this metric: aws.ec2.cpuutilization is coming in with a slight delay. This is due to the limitations on how soon this metric is available from Cloudwatch, more information on that can be found here.

2) This option is the Require a Full Window of Data (or the ability to not require). This option is typically recommended for metrics being reported by the Datadog Agent and ones that are coming in with the current timestamp. For slightly backfilled metrics, this option can cause No Data events or have the Monitor skip the current evaluation period due to the values not being present at the time the monitor evaluates. For this reason we recommend all sparse metrics or metrics that don't report at the same frequency, to utilize the option: Do Not Require a Full Window of Data.

3) The last option here is the Delay Evaluation. Since Monitors perform an evaluation every minute, it is looking back on the past X minutes of data. For backfilled metrics, like those coming from AWS, the monitor may be looking at a period of time when the data is simply not in Datadog. This will cause false No Data alerts. Setting this field allows you to have the monitor wait, 900 seconds, so that the AWS metrics have 900 seconds to be available within Datadog before the monitor begins evaluation. 

  

Please contact support@datadoghq.com should you experience any issues. 

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk