Skip to main content

Datadog

The Datadog connector streams from either the Logs Search v2 API or the Events v1 API (APM monitor alerts + custom events), depending on the configured mode.

For Cloud SIEM Security Signals, use the separate datadog_cloud_siem connector — splitting the modules keeps each schema single-purpose.

What you get​

ModeDatadog endpointNotes
logsPOST /api/v2/logs/events/searchRaw logs filtered by the configured query string
eventsGET /api/v1/eventsAPM monitor alerts + custom events filtered by tags

Events are normalised with source: datadog and the original Datadog envelope is preserved on raw_event so detection rules can match on service, env, status, or the monitor tags block.

Prerequisites​

  • A Datadog organisation on any of: datadoghq.com, datadoghq.eu, us3.datadoghq.com, us5.datadoghq.com, ddog-gov.com, or ap1.datadoghq.com.
  • An API key (Organisation Settings → API Keys → New Key).
  • An Application key (Personal Settings → Application Keys → New Key).
  • For mode: signals, the org must have Cloud SIEM enabled.

Setup walkthrough​

  1. In Datadog, Organisation Settings → API Keys → New Key. Name it aisoc-ingest and copy the value.
  2. Personal Settings → Application Keys → New Key. Name it aisoc-ingest-app and copy the value.
  3. In AiSOC: Connectors → Add connector → Datadog (Logs + APM).
  4. Site — pick the regional site that matches your Datadog tenant.
  5. Mode — logs for general log streaming, events for APM monitor alerts and custom events.
  6. Query — any Datadog query-string expression. Defaults to status:error OR status:critical. Useful filters: service:nginx status:error, env:prod source:auth, @evt.category:authentication status:error.
  7. Paste the API key and Application key.
  8. Click Test connection. AiSOC issues a 1-row search and confirms a 200.
  9. Save.

Severity mapping​

For mode: logs (the status / level attribute):

AiSOC severityDatadog log status
criticalemergency, alert, critical
mediumerror
lowwarn, warning
infonotice, info, debug, missing

Datadog log statuses follow syslog ordering, in which emergency (0) and alert (1) outrank critical (2) — so all three map to AiSOC's top tier. Mapping emergency or alert below critical would invert the vendor's own ladder. Nothing from mode: logs maps to high; routine error logs stay at medium, below anything that pages.

For mode: events (the monitor alert_type attribute):

AiSOC severityDatadog event alert_type
higherror
mediumwarning
infoinfo, success, missing

Event priority is used only as a floor: priority:low can lower severity from info, never raise it.

For Security Signals, use the datadog_cloud_siem connector.

Capabilities​

  • pull_logs — passive polling of logs.
  • pull_alerts — passive polling of APM monitor alerts.
  • query_logs — ad-hoc query support (the connector accepts arbitrary Datadog query strings).
  • pivot_host — given a hostname, return its recent logs.

Polling details​

  • Poll interval: every 5 minutes by default (since_seconds=300).
  • Pagination: cursor-based using the v2 API's meta.page.after token. The connector follows up to 25 pages per poll cycle.
  • Time range: the search request always carries filter.from: now-{since_seconds}s, filter.to: now.
  • The connector swallows network and HTTP errors and returns [] rather than raising — the scheduler logs and retries on the next cycle.

Troubleshooting​

  • 403 Forbidden — the application key was minted by a user without read permission on the resource (logs / signals). Re-create the application key under an account with the right RBAC.
  • 429 Too Many Requests — Datadog throttles aggressively; the connector backs off automatically. Tighten the query filter or raise the poll interval if it persists.
  • No events — verify the query returns rows in the Datadog UI (Logs Explorer or Security Signals page). The connector applies the query verbatim.

Configuration reference​

FieldLabelTypeRequiredDefaultNotes
siteDatadog siteselectyes—one of: us1, us3, us5, eu1, ap1, us1-fed
modeStreamselectyes—one of: logs, events
queryFilter querystringnostatus:error OR status:criticalLogs Search query (logs mode) or tag filter (events mode, e.g. 'priority:all').
api_keyAPI Keysecretyes—encrypted at rest
application_keyApplication Keysecretyes—encrypted at rest
Credential handling

api_key, application_key are encrypted at rest by the credential vault before the row is written, and decrypted only at poll time. The value is never logged and never returned by the API. See credential vault.