Skip to main content

Correlation Graph

Capability: correlation layer

Architecture owns the graph model. Engineering implements propagation. Platform operates the stores and query paths that make the graph traversable in incidents and audits.

Outcome

From one business KPI degradation, an on-call engineer (or auditor) can traverse:

Business event → service trace → infrastructure signal

without manual copy-paste across three tools.

Graph nodes and edges

Node typeKey fieldsEdge to
Business eventjourney_id, step, outcome, correlation_idService root span
Service spantrace_id, span_id, service.name, operationParent/child spans, infra context
Infra signalresource_id, metric, value, timestampService via workload labels

Steps

1. Standardize correlation ID propagation

RuleImplementation
Ingress assigns or accepts IDAPI gateway or first service hop
All outbound calls forward contextHTTP headers, message metadata
Async preserves IDQueue message attributes
Batch jobs inherit parent IDScheduler metadata

2. Map journeys to entry services

From Business journey mapping, maintain a table:

journey_idEntry serviceEntry operation
checkout.paypayment-apiPOST /pay
claims.submitclaims-apiPOST /submit

3. Enrich spans at collection

Collector adds:

  • journey_id (when known)
  • tenant / environment
  • deploy.version

Redact before write to operational tiers.

4. Build traversal queries

Define saved paths for tier-1 incidents:

ScenarioStartTraverse
Payment success dropBusiness KPI dashboardEvents with journey_id=checkout.pay → traces → DB CPU
Error budget burnSLO alertService trace → dependency → infra

5. Regulator replay path

Audit consumers need immutable chains. Link business outcome records to audit-tier storage where policy requires 7y retention (see G.A.I.N Observability for AI audit pattern).

Anti-patterns

Anti-patternWhy it fails
Different IDs per hopGraph breaks at first async boundary
Business metrics only in BI warehouseHours of lag in incidents
Infra dashboards without service labelsCannot answer "who hurt whom"
AI: logging final answer onlyAgent failures invisible

Release gate

  • Correlation ID on 100% of tier-1 synchronous paths
  • Async and batch paths documented and tested
  • Journey → entry service map published
  • One end-to-end drill from KPI to infra completed quarterly
  • AI paths include multi-hop traces where applicable