Detect ingestion backpressure between OpenTelemetry, Data Prepper, and OpenSearch before telemetry drops

A practical guide to separate healthy queues, slow pipelines, and OpenSearch rejections before changing limits blindly.

Validate Collector, Data Prepper, and OpenSearch with parity, queue, and rejection metrics so traces, logs, or metrics do not disappear before you can explain the incident.

Created: July 10, 2026

Published: July 10, 2026

Estimated time45 min

LevelAdvanced

Before you startOpenTelemetry Collector exposing internal metrics on :8888 or equivalent.

PlatformsLinux / Docker

WhatsApp X LinkedIn

Docker

Validate locally or in staging with Collector/Data Prepper containers and Prometheus scraping both endpoints.

docker composePrometheus or curla synthetic test pipeline

Start the canary stack

docker compose up -d otel-collector data-prepper prometheus opensearch

Inspect Data Prepper logs

docker compose logs --tail=100 data-prepper | egrep 'backpressure|retry|bulk|buffer'

Also available inDetectar backpressure de ingesta entre OpenTelemetry, Data Prepper y OpenSearch antes de perder telemetría

Content locked

This guide requires both steps before full content is available.

○Click “Like” on this guide.
○Share on WhatsApp, X, LinkedIn, or copy the link.

Access is automatically unlocked as soon as both steps are completed.