Global Pipeline Intelligence

circle-info

Global Pipeline Intelligence is only available for Bindplane Enterprise and Bindplane Enterprise (Google Edition) licenses.

Global Pipeline Intelligence automatically analyzes your telemetry data across your entire Bindplane project and surfaces actionable recommendations to optimize your pipelines. Unlike Pipeline Intelligence, which provides on-demand features within the pipeline editor, Global Pipeline Intelligence runs in the background, continuously monitoring your snapshot data and delivering recommendations without manual intervention.

With Global Pipeline Intelligence, you can:

  • Detect sensitive data (PII, credentials, secrets) flowing through your pipelines

  • Automatically identify unnecessary fields that can be removed to reduce telemetry volume and costs

Enabling Global Pipeline Intelligence

To enable Global Pipeline Intelligence, navigate to your organization settings within Bindplane.

  1. Enable Pipeline Intelligence AI Features

  2. An additional option will appear for you to enable Global Pipeline Intelligence AI Features

Once both settings are enabled, Global Pipeline Intelligence will begin analyzing your telemetry data and automatically generate recommendations.

Recommendations

Global Pipeline Intelligence recommendations appear alongside your existing pipeline intelligence recommendations in Bindplane. Each recommendation includes a description with the reason why it was recommended, as well as a pre-configured processor that is ready to apply to your pipeline.

Delete Fields

The Delete Fields recommendation identifies telemetry fields that can be safely removed to reduce data volume and costs. These recommendations target fields like auto-generated instrumentation metadata, development-only fields, constant or duplicated infrastructure metadata, and high-frequency fields that provide minimal observability value.

Each recommendation includes an estimated percentage reduction in data volume and a preconfigured Delete Fields processor.

Sensitive Data Detection

Sensitive Data Detection recommendations identify PII and other sensitive information flowing through your telemetry pipeline. Detected types include:

  • Credentials and secrets (API keys, passwords, bearer tokens)

  • Payment information (credit card numbers, IBANs)

  • Personal identifiers (Social Security numbers, email addresses, phone numbers)

  • Network identifiers (IP addresses, MAC addresses)

  • Location data (street addresses, city/state, zip codes)

Each recommendation includes a Redact Sensitive Data processor with the appropriate redaction rules or custom regex patterns pre-configured.

Best Practices

  • Always review recommendations before applying them to production pipelines. While Global Pipeline Intelligence is designed to produce accurate, validated recommendations, it may make mistakes.

  • Things to verify:

    • Field paths match your actual data structure

    • Redaction patterns do not inadvertently remove non-sensitive data

    • Processor placement is correct for your pipeline topology

How your data is used

When Global Pipeline Intelligence is enabled, small data snapshots are collected from across your pipelines and retained for up to 10 days. This data is used exclusively to generate recommendations and is deleted as soon as it is no longer needed.

Global Pipeline Intelligence AI features are off by default. Nothing changes in your environment until an org admin explicitly enables them.

For full details, please review our Privacy Policyarrow-up-right and EULAarrow-up-right.

Explore additional Pipeline Intelligence features in the documentation here.

Last updated

Was this helpful?