Apache Spark

Supported Platforms

Platform
Metrics
Logs
Traces

Linux

Windows

macOS

Configuration Table

Field
Description

Telemetry Types

The types of telemetry to gather with this receiver.

Endpoint

The endpoint of the Apache Spark REST API.

Enable TLS

Whether to use TLS when connecting to Apache Spark.

Skip TLS Certificate Verification

Enable to skip TLS certificate verification. This is relevant if TLS is enabled.

TLS Certificate Authority File

Certificate authority used to validate TLS certificates. This is relevant if TLS is enabled.

Mutual TLS Client Certificate File

A TLS certificate used for client authentication. This is relevant if TLS is enabled.

TLS Client Private Key File

A TLS private key used for client authentication. This is relevant if TLS is enabled.

Collection Interval

Sets how often (seconds) to scrape for metrics.

Allowed Spark Application Names

Filters that define which Spark applications are scraped for metrics. If undefined, all applications at the endpoint will be scraped.

Spark Metrics

A list of Cluster, Job, Executor, and Stage metrics to be included or excluded.

Last updated

Was this helpful?