The OpenTelemetry Collector, when configured with a Prometheus receiver, provides an integration with ZooKeeper to ingest metrics. The Collector fetches metrics from the configured path in the ZooKeeper configuration file and sends it to the Prometheus exporter. From there the metrics are received and processed by the Prometheus receiver and exported to Cloud Observability.
To complete the integration, you will:
You need to configure ZooKeeper to use the Prometheus exporter.
zoo.cfg file, set the following:
For more details about using ZooKeeper with the Prometheus exporter, see the official ZooKeeper documentation.
In the Collector configuration file, configure the Prometheus receiver to use the ZooKeeper endpoint as a scrape target.
1 2 3 4 5 6 7 receivers: prometheus: config: scrape_configs: - job_name: 'zookeeper' static_configs: - targets: ["zookeeper1:7000", "zookeeper2:7000", "zookeeper3:7000"]
The OpenTelemetry repo’s readme provides additional details about Prometheus receiver configuration.
Once the ZooKeeper receiver is configured, enable it by adding it to one or more pipelines as described in the Collector configuration documentation.
You can validate that metrics are reporting to Cloud Observability on the Metrics details page in Project settings.
In Cloud Observability, click Project settings > Metric details.
Search for ZooKeeper metric names.
See the receiver’s metadata file for a complete list of emitted metrics.
If needed, click on the metric to edit the description and how the units are displayed in Cloud Observability.
Use the Cloud Observability Terraform Provider to create a dashboard for the metrics.
For a more complete example that’s ready to run, see the ZooKeeper integration in Cloud Observability OpenTelemetry Examples.
Updated Dec 1, 2022