Process and parse incoming logs.
As of March 12, 2024, all non-logging customers have trial access to Cloud Observability logs. Use trial access to explore logging before committing to a full subscription. To get full access, contact Customer Success.
Overview
Log ingestion pipelines help you manage and transform incoming logs. Use existing tools to collect and send logs to Cloud Observability. Then transform those logs with log ingestion pipelines, securing and optimizing the logs you see in Cloud Observability.
Cloud Observability’s log ingestion pipelines help you do the following:
- Centralize log management, processing logs from several sources in one UI.
- Keep only the logs you need, controlling storage costs.
- Secure data by removing sensitive information from incoming logs.
Key features
- Customized pipelines: Create pipelines for specific data sources or unify log management with one pipeline.
- Supported tools: Use ingestion pipelines on logs from OpenTelemetry (OTel) or Datadog.
- Transformations: Process and parse logs with transformations, including Drop matching, Flatten, Format, Keep matching, Parse JSON, Rename, Set, and Regex extract.
Get started
Visit these pages to learn more about log ingestion pipelines:
- Create ingestion pipelines - Set up a basic transformation in Cloud Observability.
- Ingestion pipeline reference - Learn about every transformation type with examples.
See also
Updated Sep 6, 2024