Once you’ve integrated with AWS CloudWatch, you have access to metrics from AWS Elastic File System, which in real time, gather and process huge streams of data records. Kinesis Data Streams applications, which process data, can be produced. Data records are read from a data stream by a typical Kinesis Data Streams application.
You can create a pre-built dashboard for this integration when you add the integration to Cloud Observability or from the Dashboard list view.
To verify metrics are reporting, search for the metrics on the Metric details page in Settings.
The following table shows the Kinesis metrics ingested by Cloud Observability.
| Metric Name | Unit | Description |
|---|---|---|
| aws.kinesis.get_records.bytes | bytes | The total amount of bytes retrieved from the Kinesis stream over the predetermined time frame. |
| aws.kinesis.get_records_iterator_age | milliseconds | This metric is deprecated. Use GetRecords.IteratorAgeMilliseconds. |
| aws.kinesis.get_records_iterator_age_milliseconds | milliseconds | The oldest record in all GetRecords requests performed against a Kinesis stream over the predetermined time frame Age is the interval of time between the present and the moment at which the most recent GetRecords call was written to the stream. |
| aws.kinesis.get_records_latency | milliseconds | The amount of time required for each GetRecords operation, calculated over the given time frame. |
| aws.kinesis.get_records_records | count | The total number of records retrieved from the shard over the predetermined time frame |
| aws.kinesis.get_records_success | count | The total number of successful get-records requests for each stream during the given time frame. |
| aws.kinesis.incoming_bytes | bytes | The total amount of bytes successfully added to the Kinesis stream during the time frame specified. |
| aws.kinesis.incoming_records | count | The quantity of records that were successfully added to the Kinesis stream during the time frame specified. |
| aws.kinesis.put_record_bytes | bytes | The total amount of bytes used during the specified time frame to use the PutRecord operation to add data to the Kinesis stream. |
| aws.kinesis.put_record_latency | milliseconds | The amount of time required for each PutRecord operation, calculated over the given time frame. |
| aws.kinesis.put_record_success | count | The quantity of PutRecord operations per Kinesis stream that were successful over the predetermined time frame. |
| aws.kinesis.put_records_bytes | bytes | The total amount of bytes used during the specified time frame to use the PutRecords operation to add data to the Kinesis stream. |
| aws.kinesis.put_records_latency | milliseconds | The amount of time required for each PutRecords operation, calculated over the given time frame. |
| aws.kinesis.put_records_records | count | This metric is deprecated. Use aws.kinesis.successful_records. |
| aws.kinesis.put_records_success | count | The number of PutRecords operations per Kinesis stream during the specified time frame where at least one record was successful. |
| aws.kinesis.put_records_total_records | count | The total number of records sent in a PutRecords operation for a given Kinesis data stream over the predetermined time frame. |
| aws.kinesis.put_records_successful_records | count | The quantity of records in a PutRecords operation that were successfully added to a Kinesis data stream over the predetermined time frame. |
| aws.kinesis.put_records_failed_records | count | The number of records in a PutRecords operation that were rejected because of internal errors over the predetermined amount of time. |
| aws.kinesis.put_records_throttled_records | count | The total number of records in a PutRecords operation that were rejected because of throttling in a Kinesis data stream over the chosen time frame. |
| aws.kinesis.read_provisioned_throughput_exceeded | count | The quantity of GetRecords requests for the stream that were throttled during the time frame specified. |
| aws.kinesis.subscribe_to_shard_rate_exceeded | bytes | This metric is released whenever a new subscription attempt fails because the same consumer already has an active subscription or whenever you make more calls per second than is permitted for this operation. |
| aws.kinesis.subscribe_to_shard_success | bytes | This metric keeps track of the success or failure of the SubscribeToShard subscription setup. The subscription is only valid for a maximum of five minutes. As a result, this metric is broadcast at least once every five minutes. |
| aws.kinesis.subscribe_to_shard_event_bytes | bytes | The total number of bytes obtained from the shard during the predetermined time frame. |
| aws.kinesis.subscribe_to_shard_event_millis_behind_latest | milliseconds | The interval between now and the moment the most recent SubscribeToShard event record was written to the stream. |
| aws.kinesis.subscribe_to_shard_event_records | count | The total number of records that were obtained from the shard during the designated time frame. |
| aws.kinesis.subscribe_to_shard_event_success | count | When an event is successfully published, this metric is released. Only when a subscription is active is it released. |
| aws.kinesis.write_provisioned_throughput_exceeded | count | The total number of records for the stream that were rejected because of throttling during the given time frame. |
| aws.kinesis.incoming_bytes | bytes | The total amount of bytes successfully added to the shard during the time frame specified. Bytes from PutRecord and PutRecordsoperations are included in this metric. |
| aws.kinesis.incoming_records | count | The total number of records that were successfully added to the shard during the time frame specified. Record counts from the PutRecord and PutRecords operations are included in this metric. |
| aws.kinesis.iterator_age_milliseconds | milliseconds | The total number of records during the specified time period that were successfully added to the shard. This metric includes record counts from the PutRecord and PutRecordsoperations. |
| aws.kinesis.outgoing_bytes | bytes | The total number of bytes retrieved from the shard during the chosen time frame. |
| aws.kinesis.outgoing_records | count | The total number of records retrieved from the shard over the predetermined time frame |
| aws.kinesis.read_provisioned_throughput_exceeded | count | The quantity of GetRecords requests for the shard over the predetermined time frame that were throttled. |
| aws.kinesis.write_provisioned_throughput_exceeded | count | The quantity of records for the specified time period that were rejected for the shard due to throttling. |
See also
Updated Dec 1, 2022