Once you’ve integrated with AWS CloudWatch, you have access to metrics from AWS Elastic File System, which in real time, gather and process huge streams of data records. Kinesis Data Streams applications, which process data, can be produced. Data records are read from a data stream by a typical Kinesis Data Streams application.

All available AWS integrations

To verify metrics are reporting, search for the metrics on the Metric details page in Project settings.

The following table shows the Kinesis metrics ingested by Lightstep.

Metric Name Unit Description
aws.kinesis.get_records.bytes bytes The total amount of bytes retrieved from the Kinesis stream over the predetermined time frame.
aws.kinesis.get_records_iterator_age milliseconds This metric is deprecated. Use GetRecords.IteratorAgeMilliseconds.
aws.kinesis.get_records_iterator_age_milliseconds milliseconds The oldest record in all GetRecords requests performed against a Kinesis stream over the predetermined time frame Age is the interval of time between the present and the moment at which the most recent GetRecords call was written to the stream.
aws.kinesis.get_records_latency milliseconds The amount of time required for each GetRecords operation, calculated over the given time frame.
aws.kinesis.get_records_records count The total number of records retrieved from the shard over the predetermined time frame
aws.kinesis.get_records_success count The total number of successful get-records requests for each stream during the given time frame.
aws.kinesis.incoming_bytes bytes The total amount of bytes successfully added to the Kinesis stream during the time frame specified.
aws.kinesis.incoming_records count The quantity of records that were successfully added to the Kinesis stream during the time frame specified.
aws.kinesis.put_record_bytes bytes The total amount of bytes used during the specified time frame to use the PutRecord operation to add data to the Kinesis stream.
aws.kinesis.put_record_latency milliseconds The amount of time required for each PutRecord operation, calculated over the given time frame.
aws.kinesis.put_record_success count The quantity of PutRecord operations per Kinesis stream that were successful over the predetermined time frame.
aws.kinesis.put_records_bytes bytes The total amount of bytes used during the specified time frame to use the PutRecords operation to add data to the Kinesis stream.
aws.kinesis.put_records_latency milliseconds The amount of time required for each PutRecords operation, calculated over the given time frame.
aws.kinesis.put_records_records count This metric is deprecated. Use aws.kinesis.successful_records.
aws.kinesis.put_records_success count The number of PutRecords operations per Kinesis stream during the specified time frame where at least one record was successful.
aws.kinesis.put_records_total_records count The total number of records sent in a PutRecords operation for a given Kinesis data stream over the predetermined time frame.
aws.kinesis.put_records_successful_records count The quantity of records in a PutRecords operation that were successfully added to a Kinesis data stream over the predetermined time frame.
aws.kinesis.put_records_failed_records count The number of records in a PutRecords operation that were rejected because of internal errors over the predetermined amount of time.
aws.kinesis.put_records_throttled_records count The total number of records in a PutRecords operation that were rejected because of throttling in a Kinesis data stream over the chosen time frame.
aws.kinesis.read_provisioned_throughput_exceeded count The quantity of GetRecords requests for the stream that were throttled during the time frame specified.
aws.kinesis.subscribe_to_shard_rate_exceeded bytes This metric is released whenever a new subscription attempt fails because the same consumer already has an active subscription or whenever you make more calls per second than is permitted for this operation.
aws.kinesis.subscribe_to_shard_success bytes This metric keeps track of the success or failure of the SubscribeToShard subscription setup. The subscription is only valid for a maximum of five minutes. As a result, this metric is broadcast at least once every five minutes.
aws.kinesis.subscribe_to_shard_event_bytes bytes The total number of bytes obtained from the shard during the predetermined time frame.
aws.kinesis.subscribe_to_shard_event_millis_behind_latest milliseconds The interval between now and the moment the most recent SubscribeToShard event record was written to the stream.
aws.kinesis.subscribe_to_shard_event_records count The total number of records that were obtained from the shard during the designated time frame.
aws.kinesis.subscribe_to_shard_event_success count When an event is successfully published, this metric is released. Only when a subscription is active is it released.
aws.kinesis.write_provisioned_throughput_exceeded count The total number of records for the stream that were rejected because of throttling during the given time frame.
aws.kinesis.incoming_bytes bytes The total amount of bytes successfully added to the shard during the time frame specified. Bytes from PutRecord and PutRecordsoperations are included in this metric.
aws.kinesis.incoming_records count The total number of records that were successfully added to the shard during the time frame specified. Record counts from the PutRecord and PutRecords operations are included in this metric.
aws.kinesis.iterator_age_milliseconds milliseconds The total number of records during the specified time period that were successfully added to the shard. This metric includes record counts from the PutRecord and PutRecordsoperations.
aws.kinesis.outgoing_bytes bytes The total number of bytes retrieved from the shard during the chosen time frame.
aws.kinesis.outgoing_records count The total number of records retrieved from the shard over the predetermined time frame
aws.kinesis.read_provisioned_throughput_exceeded count The quantity of GetRecords requests for the shard over the predetermined time frame that were throttled.
aws.kinesis.write_provisioned_throughput_exceeded count The quantity of records for the specified time period that were rejected for the shard due to throttling.