Amazon Kinesis processes and analyzes streaming data at scale as a fully managed service. Cisco Cloud Observability supports monitoring basic (stream-level) monitoring for Kinesis data streams.

You must configure cloud connections to monitor this entity. See Set up Cisco AppDynamics Cloud Collectors to Monitor AWS.

Cisco Cloud Observability displays AWS entities on the Observe page. Metrics are displayed for specific entity instances in the list and detail views.

This document contains references to third-party documentation. Splunk AppDynamics does not own any rights and assumes no responsibility for the accuracy or completeness of such third-party documentation.

Detail View 

To display the detail view of an Amazon Kinesis data stream instance:

  1. Navigate to the Observe page.
  2. Under Analytics, click an AWS Kinesis Data Streams group.
    The list view now displays.
  3. From the list, click an instance Name to display the detail view.
    The detail view displays the metrics, key performance indicators, and properties (attributes) related to the instance you selected.

Metrics and Key Performance Indicators 

Cisco Cloud Observability displays the following metrics and key performance indicators (KPIs) for Amazon Kinesis. See Monitoring the Amazon Kinesis Data Streams Service with Amazon CloudWatch.

Display NameSource MetricDescription

Data Stream Bytes

GetRecords.BytesThe number of bytes retrieved from the Kinesis stream, measured over the specified time period. Minimum, Maximum, and Average statistics represent the bytes in a single GetRecords operation for the stream in the specified time period.
PutRecord.BytesThe number of bytes put to the Kinesis stream using the PutRecord operation over the specified time period.
PutRecords.BytesThe number of bytes put to the Kinesis stream using the PutRecords operation over the specified time period.
IncomingBytesThe number of bytes successfully put to the Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords operations. Minimum, Maximum, and Average statistics represent the bytes in a single put operation for the stream in the specified time period.

Data Stream Records (Count)

GetRecords.RecordsThe number of records retrieved from the shard, measured over the specified time period. Minimum, Maximum, and Average statistics represent the records in a single GetRecords operation for the stream in the specified time period.
PutRecords.SuccessfulRecordsThe number of successful records in a PutRecords operation per Kinesis data stream, measured over the specified time period.
PutRecords.TotalRecordsThe total number of records sent in a PutRecords operation per Kinesis data stream, measured over the specified time period.
PutRecords.FailedRecordsThe number of records rejected due to internal failures in a PutRecords operation per Kinesis data stream, measured over the specified time period. Occasional internal failures are to be expected and should be retried.
PutRecords.ThrottledRecordsThe number of records rejected due to throttling in a PutRecords operation per Kinesis data stream, measured over the specified time period.
IncomingRecordsThe number of records successfully put to the shard over the specified time period. This metric includes record counts from PutRecord and PutRecords operations. Minimum, Maximum, and Average statistics represent the records in a single put operation for the shard in the specified time period.

Iterator Age (ms)

GetRecords.IteratorAgeMilliseconds

The age of the last record in all GetRecords calls made against a Kinesis stream, measured over the specified time period. Age is the difference between the current time and when the last record of the GetRecords call was written to the stream. The Minimum and Maximum statistics can be used to track the progress of Kinesis consumer applications. A value of zero indicates that the records being read are completely caught up with the stream.

Latency (ms)

GetRecords.latencyThe time taken per GetRecords operation, measured over the specified time period.
PutRecord.latencyThe time taken per PutRecord operation, measured over the specified time period.
PutRecords.latencyThe time taken per PutRecords operation, measured over the specified time period.

Success (Operations)

GetRecords.SuccessThe number of successful GetRecords operations per stream, measured over the specified time period.
PutRecord.SuccessThe number of successful PutRecord operations per Kinesis stream, measured over the specified time period. Average reflects the percentage of successful writes to a stream.
PutRecords.SuccessThe number of PutRecords operations where at least one record succeeded, per Kinesis stream, measured over the specified time period.

Provisioned Throughput Exceeded (Records)

ReadProvisionedThroughputExceeded

The number of GetRecords calls throttled for the stream over the specified time period. The most commonly used statistic for this metric is Average.

When the Minimum statistic has a value of 1, all records were throttled for the stream during the specified time period.

When the Maximum statistic has a value of 0 (zero), no records were throttled for the stream during the specified time period.

WriteProvisionedThroughputExceeded

The number of records rejected due to throttling for the stream over the specified time period. This metric includes throttling from PutRecord and PutRecords operations. The most commonly used statistic for this metric is Average.

When the Minimum statistic has a non-zero value, records were being throttled for the stream during the specified time period.

When the Maximum statistic has a value of 0 (zero), no records were being throttled for the stream during the specified time period.

Properties (Attributes)

Cisco Cloud Observability displays the following properties for Amazon Kinesis.

Display NameProperty NameDescription
Cloud Providercloud.providerThe name of the cloud provider of the database.
Account IDcloud.account.idThe cloud account ID where the resource is assigned.
Locationcloud.regionThe geographical region where the resource is running.
Zonescloud.availability_zoneThe logical zone list for the database.
Image IDImageIdThe host image ID.
Private IPPrivateIpAddressThe private DNS names of the instance.
Host IDInstance IDThe Instance Identifier where the agent is deployed; usually assigned by the cloud provider.
Host TypeInstance TypeThe AWS machine type.
NameInstance NameThe hostname.
OS ArchitectureArchitectureThe OS architecture.
OS NameOSName

The OS name.

Public IP AddressesPublicIpAddressThe host IP address.
Total VCPU CountvCPUCountAvailable vCPU on the machine.
VPC IDVpcIdThe ID of the virtual private cloud.

Retention and Purge Time-To-Live (TTL)

For all cloud and infrastructure entities, the retention TTL is 180 minutes (3 hours) and the purge TTL is 525,600 minutes (365 days). 

Amazon Web Services, the AWS logo, AWS, and any other AWS Marks used in these materials are trademarks of Amazon.com, Inc. or its affiliates in the United States and/or other countries.