Amazon Kinesis Data Streams is used to collect and process large streams of data records in real-time.

You can create data-processing applications, known as Kinesis Data Streams applications. A typical Kinesis Data Streams application reads data from a data stream as data records. These applications can use the Kinesis Client Library and run on Amazon EC2 instances.

You can:

  • Send the processed records to dashboards.
  • Use the record to generate alerts.
  • Dynamically change pricing and advertising strategies.
  • Send data to a variety of other AWS services.

Use the OpsRamp AWS public cloud integration to discover and collect metrics against the AWS service.

Setup

To set up the OpsRamp AWS integration and discover the AWS services (Kinesis and Shard), go to AWS Integration Discovery Profile and select Kinesis.

Metrics

Standard metrics

OpsRamp MetricMetric Display NameUnitAggregation Type
aws_kinesis_PutRecord_Bytes

Number of bytes put to the Amazon Kinesis stream using PutRecord over the specified time period.
PutRecord.BytesBytesAverage
aws_kinesis_PutRecord_Latency

Time taken per PutRecord operation, measured over the specified time period.
PutRecord.LatencymsAverage
aws_kinesis_PutRecord_Success

Number of successful PutRecord operations per Amazon Kinesis stream, measured over the specified time period.
PutRecord.SuccessCountAverage
aws_kinesis_PutRecords_Bytes

Number of bytes put to the Amazon Kinesis stream using PutRecords over the specified time period.
PutRecords.BytesBytesAverage
aws_kinesis_PutRecords_Latency

Time taken per PutRecords operation, measured over the specified time period.
PutRecords.LatencymsAverage
aws_kinesis_PutRecords_Records

Number of successful records in a PutRecords operation per Amazon Kinesis stream, measured over the specified time period.
PutRecords.RecordsCountAverage
aws_kinesis_PutRecords_Success

Number of successful PutRecords operations per Amazon Kinesis stream, measured over the specified time period.
PutRecords.SuccessCountAverage
aws_kinesis_IncomingBytes

Number of bytes successfully put to the Amazon Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords.
IncomingBytesBytesAverage
aws_kinesis_IncomingRecords

Number of records sucessfully put to the Amazon Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords.
IncomingRecordsCountAverage
aws_kinesis_GetRecords_Bytes

Number of bytes retrieved from the stream, measured over the specified time period.
GetRecords.BytesBytesAverage
aws_kinesis_GetRecords_IteratorAgeMilliseconds

Age of the last record in all GetRecords calls made against a stream, measured over the specified time period. Age is the difference between the current time and when the last record of a GetRecords call was written to the stream. Maximum statistic represents the oldest record that has been consumed over the specified time period, while Minimum represents the newest record.
GetRecords.IteratorAgeMillisecondsmsAverage
aws_kinesis_GetRecords_Latency

Time taken per GetRecords operation, measured over the specified time period.
GetRecords.LatencymsAverage
aws_kinesis_GetRecords_Success

Number of successful GetRecords operations per stream, measured over the specified time period.
GetRecords.SuccessCountAverage
aws_kinesis_GetRecords_Records

Number of records retrieved from the shard, measured over the specified time period.
Get Records RecordsCountAverage
aws_kinesis_ReadProvisionedThroughputExceeded

Number of GetRecords calls throttled for the stream over the specified time period.
Read Provisioned Throughput ExceededCountAverage
aws_kinesis_WriteProvisionedThroughputExceeded

Number of records rejected due to throttling for the stream over the specified time period.
Write Provisioned Throughput ExceededCountAverage

Shard metrics

OpsRamp MetricMetric Display NameUnitAggregation Type
aws_kinesis_IncomingBytes

Number of bytes successfully put to the Amazon Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords.
IncomingBytesBytesAverage
aws_kinesis_IncomingRecords

Number of records sucessfully put to the Amazon Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords.
IncomingRecordsCountAverage
aws_kinesis_ReadProvisionedThroughputExceeded

Number of GetRecords calls throttled for the stream over the specified time period.
Read Provisioned Throughput ExceededCountAverage
aws_kinesis_WriteProvisionedThroughputExceeded

Number of records rejected due to throttling for the stream over the specified time period.
Write Provisioned Throughput ExceededCountAverage
aws_kinesis_IteratorAgeMilliseconds

The age of the last record in all GetRecords calls made against a shard, measured over the specified time period.
Iterator Age MillisecondsMillisecondsAverage
aws_kinesis_OutgoingBytes

Number of bytes retrieved from the shard, measured over the specified time period.
Outgoing BytesBytesAverage
aws_kinesis_OutgoingRecords

Number of records retrieved from the shard, measured over the specified time period.
Outgoing RecordsCountAverage

Event support

CloudTrail event support

  • Not Supported

CloudWatch alarm support

  • Supported
  • Configurable in OpsRamp AWS Integration Discovery Profile.

External reference