Amazon Kinesis Data Stream
Most recent version: v0.0.1
This is a Pull Listener and therefore should not be used in environments with more than one cluster.
Note that this Listener is only available in certain Tenants. Get in touch with us if you don't see it and want to access it.
Overview
Onum supports integration with Amazon Kinesis Data Stream.
Amazon Kinesis Data Streams is a fully managed, serverless streaming data service that allows you to ingest, store, and process real-time data streams. It's designed for high-throughput, low-latency data ingestion from various sources, enabling real-time analytics and applications.
Select Amazon Kinesis Data Stream from the list of Listener types and click Configuration to start.
Listener configuration
Now you need to specify how and where to collect the data, and how to establish a connection with Amazon Kinesis.
Metadata
Enter the basic information for the new Listener.
Name*
Enter a name for the new Listener.
Description
Optionally, enter a description for the Listener.
Tags
Add tags to easily identify your Listener. Hit the Enter key after you define each tag.
Configuration
Now, add the configuration to establish the connection.
AWS authentication
Region*
The region of your AWS data center. Your region is displayed in the top right-hand corner of your AWS console.
Access Key ID*
Select the access key ID from your Secrets or click New secret to generate a new one.
The Access Key ID is found in the IAM Dashboard of the AWS Management Console.
In the left panel, click on Users.
Select your IAM user.
Under the Security Credentials tab, scroll to Access Keys, and you will find existing Access Key IDs (but not the secret access key).
Secret Access Key*
Select the secret access key from your Secrets or click New secret to generate a new one.
Under Access keys, you can see your Access Key IDs, but AWS will not show the Secret Access Key. You must have it saved somewhere. If you don't have the secret key saved, you need to create a new one.
Data Stream configuration
An Amazon Kinesis Data Stream is a real-time data streaming service provided by AWS that allows you to collect, process, and analyze large volumes of streaming data in real time.
Stream Name*
Name that identifies your stream. To get it:
Select Data Streams under Amazon Kinesis in the sidebar.
The Stream Name will be in the first column e.g.
my-kinesis-stream-prod
Shard ID
The Shard is the basic unit of capacity in a Kinesis Data Stream, acting like a partition for your data stream and determining how your data is ingested, stored, and consumed.
Click your data stream name to find your Shard ID in the Shards tab e.g. shardId-000000000000
shardId-000000000001
Advanced Configuration
Custom endpoint
If you have a non-default URL that directs API requests to a specific Kinesis service endpoint, enter it here.
Click Create labels to move on to the next step and define the required Labels if needed.
Last updated
Was this helpful?