LogoLogo
WebsiteBlogLogin
  • Onum Docs
  • Use Cases
  • Videos
  • Release Notes
  • Welcome
  • Getting Started
    • About Onum
    • Architecture
    • Deployment
    • Getting Started with Onum
    • Understanding The Essentials
      • Cards and Table Views
      • Data Types
      • Graph Calculations
      • The Time Range Selector
    • Key Terminology
  • THE WORKSPACE
    • Home
    • Listeners
      • Cloud Listeners
      • Listener Integrations
        • Amazon SQS
        • Amazon S3
        • Apache Kafka
        • Azure Event Hubs
        • Cisco NetFlow
        • Google Pub/Sub
        • HTTP
        • HTTP Pull
        • Microsoft 365
        • OpenTelemetry
        • Syslog
        • TCP
      • Labels
    • Pipelines
      • Building a Pipeline
        • AI Assistant
          • AI Pipeline Assistant
          • AI Action Assistant
      • Listeners
      • Actions
        • Advanced
          • Anonymizer
          • Bring Your Own Code
          • Field Generator
          • For Each
          • Google DLP
          • HTTP Request
          • Redis
        • Aggregation
          • Accumulator
          • Group By
        • AI
          • Amazon GenAI
          • BLIP-2
          • Cog
          • Google GenAI
          • Llama
          • Replicate
        • Detection
          • Sigma Rules
        • Enrichment
          • Lookup
        • Filtering
          • Conditional
          • Sampling
        • Formatting
          • Message Builder
        • Transformation
          • Field Transformation
            • Field Transformation Operations
              • Arithmetic / Logic
                • Divide Operation
                • Median
                • Multiply Operation
                • Subtract Operation
                • Sum Operation
              • Code tidy
                • JSON Minify
              • Control characters
                • Escape String
                • Unescape String
              • Conversion
                • Convert Area
                • Convert Data Units
                • Convert Distance
                • Convert Mass
                • Convert Speed
                • List to String
                • String to List
              • Data format
                • From Base
                • From Base64
                • From Hex
                • To Base
                • To Base64
                • To Hex
              • Date / Time
                • From Unix Timestamp
                • To Timestamp
                • To Unix Timestamp
                • Translate Datetime Format
              • Encoding / Decoding
                • From Binary
                • To Binary
                • To Decimal
              • Encryption / Encoding
                • JWT Decode
              • File system permissions
                • Parse Unix file permissions
              • Format conversion
                • CSV to JSON
                • JSON to CSV
              • Hashing
                • Keccak
                • MD2
                • MD4
                • MD5
                • SHA0
                • SHA1
                • SHA2
                • SHA3
                • Shake
                • SM3
              • Networking
                • Defang IP Address
                • Defang URL
                • Extract IP Address
                • Fang IP Address
                • Fang URLs
                • IP to Hexadecimal
                • Parse URI
                • URL Decode
                • URL Encode
              • Other
                • Parse Int
              • String
                • Length
              • Text sample adding
                • Pad Lines
              • Utils
                • Byte to Human Readable
                • Count Occurrences
                • CRC8 Checksum
                • CRC16 Checksum
                • CRC24 Checksum
                • CRC32 Checksum
                • Credit Card Obfuscator
                • Filter
                • Find and Replace
                • Regex
                • Remove Whitespace
                • Reverse String
                • Shuffle
                • Sort
                • Substring
                • Swap Case
                • To Lower Case
                • To Upper Case
          • Flat JSON
          • JSON Transformation
          • JSON Unroll
          • Math Expression
          • Parser
            • PCL (Parser Configuration Language)
        • Utils
          • Unique
      • Data sinks
      • Bulk Changes
      • Publishing & Versioning
      • Test your Pipeline
    • Data sinks
      • Data sink Integrations
        • Amazon S3
        • Amazon SQS
        • Azure Blob Storage
        • Azure Event Hubs
        • Devo
        • Google BigQuery
        • Google Cloud Storage
        • Google Pub/Sub
        • HTTP
        • Jira
        • Mail
        • Null
        • OpenTelemetry
        • PagerDuty
        • Pushover
        • Qradar
        • Relational Databases
        • ServiceNow
        • Slack
        • Splunk HEC
        • Syslog
        • TCP
        • Telegram
        • Twilio
    • Alerts
  • YOUR VAULT
    • Enrichment
    • Data History
    • Actions
  • ADMINISTRATION
    • Tenant Menu
    • Global Settings
      • Your Account
      • Organization Settings
        • Secrets Management
      • Tenant
        • Authentication
        • Users
        • Activity Log
  • MARKETPLACE
    • Onum Marketplace
      • Pulling Pipelines
        • Netskope Events Alert
        • OKTA System Log API
        • Sophos Connector SIEM
Powered by GitBook
On this page
  • Overview
  • Data Sink Configuration
  • Metadata
  • Metrics display
  • Configuration
  • Pipeline configuration
  • Output configuration

Was this helpful?

Export as PDF
  1. THE WORKSPACE
  2. Data sinks
  3. Data sink Integrations

Amazon SQS

Most recent version: v0.0.1

PreviousAmazon S3NextAzure Blob Storage

Last updated 5 days ago

Was this helpful?

See the changelog of this Data Sink type .

Overview

Amazon SQS (Simple Queue Service) is a fully managed message queuing service that enables asynchronous communication between different parts of a distributed system. It allows developers to send, store, and retrieve messages without needing to manage the underlying queue infrastructure.

Select Amazon SQS from the list of Data Sink types and click Configuration to start.

Data Sink Configuration

Now you need to specify how and where to send the data, and how to establish a connection with Amazon SQS.

Metadata

Enter the basic information for the new Data Sink.

Parameters
Description

Name*

Enter a name for the new Data Sink.

Description

Optionally, enter a description for the Data Sink.

Tags

Add tags to identify your Data Sink easily. Hit the Enter key after you define each tag.


Metrics display


Configuration

Now, add the configuration to establish the connection.

Auth Configuration

Parameter
Description

Access Key ID*

  1. In the left panel, click on Users.

  2. Select your IAM user.

  3. Under the Security Credentials tab, scroll to Access Keys, and you will find existing Access Key IDs (but not the secret access key).

Secret Access Key*

Under Access keys, you can see your Access Key IDs, but AWS will not show the Secret Access Key. You must have it saved somewhere. If you don't have the secret key saved, you need to create a new one.

Default region*

Choose your default region from the list provided. Your region is displayed in the top right-hand corner of your AWS console, as you can see in the image below.

Custom Endpoint

Specify the full URL of a custom endpoint if you want to use one instead of the default SQS endpoint.

Bulk Configuration

Parameter
Description

Bulk configuration

Set the Bulk configuration parameter to true if you want to allow bulk sending. Configure the following parameters:

  • Event amount* - Maximum number of events to send in a single batch. The maximum and default value is 10.

  • Event time limit in seconds* - Time in seconds to wait before sending the batch. The default value is 1, and the minimum is 0.

  • Max size in bytes* - Maximum limit of the batch size in bytes. The maximum and default value is 262144. The minimum value is 1.

Delay seconds

The length of time, in seconds, for which to delay a specific message. The minimum value is 1 and the maximum value is 900.

Click Finish when complete.

Pipeline configuration

Output configuration

Parameter
Description

Queue URL*

The URL of your existing Amazon SQS queue to send the data to. To get it:

  1. Go to the AWS Management Console.

  2. In the Search Bar, type SQS and click on Simple Queue Service (SQS).

  3. Click on Queues in the left panel.

  4. Locate your queue from the list and click it.

  5. The Queue URL will be displayed in the table under URL.

This is the correct format: sqs.region.localhost/awsaccountnumber/storedinenvvar

Queue Type*

The queue type of your SQS object, found also in the Queues area (Standard or FIFO).

Message*

Select the field that contains the message. The data type must be string.

Click Save to save your configuration.

Onum supports integration with .

Decide whether or not to include this Data Sink info in the metrics and graphs of the area.

Add the access key from your or create one. The Access Key ID is found in the IAM Dashboard of the AWS Management Console:

Add the secret access key from your or create one.

When it comes to using this Data Sink in a , you must configure the following output parameters. To do it, simply click the Data Sink on the canvas and select Configuration.

Amazon SQS
Home
Pipeline
Secrets
Secrets
here