LogoLogo
WebsiteBlogLogin
  • Onum Docs
  • Use Cases
  • Videos
  • Release Notes
  • Welcome
  • Getting Started
    • About Onum
    • Architecture
    • Deployment
    • Getting Started with Onum
    • Understanding The Essentials
      • Cards and Table Views
      • Data Types
      • Graph Calculations
      • The Time Range Selector
    • Key Terminology
  • THE WORKSPACE
    • Home
    • Listeners
      • Cloud Listeners
      • Listener Integrations
        • Amazon
          • Amazon S3
          • Amazon SQS
        • Kafka
          • Apache Kafka
        • Cisco NetFlow
        • Google Cloud
          • Google Cloud Storage
          • Google Pub/Sub
        • HTTP
          • HTTP Pull
            • Netskope
            • OKTA
            • CrowdStrike
            • Cortex
        • Microsoft
          • Azure Event Hubs
          • Microsoft 365
        • OpenTelemetry
        • Syslog
        • TCP
        • Tick
      • Labels
    • Pipelines
      • Building a Pipeline
        • AI Assistant
          • AI Pipeline Assistant
          • AI Action Assistant
      • Listeners
      • Actions
        • Advanced
          • Anonymizer
          • Bring Your Own Code
          • Field Generator
          • For Each
          • Google DLP
          • HTTP Request
          • Redis
        • Aggregation
          • Accumulator
          • Group By
        • AI
          • Amazon GenAI
          • BLIP-2
          • Cog
          • Google GenAI
          • Llama
          • Replicate
        • Detection
          • Sigma Rules
        • Enrichment
          • Lookup
        • Filtering
          • Conditional
          • Sampling
        • Formatting
          • Message Builder
        • Schemas
          • OCSF
        • Transformation
          • Field Transformation
            • Field Transformation Operations
              • Arithmetic / Logic
                • Divide Operation
                • Median
                • Multiply Operation
                • Subtract Operation
                • Sum Operation
              • Code tidy
                • JSON Minify
              • Control characters
                • Escape String
                • Unescape String
              • Conversion
                • Convert Area
                • Convert Data Units
                • Convert Distance
                • Convert Mass
                • Convert Speed
                • List to String
                • String to List
              • Data format
                • From Base
                • From Base64
                • From Hex
                • To Base
                • To Base64
                • To Hex
              • Date / Time
                • From Unix Timestamp
                • To Timestamp
                • To Unix Timestamp
                • Translate Datetime Format
              • Encoding / Decoding
                • From Binary
                • To Binary
                • To Decimal
              • Encryption / Encoding
                • JWT Decode
              • File system permissions
                • Parse Unix file permissions
              • Format conversion
                • CSV to JSON
                • JSON to CSV
                • Protobuf to JSON
              • Hashing
                • Keccak
                • MD2
                • MD4
                • MD5
                • SHA0
                • SHA1
                • SHA2
                • SHA3
                • Shake
                • SM3
              • List manipulation
                • Index list boolean
                • Index list float
                • Index list integer
                • Index list string
                • Index list timestamp
              • Networking
                • Defang IP Address
                • Defang URL
                • Extract IP Address
                • Fang IP Address
                • Fang URLs
                • IP to Hexadecimal
                • Parse URI
                • URL Decode
                • URL Encode
              • Other
                • Parse Int
              • String
                • Length
              • Text sample adding
                • Pad Lines
              • Utils
                • Byte to Human Readable
                • Count Occurrences
                • CRC8 Checksum
                • CRC16 Checksum
                • CRC24 Checksum
                • CRC32 Checksum
                • Credit Card Obfuscator
                • Filter
                • Find and Replace
                • Regex
                • Remove Whitespace
                • Reverse String
                • Shuffle
                • Sort
                • Substring
                • Swap Case
                • To Lower Case
                • To Upper Case
          • Flat JSON
          • JSON Transformation
          • JSON Unroll
          • Math Expression
          • Parser
            • PCL (Parser Configuration Language)
        • Utils
          • Unique
      • Data sinks
      • Bulk Changes
      • Publishing & Versioning
      • Test your Pipeline
    • Data sinks
      • Data sink Integrations
        • Amazon
          • Amazon S3
          • Amazon SQS
        • Microsoft
          • Azure Blob Storage
          • Azure Event Hubs
        • Devo
        • Google Cloud
          • Google BigQuery
          • Google Cloud Storage
          • Google Pub/Sub
        • HTTP
        • Jira
        • Mail
        • Mongo DB
        • Null
        • OpenTelemetry
        • PagerDuty
        • Pushover
        • Qradar
        • Relational Databases
        • ServiceNow
        • Slack
        • Splunk
          • Splunk HEC
        • Syslog
          • Syslog
          • Syslog Resilient
        • TCP
        • Telegram
        • Twilio
    • Alerts
  • YOUR VAULT
    • Enrichment
    • Data History
    • Actions
  • ADMINISTRATION
    • Tenant Menu
    • Global Settings
      • Your Account
      • Organization Settings
        • Secrets Management
      • Tenant
        • Authentication
        • Users
        • Activity Log
        • API Keys
  • MARKETPLACE
    • Onum Marketplace
      • Pulling Pipelines
        • CrowdStrike Event Stream Logs - Falcon API
        • Netskope Events Alert
        • OKTA System Log API
        • Sophos Connector SIEM
Powered by GitBook
On this page
  • Overview
  • Data sink configuration
  • Metadata
  • Metrics display
  • Configuration
  • Pipeline configuration
  • Output configuration

Was this helpful?

Export as PDF
  1. THE WORKSPACE
  2. Data sinks
  3. Data sink Integrations
  4. Microsoft

Azure Event Hubs

Most recent version: v0.0.1

PreviousAzure Blob StorageNextDevo

Last updated 4 days ago

Was this helpful?

See the changelog of this Data sink type .

Overview

Onum supports integration with Azure Event Hubs.

Azure Event Hubs is a real-time data ingestion that allows you to stream millions of events per second from any source to build dynamic data pipelines and immediately respond to business challenges.

Select Azure Event Hubs from the list of Data sink types and click Configuration to start.

Data sink configuration

Now you need to specify how and where to send the data, and how to establish a connection with Azure Storage.

Metadata

Enter the basic information for the new Data sink.

Parameters
Description

Name*

Enter a name for the new Data sink.

Description

Optionally, enter a description for the Data sink.

Tags

Add tags to easily identify your Data sink. Hit the Enter key after you define each tag.


Metrics display

Decide whether or not to include this Data sink info in the metrics and graphs of the Home area.


Configuration

Now, add the configuration to establish the connection.

Parameters
Description

Event Hub Namespace

The namespace is the container for your various event hubs. Click it to see the individual hubs it contains.

Event Hub Name

To see the individual Event Hubs in your Namespace, click it in the list to open its contents. Scroll down to the bottom to see the list of Event Hubs.

Find the event hub to connect to and enter the name in this field.

Connection String

To communicate with an event hub or a namespace, you need a connection string. Note that this is required if you select None in the Authentication Method option.

  1. Click the Event Hub name in the list to open it.

  2. In the left menu, go to Shared Access Policies.

  3. If no policy has been created for an event hub, create one with Manage, Send, or Listen access.

  4. Select the policy from the list.

  5. Select the copy button next to the Connection string-primary key field.

Depending on the version of Azure you are using, the corresponding field may have a different name, so to help you find it, look for the string with the same format:

Endpoint=sb://.servicebus.windows.net/; SharedAccessKeyName=RootManageSharedAccessKey; SharedAccessKey=

Authentication Method*

If an authentication method is required, select the method and enter the credentials of the selected method below. If not, select None.

SASL Authentication Parameters

Enter your SASL authentication parameters for Azure Event Hubs.

Parameters
Description

SASL Username

Username for SASL authentication. Note that this is only required if you select SASL in the Authentication Method option.

SASL Password

Authentication Token

Tenant ID

The unique Tenant ID associated with your Azure account. Note that this is only required if you select AAD Token in the Authentication Method option.

Client ID

The Client ID used for authenticating with Azure Active Directory. Note that this is only required if you select AAD Token in the Authentication Method option.

TLS Configuration

Enter your TLS authentication parameters for Azure Event Hubs.

Note that these parameters are only required if you select TLS in the Authentication Method option.

Parameters
Description

CA Certificate

Client Certificate

Batch Size

The number of messages to batch before sending to Event Hubs.

Batch Timeout

The maximum amount of time in milliseconds to wait before sending a batch.

Retry Attempts

Number of retry attempts before failing.

Retry Interval

Interval in milliseconds between retry attempts.

Click Finish when complete. Your new Data sink will appear in the Data sinks area list.

Pipeline configuration

When it comes to using this Data sink in a Pipeline, you must configure the following output parameters. To do it, simply click the Data sink on the canvas and select Configuration.

Output configuration

Parameters
Description

Message*

Choose the field that contains the data to be sent.

Click Save to save your configuration.

Add your SASL password from your or create one. Note that this is only required if you select SASL in the Authentication Method option.

Add your token from your or create one. Note that this is only required if you select SAS Token or AAD Token in the Authentication Method option.

Add your CA certificate from your or create one.

Add your client certificate from your or create one.

Secrets
Secrets
Secrets
Secrets
here