LogoLogo
WebsiteBlogLogin
  • Onum Docs
  • Use Cases
  • Videos
  • Release Notes
  • Welcome
  • Getting Started
    • About Onum
    • Architecture
    • Deployment
    • Getting Started with Onum
    • Understanding The Essentials
      • Cards and Table Views
      • Data Types
      • Graph Calculations
      • The Time Range Selector
    • Key Terminology
  • THE WORKSPACE
    • Home
    • Listeners
      • Cloud Listeners
      • Listener Integrations
        • Amazon SQS
        • Amazon S3
        • Apache Kafka
        • Azure Event Hubs
        • Cisco NetFlow
        • Google Cloud Storage
        • Google Pub/Sub
        • HTTP
        • HTTP Pull
        • Microsoft 365
        • OpenTelemetry
        • Syslog
        • TCP
      • Labels
    • Pipelines
      • Building a Pipeline
        • AI Assistant
          • AI Pipeline Assistant
          • AI Action Assistant
      • Listeners
      • Actions
        • Advanced
          • Anonymizer
          • Bring Your Own Code
          • Field Generator
          • For Each
          • Google DLP
          • HTTP Request
          • Redis
        • Aggregation
          • Accumulator
          • Group By
        • AI
          • Amazon GenAI
          • BLIP-2
          • Cog
          • Google GenAI
          • Llama
          • Replicate
        • Detection
          • Sigma Rules
        • Enrichment
          • Lookup
        • Filtering
          • Conditional
          • Sampling
        • Formatting
          • Message Builder
        • Transformation
          • Field Transformation
            • Field Transformation Operations
              • Arithmetic / Logic
                • Divide Operation
                • Median
                • Multiply Operation
                • Subtract Operation
                • Sum Operation
              • Code tidy
                • JSON Minify
              • Control characters
                • Escape String
                • Unescape String
              • Conversion
                • Convert Area
                • Convert Data Units
                • Convert Distance
                • Convert Mass
                • Convert Speed
                • List to String
                • String to List
              • Data format
                • From Base
                • From Base64
                • From Hex
                • To Base
                • To Base64
                • To Hex
              • Date / Time
                • From Unix Timestamp
                • To Timestamp
                • To Unix Timestamp
                • Translate Datetime Format
              • Encoding / Decoding
                • From Binary
                • To Binary
                • To Decimal
              • Encryption / Encoding
                • JWT Decode
              • File system permissions
                • Parse Unix file permissions
              • Format conversion
                • CSV to JSON
                • JSON to CSV
              • Hashing
                • Keccak
                • MD2
                • MD4
                • MD5
                • SHA0
                • SHA1
                • SHA2
                • SHA3
                • Shake
                • SM3
              • List manipulation
                • Index list boolean
                • Index list float
                • Index list integer
                • Index list string
                • Index list timestamp
              • Networking
                • Defang IP Address
                • Defang URL
                • Extract IP Address
                • Fang IP Address
                • Fang URLs
                • IP to Hexadecimal
                • Parse URI
                • URL Decode
                • URL Encode
              • Other
                • Parse Int
              • String
                • Length
              • Text sample adding
                • Pad Lines
              • Utils
                • Byte to Human Readable
                • Count Occurrences
                • CRC8 Checksum
                • CRC16 Checksum
                • CRC24 Checksum
                • CRC32 Checksum
                • Credit Card Obfuscator
                • Filter
                • Find and Replace
                • Regex
                • Remove Whitespace
                • Reverse String
                • Shuffle
                • Sort
                • Substring
                • Swap Case
                • To Lower Case
                • To Upper Case
          • Flat JSON
          • JSON Transformation
          • JSON Unroll
          • Math Expression
          • Parser
            • PCL (Parser Configuration Language)
        • Utils
          • Unique
      • Data sinks
      • Bulk Changes
      • Publishing & Versioning
      • Test your Pipeline
    • Data sinks
      • Data sink Integrations
        • Amazon S3
        • Amazon SQS
        • Azure Blob Storage
        • Azure Event Hubs
        • Devo
        • Google BigQuery
        • Google Cloud Storage
        • Google Pub/Sub
        • HTTP
        • Jira
        • Mail
        • Null
        • OpenTelemetry
        • PagerDuty
        • Pushover
        • Qradar
        • Relational Databases
        • ServiceNow
        • Slack
        • Splunk HEC
        • Syslog
        • TCP
        • Telegram
        • Twilio
    • Alerts
  • YOUR VAULT
    • Enrichment
    • Data History
    • Actions
  • ADMINISTRATION
    • Tenant Menu
    • Global Settings
      • Your Account
      • Organization Settings
        • Secrets Management
      • Tenant
        • Authentication
        • Users
        • Activity Log
        • API Keys
  • MARKETPLACE
    • Onum Marketplace
      • Pulling Pipelines
        • Netskope Events Alert
        • OKTA System Log API
        • Sophos Connector SIEM
Powered by GitBook
On this page
  • Overview
  • Configuration
  • Metadata
  • Metrics display
  • Output configuration

Was this helpful?

Export as PDF
  1. THE WORKSPACE
  2. Data sinks
  3. Data sink Integrations

HTTP

Most recent version: v1.0.1

PreviousGoogle Pub/SubNextJira

Last updated 1 month ago

Was this helpful?

See the changelog of this Data sink type .

Overview

Onum supports integration with HTTP protocols.

Select HTTP from the list of Data sink types and click Configuration to start.

Configuration

Now you need to specify how and where to send the data, and how to establish a connection with HTTP.

Metadata

Enter the basic information for the new Data sink.

Parameters
Description

Name*

Enter a name for the new Data sink.

Description

Optionally, enter a description for the Data sink.

Tags

Add tags to easily identify your Data sink. Hit the Enter key after you define each tag


Metrics display

Output configuration

Output configuration

Parameter
Description

HTTP method*

The method used to connect to the server.

URL*

The URL to send HTTP requests.

Message

This is the field containing the message you wish to send on.

Content type

Set the request content type. Choose between:

  • text/plain - The message body contains plain text.

  • application/json - The message body is formatted as JSON. This is the default option.

  • application/xml - The message body is formatted as XML.

  • text/html - The message body contains HTML.

  • application/x-ndjson - The message body is formatted as NDJSON.

Support special characters

Set this to true to allow special characters in HTTP requests. Mostly used with application/x-ndjson content type.

HTTP headers

Map of header key-value pairs to be included in the request.

Bulk configuration

HTTP bulk configuration refers to setting up an API or system to handle multiple requests or large amounts of data efficiently in a single operation. Instead of sending multiple individual HTTP requests, use the bulk settings to send a single request containing multiple actions.

For example, this sends three user records in one request instead of three separate requests.

POST /api/bulk/users HTTP/1.1
Content-Type: application/json

[
  {"id": 1, "name": "Alice"},
  {"id": 2, "name": "Bob"},
  {"id": 3, "name": "Charlie"}
]
Parameter
Description

Bulk allow*

true to set a bulk amount or false to ignore.

Delimiter

Optionally, choose a delimiter to separate the individual records in the bulk data file. Choose between:

  • Manual delimeter - Each record will appear on its own line. This is the default option. Enter the required delimeter in the Manual delimiter field that appears. The default value is \n

  • Json list - Use a comma (,) to separate individual JSON objects.

Maximum number of buffers per server URL

Multiple buffers can be assigned to a single URL to prevent excessive memory usage. The default and maximim value is 50.

Event amount

Enter the bulk amount to allow through.

Event time limit

If the bulk amount is not reached, enter the seconds to wait before sending through the accumulated events.

Authentication configuration

Parameter
Description

Authentication type*

Choose the required authentication type:

  • None - Choose this if no authentication is required.

  • Basic - Enter the required Username and Password.

  • Bearer - If you're using a bearer Token, select it from the list.

  • API key - If you're using API credentials, enter your API key name and choose the required API key value.

  • OAuth2 - Choose if you want to set OAuth2 authentication. Set the following:

    • OAuth URL* - OAuth server URL.

    • OAuth method* - OAuth method used when sending requests to the server.

    • Send body as - Select how to send the request body to the server From URL encoded or JSON).

    • OAuth request body - Body that will be sent to auth server.

    • OAuth token path* - Path to token in response body from auth server.

    • Query key / Value pairs - Set of query keys and values. Use this also in case you are sending the request with From URL encoded content type.

    • Header key / Value pairs - Set of header keys and values.

TLS configuration

Activate the TLS Configuration toggle to enable TLS and configure these parameters:

Parameter
Description

Minimum TLS version*

Choose the TLS version to use.

Certificate

Predefined TLS certificate.

Private key

Private key of the corresponding certificate.

Skip TLS validations

Activate to skip all TLS validations.

CA Chain

Path containing the CA certificates.

Proxy configuration

If your organization uses proxy servers, establish the connection here:

Parameter
Description

Proxy scheme

Choose the field to set in the proxy scheme (HTTP or HTTPS)

Username

Username used in the proxy.

Password

Password used in the proxy.

URL

Proxy server and port.

Rate limit

Parameter
Description

Maximum requests

Set a limit on the number of requests per second to launch on the server. The maximum value is 100.

Select Save and see your Data sink appear in the list.

Decide whether or not to include this Data sink info in the metrics and graphs of the area.

When it comes to using this Data sink in a , you must configure the following output parameters. To do it, simply click the Data sink on the canvas and select Configuration.

Home
Pipeline
here