LogoLogo
WebsiteBlogLogin
  • Onum Docs
  • Use Cases
  • Videos
  • Release Notes
  • Welcome
  • Getting Started
    • About Onum
    • Architecture
    • Deployment
    • Getting Started with Onum
    • Understanding The Essentials
      • Cards and Table Views
      • Data Types
      • Graph Calculations
      • The Time Range Selector
    • Key Terminology
  • THE WORKSPACE
    • Home
    • Listeners
      • Cloud Listeners
      • Listener Integrations
        • Amazon S3
        • Amazon SQS
        • Apache Kafka
        • Azure Event Hubs
        • Cisco NetFlow
        • Google Cloud Storage
        • Google Pub/Sub
        • HTTP
        • HTTP Pull
          • Netskope integration
          • OKTA integration
          • Sophos integration
          • CrowdStrike integration
          • Cortex integration
        • Microsoft 365
        • OpenTelemetry
        • Syslog
        • TCP
        • Tick
      • Labels
    • Pipelines
      • Building a Pipeline
        • AI Assistant
          • AI Pipeline Assistant
          • AI Action Assistant
      • Listeners
      • Actions
        • Advanced
          • Anonymizer
          • Bring Your Own Code
          • Field Generator
          • For Each
          • Google DLP
          • HTTP Request
          • Redis
        • Aggregation
          • Accumulator
          • Group By
        • AI
          • Amazon GenAI
          • BLIP-2
          • Cog
          • Google GenAI
          • Llama
          • Replicate
        • Detection
          • Sigma Rules
        • Enrichment
          • Lookup
        • Filtering
          • Conditional
          • Sampling
        • Formatting
          • Message Builder
        • Schemas
          • OCSF
        • Transformation
          • Field Transformation
            • Field Transformation Operations
              • Arithmetic / Logic
                • Divide Operation
                • Median
                • Multiply Operation
                • Subtract Operation
                • Sum Operation
              • Code tidy
                • JSON Minify
              • Control characters
                • Escape String
                • Unescape String
              • Conversion
                • Convert Area
                • Convert Data Units
                • Convert Distance
                • Convert Mass
                • Convert Speed
                • List to String
                • String to List
              • Data format
                • From Base
                • From Base64
                • From Hex
                • To Base
                • To Base64
                • To Hex
              • Date / Time
                • From Unix Timestamp
                • To Timestamp
                • To Unix Timestamp
                • Translate Datetime Format
              • Encoding / Decoding
                • From Binary
                • To Binary
                • To Decimal
              • Encryption / Encoding
                • JWT Decode
              • File system permissions
                • Parse Unix file permissions
              • Format conversion
                • CSV to JSON
                • JSON to CSV
                • Protobuf to JSON
              • Hashing
                • Keccak
                • MD2
                • MD4
                • MD5
                • SHA0
                • SHA1
                • SHA2
                • SHA3
                • Shake
                • SM3
              • List manipulation
                • Index list boolean
                • Index list float
                • Index list integer
                • Index list string
                • Index list timestamp
              • Networking
                • Defang IP Address
                • Defang URL
                • Extract IP Address
                • Fang IP Address
                • Fang URLs
                • IP to Hexadecimal
                • Parse URI
                • URL Decode
                • URL Encode
              • Other
                • Parse Int
              • String
                • Length
              • Text sample adding
                • Pad Lines
              • Utils
                • Byte to Human Readable
                • Count Occurrences
                • CRC8 Checksum
                • CRC16 Checksum
                • CRC24 Checksum
                • CRC32 Checksum
                • Credit Card Obfuscator
                • Filter
                • Find and Replace
                • Regex
                • Remove Whitespace
                • Reverse String
                • Shuffle
                • Sort
                • Substring
                • Swap Case
                • To Lower Case
                • To Upper Case
          • Flat JSON
          • JSON Transformation
          • JSON Unroll
          • Math Expression
          • Parser
            • PCL (Parser Configuration Language)
        • Utils
          • Unique
      • Data sinks
      • Bulk Changes
      • Publishing & Versioning
      • Test your Pipeline
    • Data sinks
      • Data sink Integrations
        • Amazon S3
        • Amazon SQS
        • Azure Blob Storage
        • Azure Event Hubs
        • Devo
        • Google BigQuery
        • Google Cloud Storage
        • Google Pub/Sub
        • HTTP
        • Jira
        • Mail
        • Null
        • OpenTelemetry
        • PagerDuty
        • Pushover
        • Qradar
        • Relational Databases
        • ServiceNow
        • Slack
        • Splunk HEC
        • Syslog
        • Syslog Resilient
        • TCP
        • Telegram
        • Twilio
    • Alerts
  • YOUR VAULT
    • Enrichment
    • Data History
    • Actions
  • ADMINISTRATION
    • Tenant Menu
    • Global Settings
      • Your Account
      • Organization Settings
        • Secrets Management
      • Tenant
        • Authentication
        • Users
        • Activity Log
        • API Keys
  • MARKETPLACE
    • Onum Marketplace
      • Pulling Pipelines
        • CrowdStrike Event Stream Logs - Falcon API
        • Netskope Events Alert
        • OKTA System Log API
        • Sophos Connector SIEM
Powered by GitBook
On this page
  • Overview
  • Configuration
  • Metadata
  • Metrics display
  • Configuration
  • Output configuration
  • Compression
  • Passthrough
  • Dry run
  • Resiliency

Was this helpful?

Export as PDF
  1. THE WORKSPACE
  2. Data sinks
  3. Data sink Integrations

Syslog Resilient

Most recent version: v0.1.0

PreviousSyslogNextTCP

Last updated 9 hours ago

Was this helpful?

See the changelog of this Data sink type .

Note that this Data sink is only available in certain Tenants. Get in touch with us if you don't see it and want to access it.

Overview

Syslog Sink Resilient is a proof-of-concept sink that uses Syslog Sink v2.0.0 underneath. It differs from the base sink in that is has a special "fallback" port used to deliver events that could not be delivered to the destination due to connectivity issues. The event out of the fallback port will contain a field with the assembled the syslog message just so other actions may work with it w/o necessarily knowing about to handle syslog.


Configuration

Now you need to specify how and where to send the data and how to establish a connection with Syslog.

Metadata

Enter the basic information for the new Data sink.

Parameters
Description

Name*

Enter a name for the new Data sink.

Description

Optionally, enter a description for the Data sink.

Tags

Add tags to easily identify your Data sink. Hit the Enter key after you define each tag.


Metrics display

Decide whether or not to include this Data sink info in the metrics and graphs of the Home area.

Configuration

Now, add the configuration to establish the connection.

Parameters
Description

Protocol*

Onum supports TCP and UDP protocols.

Host*

Enter the IP address or hostname. Use 0.0.0.0 to indicate all.

Port*

Enter the destination IP port number.

Framing method*

This parameter defines how events are separated within Syslog. Choose between the various options.

  • octet-counting - Transmits all characters inside a syslog message.

  • non-transparent - Inserts a Syslog message into a frame and ends with a trailer character.

Trailer character code

The trailer is a single character, mostly ASCII LF.

Internal buffer size

Define the number of bytes allocated for buffering network data during transmission to Syslog.

Write timeout

Enter the number of milliseconds to wait before considering the request a timeout.

Idle timeout

Enter the milliseconds the connection remains open and idle before it is automatically terminated or closed.

Dial timeout

The maximum time (in ms) allowed for establishing a connection before the attempt is aborted.

Connection Time to Live

The maximum duration the connection remains active before it is forcibly closed, regardless of whether it is idle or in use.

Buffer Threshold

Bytes in the buffer before performing a non-blocking flush. The minimum value is 1, and the default value is 262144.

Delivery Timeout

Time in milisecons that the action can wait for the buffer to accept the event's data. The minimum value is 1, and the default value is 10000.

Flush attempts

Number of times the sink will re-attempt to flush its buffer. The minimum value is 1, and the default value is 3.

Connection attempts

Number of times we will reattempt connecting to the destination. The minimum value is 1, and the default value is 3.

TLS configuration

Here, you must select or create the secrets containing these values.

Parameter
Description

Certificate

This is the predefined TLS certificate.

Private key

The private key of the corresponding certificate.

CA chain

The path containing the CA certificates.

Skip TLS validations

Select true or false to validate or not.

Minimum TLS version

Choose the TLS version to use.

Subject Alternate Name to verify

If you have assigned your TLS configuration another name, enter it here.


Click Finish when complete.

Output configuration

When you use this Data sink in a Pipeline, you can configure the output parameters. This is where you give the message the required format to be processed in Syslog.

If your message already has the required format, toggle Passthrough to send the message exactly as it is received by the Data sink. Uncheck Passthrough to manually format the message.

Configure the following parameters to manually format the message:

Compression

Toggle ON to enable GZip compression on the message or No to send it on as is.

Passthrough

This sink has two modes of use; it can either assemble a syslog message by selecting a protocol and the event fields to use or it can work as a "passthrough" where it takes a valid syslog message from an event field and just delivers it to the destination.

Toggle OFF to select the desired RFC format (RFC-3164/RFC-5424) to use when sending via the syslog protocol.

Toggle ON to select an event field to use as the messaging format.

Dry run

Toggle ON to disable the delivery of the event whilst still being able to process it. This means you do not require a valid destination to use the Data sink, as it will not send the data

Resiliency

This sink is split into two parts: a producer and a consumer. The producer (the main pipeline goroutine) adds syslog messages to the sink's internal buffer. The consumer is a separate goroutine that sends those messages to the destination.

Toggling enable prevents the main routine from being blocked while messages are sent (unless the buffer is full) and allows a delivery timeout to stop the producer from waiting too long if the consumer is slow. Simply give it a name in the message out field.

here