LogoLogo
WebsiteBlogLogin
  • Onum Docs
  • Use Cases
  • Videos
  • Release Notes
  • Welcome
  • Getting Started
    • About Onum
    • Architecture
    • Deployment
    • Getting Started with Onum
    • Understanding The Essentials
      • Cards and Table Views
      • Data Types
      • Graph Calculations
      • The Time Range Selector
    • Key Terminology
  • THE WORKSPACE
    • Home
    • Listeners
      • Cloud Listeners
      • Listener Integrations
        • Amazon SQS
        • Amazon S3
        • Apache Kafka
        • Azure Event Hubs
        • Cisco NetFlow
        • Google Pub/Sub
        • HTTP
        • HTTP Pull
        • Microsoft 365
        • OpenTelemetry
        • Syslog
        • TCP
      • Labels
    • Pipelines
      • Building a Pipeline
        • AI Assistant
          • AI Pipeline Assistant
          • AI Action Assistant
      • Listeners
      • Actions
        • Advanced
          • Anonymizer
          • Bring Your Own Code
          • Field Generator
          • For Each
          • Google DLP
          • HTTP Request
          • Redis
        • Aggregation
          • Accumulator
          • Group By
        • AI
          • Amazon GenAI
          • BLIP-2
          • Cog
          • Google GenAI
          • Llama
          • Replicate
        • Detection
          • Sigma Rules
        • Enrichment
          • Lookup
        • Filtering
          • Conditional
          • Sampling
        • Formatting
          • Message Builder
        • Transformation
          • Field Transformation
            • Field Transformation Operations
              • Arithmetic / Logic
                • Divide Operation
                • Median
                • Multiply Operation
                • Subtract Operation
                • Sum Operation
              • Code tidy
                • JSON Minify
              • Control characters
                • Escape String
                • Unescape String
              • Conversion
                • Convert Area
                • Convert Data Units
                • Convert Distance
                • Convert Mass
                • Convert Speed
                • List to String
                • String to List
              • Data format
                • From Base
                • From Base64
                • From Hex
                • To Base
                • To Base64
                • To Hex
              • Date / Time
                • From Unix Timestamp
                • To Timestamp
                • To Unix Timestamp
                • Translate Datetime Format
              • Encoding / Decoding
                • From Binary
                • To Binary
                • To Decimal
              • Encryption / Encoding
                • JWT Decode
              • File system permissions
                • Parse Unix file permissions
              • Format conversion
                • CSV to JSON
                • JSON to CSV
              • Hashing
                • Keccak
                • MD2
                • MD4
                • MD5
                • SHA0
                • SHA1
                • SHA2
                • SHA3
                • Shake
                • SM3
              • Networking
                • Defang IP Address
                • Defang URL
                • Extract IP Address
                • Fang IP Address
                • Fang URLs
                • IP to Hexadecimal
                • Parse URI
                • URL Decode
                • URL Encode
              • Other
                • Parse Int
              • String
                • Length
              • Text sample adding
                • Pad Lines
              • Utils
                • Byte to Human Readable
                • Count Occurrences
                • CRC8 Checksum
                • CRC16 Checksum
                • CRC24 Checksum
                • CRC32 Checksum
                • Credit Card Obfuscator
                • Filter
                • Find and Replace
                • Regex
                • Remove Whitespace
                • Reverse String
                • Shuffle
                • Sort
                • Substring
                • Swap Case
                • To Lower Case
                • To Upper Case
          • Flat JSON
          • JSON Transformation
          • JSON Unroll
          • Math Expression
          • Parser
            • PCL (Parser Configuration Language)
        • Utils
          • Unique
      • Data sinks
      • Bulk Changes
      • Publishing & Versioning
      • Test your Pipeline
    • Data sinks
      • Data sink Integrations
        • Amazon S3
        • Amazon SQS
        • Azure Blob Storage
        • Azure Event Hubs
        • Devo
        • Google BigQuery
        • Google Cloud Storage
        • Google Pub/Sub
        • HTTP
        • Jira
        • Mail
        • Null
        • OpenTelemetry
        • PagerDuty
        • Pushover
        • Qradar
        • Relational Databases
        • ServiceNow
        • Slack
        • Splunk HEC
        • Syslog
        • TCP
        • Telegram
        • Twilio
    • Alerts
  • YOUR VAULT
    • Enrichment
    • Data History
    • Actions
  • ADMINISTRATION
    • Tenant Menu
    • Global Settings
      • Your Account
      • Organization Settings
        • Secrets Management
      • Tenant
        • Authentication
        • Users
        • Activity Log
  • MARKETPLACE
    • Onum Marketplace
      • Pulling Pipelines
        • Netskope Events Alert
        • OKTA System Log API
        • Sophos Connector SIEM
Powered by GitBook
On this page

Was this helpful?

Export as PDF
  1. THE WORKSPACE
  2. Pipelines
  3. Actions
  4. Transformation
  5. Field Transformation

Field Transformation Operations

PreviousField TransformationNextArithmetic / Logic

Last updated 13 days ago

Was this helpful?

A comprehensive list of the operations available in the Action.

Operation
Description
Example

Converts a size in bytes to a human-readable string.

  • Input data - 134367

  • Output data - 131.22 KiB

Converts values from one unit of measurement to another.

  • Input data - 5000

  • Input units - Square foot (sq ft)

  • Output units - Square metre (sq m)

  • Output data - 464.515215

Converts a unit of data to another format.

  • Input data - 2

  • Input units - Megabits (Mb)

  • Output units - Kilobytes (KB)

  • Output data - 250

Converts values from one unit of length to another.

  • Input data - 100

  • Input units - Metres (m)

  • Output units - Yards (yd)

  • Output data - 109.3613298

Converts values from one unit of mass to another.

  • Input data - 100

  • Input units - Kilogram (kg)

  • Output units - Pound (lb)

  • Output data - 220.4622622

Converts values from one unit of speed to another.

  • Input data - 200

  • Input units - Kilometres per hour (km/h)

  • Output units - Miles per hour (mph)

  • Output data - 124.2841804

Counts the amount of times a given string occurs in your input data.

  • Input data - This is a sample test

  • Search - test

  • Search Type - simple

  • Output data - 1

Calculates an 8-bit Cyclic Redundancy Check (CRC) value for a given input.

  • Input data - hello 1234

  • Output data - C7

Calculates an 16-bit Cyclic Redundancy Check (CRC) value for a given input.

  • Input data - hello 1234

  • Output data - 57D4

Calculates an 24-bit Cyclic Redundancy Check (CRC) value for a given input.

  • Input data - hello 1234

  • Output data - 3B6473

Calculates an 32-bit Cyclic Redundancy Check (CRC) value for a given input.

  • Input data - hello 1234

  • Output data - 7ED8D648

Obfuscates all digits of a credit card number except for the last 4 digits.

  • Input data - 1111222233334444

  • Output data - ************4444

Converts a CSV file to JSON format.

  • Input data -

First name,Last name,Age,City John,Wick,20,New-York Tony,Stark,30,Madrid

  • Cell delimiter - ,

  • Format - Array of dictionaries

  • Output data -

[ { "First name": "John", "Last name": "Wick", "Age": "20", "City": "New-York" }, { "First name": "Tony", "Last name": "Stark", "Age": "30", "City": "Madrid" } ]

Defangs an IP address to prevent it from being recognized.

  • Input data - 192.168.1.1

  • Output data - 192[.]168[.]1[.]1

Defangs a URL to prevent it from being recognized as a clickable link.

  • Input data - https://example.com

  • Escape Dots - true

  • Escape HTTP - true

  • Escape ://* - false

  • Process Type - Everything

  • Output data - hxxps://example[.]com

Divides a list of numbers provided in the input string, separated by a specific delimiter.

  • Input data - 26:2:4

  • Delimiter - Colon

  • Output data - 3.25

Escapes specific characters in a string.

  • Input data - She said, "Hello, world!"

  • Escape Level - Special chars

  • Escape Quote - Double

  • JSON compatible -false

  • Output data - She said, \"Hello, world!\"

Extracts all the IPv4 and IPv6 addresses from a block of text or data.

  • Input data -

User logged in from 192.168.1.1. Another login detected from 10.0.0.5.

  • Output data -

192.168.1.1,10.0.0.5

Makes defanged IP addresses valid.

  • Input data - 192[.]168[.]1[.]1

  • Output data - 192.168.1.1

Makes defanged URLs valid.

  • Input data - hxxps://example[.]com

  • Escape Dots - true

  • Escape HTTP - true

  • Escape ://* - false

  • Process Type - Everything

  • Output data - https://example.com

Splits the input string using a specified delimiter and filters.

  • Input data -

Error: File not found Warning: Low memory Info: Operation completed Error: Disk full

  • Delimiter - Line feed

  • Regex - ^Error

  • Invert - false

  • Output data -

Error: File not found Error: Disk full

Finds values in a string and replace them with others.

  • Input data - The server encountered an error while processing your request.

  • Substring to find - error

  • Replacement - issue

  • Global Match - true

  • Case Insensitive - true

  • Multiline - false

  • Dot Matches All - false

  • Output data - The server encountered an issue while processing your request.

Converts a number from a specified base (or radix) into its decimal form.

  • Input data - 100

  • Radix (Base) - 2

  • Output data - 4

Decodes data from a Base64 string back into its raw format.

  • Input data - SGVsbG8sIE9udW0h

  • Strict Mode - true

  • Output data - Hello, Onum!

Decodes a binary string into plain text.

  • Input data - 01001000 01101001

  • Delimiter - Space

  • Byte Length - 8

  • Output data - Hi

Converta hexadecimal-encoded data back into its original form.

  • Input data - 48 65 6c 6c 6f 20 57 6f 72 6c 64

  • Delimiter - Space

  • Output data - Hello World

Converts a timestamp into a human-readable date string.

  • Input data - 978346800

  • Time Unit - Seconds

  • Timezone Output - UTC

  • Format Output - Mon 2 January 2006 15:04:05 UTC

  • Output data - Mon 1 January 2001 11:00:00 UTC

Converts an IP address (either IPv4 or IPv6) to its hexadecimal representation.

  • Input data - 192.168.1.1

  • Output data - c0a80101

Reduces the size of a JSON file by removing unnecessary characters from it.

  • Input data -

{ "name": "John Doe", "age": 30, "isActive": true, "address": { "city": "New York", "zip": "10001" } }

  • Output data -

{"name":"John Doe","age":30,"isActive":true,"address":{"city":"New York","zip":"10001"}}

Converts a JSON file to CSV format.

  • Input data -

[ { "First name": "John", "Last name": "Wick", "Age": "20", "City": "New-York" }, { "First name": "Tony", "Last name": "Stark", "Age": "30", "City": "Madrid" } ]

  • Cell delimiter - ,

  • Row delimiter - /n

  • Output data -

First name,Last name,Age,City John,Wick,20,New-York Tony,Stark,30,Madrid

Decodes the payload in a JSON Web Token string.

  • Input data - eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzdWIiOiIxMjM0NTY3ODkwIiwibmFtZSI6IkpvaG4gRG9lIiwiaWF0IjoxNTE2MjM5MDIyfQ.SflKxwRJSMeKKF2QT4fwpMeJf36POk6yJV_adQssw5c

  • Output data - {"sub":"1234567890","name":"John Doe","iat":1516239022}

Generates a Keccak cryptographic hash function from a given input.

  • Input data - Hello World!

  • Size - 256

  • Output data -3ea2f1d0abf3fc66cf29eebb70cbd4e7fe762ef8a09bcc06c8edf641230afec0

Returns the number of Unicode characters in your input strings.

  • Input data - hello world!

  • Output data - 12

Converts a list of comma-separated values into a string of values divided by a specific separator.

  • Input data - hello,my,world

  • Separator - /

  • Output data - hello/my/world

Produces a MD2 hash string from a given input.

  • Input data - Hello World!

  • Output data - 315f7c67223f01fb7cab4b95100e872e

Produces a MD4 hash string from a given input.

  • Input data - Hello World!

  • Output data -b2a5cc34fc21a764ae2fad94d56fadf6

Produces a MD5 hash string from a given input.

  • Input data - Hello World!

  • Output data -ed076287532e86365e841e92bfc50d8c

Calculates the median of given values, separated by a specific delimiter.

  • Input data - 10, 5, 20, 15, 25

  • Delimiter - ,

  • Output data - 15

Calculates the result of the multiplication of given values, separated by a specific delimiter.

  • Input data - 2, 3, 5

  • Delimiter - ,

  • Output data - 30

Pads each input line with a specified number of characters.

  • Input data - Apple Banana Cherry

  • Pad position - Start

  • Pad line - 7

  • Character - >>>

  • Output data -

>>> >>>Apple >>> >>>Banana >>> >>>Cherry

Parses a string and returns an integer of the specified base.

  • Input data - 100

  • Base - 2

  • Output data -4

Takes Unix file permission strings and converts them to code format or vice versa.

  • Input data - -rwxr-xr--

  • Output data -

Textual representation: -rwxr-xr-- Octal representation: 0754 +---------+-------+-------+-------+ | | User | Group | Other | +---------+-------+-------+-------+ | Read | X | X | X | +---------+-------+-------+-------+ | Write | X | | | +---------+-------+-------+-------+ | Execute | X | X | | +---------+-------+-------+-------+

Analyzes a URI into its individual components.

  • Input data -

https://user:pass@example.com:8080/path/to/resource?key=value#fragment

  • Output data -

Scheme: https Host: example.com:8080 Path: /path/to/resource Arguments: map[key:[value]] User: user Password: pass

Extracts or manipulates parts of your input strings that match a specific regular expression pattern.

  • Input data - 100

  • Base - 2

  • Output data -4

Removes whitespace and other characters characters from a string.

  • Input data -

Hello World!

This is a test.

  • Spaces - true

  • Carriage returns - false

  • Line feeds - true

  • Tabs - false

  • Form feeds - false

  • Full stops - true

  • Output data -

HelloWorld!Thisisatest

Reverses the order of the characters in a string.

  • Input data - Hello World!

  • Reverse mode - Character

  • Output data - !dlroW olleH

Returns the SHA0 hash of a given string.

  • Input data - Hello World!

  • Output data - 1261178ff9a732aacfece0d8b8bd113255a57960

Returns the SHA1 hash of a given string.

  • Input data - Hello World!

  • Output data - 2ef7bde608ce5404e97d5f042f95f89f1c232871

Returns the SHA2 hash of a given string.

  • Input data - Hello World!

  • Size - 512

  • Output data - f4d54d32e3523357ff023903eaba2721e8c8cfc7702663782cb3e52faf2c56c002cc3096b5f2b6df870be665d0040e9963590eb02d03d166e52999cd1c430db1

Returns the SHA3 hash of a given string.

  • Input data - Hello World!

  • Size - 512

  • Output data - 32400b5e89822de254e8d5d94252c52bdcb27a3562ca593e980364d9848b8041b98eabe16c1a6797484941d2376864a1b0e248b0f7af8b1555a778c336a5bf48

Returns the SHAKE hash of a given string.

  • Input data - Hello World!

  • Capacity - 256

  • Size - 512

  • Output data - 35259d2903a1303d3115c669e2008510fc79acb50679b727ccb567cc3f786de3553052e47d4dd715cc705ce212a92908f4df9e653fa3653e8a7855724d366137

Shuffles the characters of a given string.

  • Input data - Hello, World!

  • Delimiter - Comma

  • Output data - eollH,ro!ld W

Returns the SM3 cryptographic hash function of a given string.

  • Input data - Hello World!

  • Length - 64

  • Output data - 0ac0a9fef0d212aa

Sorts a list of strings separated by a specified delimiter according to the provided sorting order.

  • Input data - banana,apple,orange,grape

  • Delimiter - Comma

  • Order - Alphabetical (case sensitive)

  • Reverse - false

  • Output data - apple,banana,grape,orange

Converts a string composed of values separated by a specific separator into a list of comma-separated values.

  • Input data - hello/my/world

  • Separator - /

  • Output data - hello,my,world

Extracts characters from a given string.

  • Input data - +34678987678

  • Start Index - 3

  • Length - 9

  • Output data - 678987678

Calculates the result of the subtraction of given values, separated by a specific delimiter.

  • Input data - 10, 5, 2

  • Delimiter - Comma

  • Output data - 3

Calculates the sum of given values, separated by a specific delimiter.

  • Input data - 10, 5, 2

  • Delimiter - Comma

  • Output data - 17

Swaps the case of a given string.

  • Input data - Hello World!

  • Output data - hELLO wORLD!

Converts a number into its representation in a specified numeric base (or radix).

  • Input data - 100

  • Radix (Base) - 2

  • Output data - 1100100

Encodes raw data into an ASCII Base64 string.

  • Input data - Hello, Onum!

  • Output data - SGVsbG8sIE9udW0h

Converts a text string into its binary representation.

  • Input data - Hello

  • Delimiter - Comma

  • Byte Length - 8

  • Output data - 01001000,01100101,01101100,01101100,01101111

Converts a text string into its ordinal integer decimal representation.

  • Input data - Hello

  • Delimiter - Comma

  • Support signed values - false

  • Output data - 72,101,108,108,111

Converts a string to its corresponding hexadecimal code.

  • Output data - Hello World!

  • Delimiter - Space

  • Bytes per line - 0

  • Input data - 48 65 6c 6c 6f 20 57 6f 72 6c 64

Converts the characters of a string to lower case.

  • Input data - Hello World!

  • Output data - hello world!

Transforms a string representing a date into a timestamp.

  • Input data - 2006-01-02

  • Format - DateOnly

  • Output data - 2006-01-02T00:00:00Z

Parses a datetime string in UTC and returns the corresponding Unix timestamp.

  • Input data - 2006-01-02 15:04:05

  • Unit - Seconds

  • Output data - 1136214245

Converts the characters of a string to upper case.

  • Input data - Hello World!

  • Output data - HELLO WORLD!

Converts a date and time from one format to another.

  • Input data - 05-20-2023 10:10:45

  • Input Format - 01-02-2006 15:04:05

  • Input Timezone - UTC+1

  • Output Format - Mon, 2 Jan 2006 15:04:05 +0000

  • Output Timezone - UTC+1

  • Output data - Sat, 20 May 2023 10:10:45 +0000

Removes escape characters from a given string.

  • Input data - She said, \"Hello, world!\"

  • Output data - She said, "Hello, world!"

Decodes a URL and returns its corresponding URL-decoded string.

  • Input data - https%3A%2F%2Fexample.com%2Fsearch%3Fq%3DHello+World%21

  • Output data - https://example.com/search?q=Hello World!

Encodes a URL-decoded string back to its original URL format,

  • Input data - https://example.com/search?q=Hello World!

  • Output data - https://example.com/search?q=Hello%20World!

Field Tranformation
Byte to Human Readable
Convert Area
Convert Data Units
Convert Distance
Convert Mass
Convert Speed
Count Occurrences
CRC8 Checksum
CRC16 Checksum
CRC24 Checksum
CRC32 Checksum
Credit Card Obfuscator
CSV to JSON
Defang IP Address
Defang URL
Divide Operation
Escape String
Extract IP Address
Fang IP Address
Fang URLs
Filter
Find and Replace
From Base
From Base64
From Binary
From Hex
From UNIX Timestamp
IP to hexadecimal
JSON Minify
JSON to CSV
JWT Decode
Keccak
Length
List to String
MD2
MD4
MD5
Median
Multiply Operation
Pad Lines
Parse Int
Parse Unix File Permissions
Parse URI
Regex
Remove Whitespace
Reverse String
SHA0
SHA1
SHA2
SHA3
Shake
Shuffle
SM3
Sort
String to List
Substring
Subtract Operation
Sum Operation
Swap Case
To Base
To Base64
To Binary
To Decimal
To Hex
To Lower Case
To Timestamp
To Unix Timestamp
To Upper Case
Translate Datetime Format
Unescape String
URL Decode
URL Encode