Extract URLs

Description

This operation extracts URLs from a given input text, supporting HTTP, HTTPs, FTP and other protocols.

---

Data types

These are the input/output expected data types for this operation:

Input data

- Input events to URLs from.

Output data

- List of comma-separated URLs.

---

Parameters

These are the parameters you need to configure to use this operation (mandatory parameters are marked with a *):

Protocol Must Be Present

Choose true if you want to extract only URLs that start with a protocol (http://, https://, etc.). The default value is false.

---

Example

Suppose you want to extract all the URLs from a given series of events. To do it:

1. In your Pipeline, open the required Action configuration and select the input Field.

2. In the Operation field, choose Extract URLs.

3. Set Protocol Must Be Present to false.

4. Give your Output field a name and click Save.

For example, given this input text:

Check the latest sales figures at reports.example.com before tomorrow's call. The customer feedback survey (survey.fictional-company.net) closes Friday. Product documentation has moved to docs.nonexistent-tech.org

You'll get the following:

reports.example.com,survey.fictional-company.net,docs.nonexistent-tech.org

You can try out operations with specific values using the Input field above the operation. You can enter the value in the example above and check the result in the Output field.