Azure Blob Storage

Most recent version: v0.0.1

See the changelog of this Data sink type here.

Overview

Onum supports integration with Azure Blob Storage.

By integrating with Azure Storage, your organization leverages the advantages of Azure to enhance operational efficiency, reduce costs, and ensure the security and availability of data, all while scaling and innovating rapidly.

Select Azure Blob Storage from the list of Data sink types and click Configuration to start.

Data sink configuration

Now you need to specify how and where to send the data, and how to establish a connection with Azure Blob Storage.

Metadata

Enter the basic information for the new Data sink.

Parameters
Description

Name*

Enter a name for the new Data sink.

Description

Optionally, enter a description for the Data sink.

Tags

Add tags to easily identify your Data sink. Hit the Enter key after you define each tag.


Metrics display

Decide whether or not to include this Data sink info in the metrics and graphs of the Home area.


Configuration

Now, add the configuration to establish the connection.

Authentication

Parameters
Description

Storage account name*

Enter the name of the storage account to connect to.

  1. In the Azure Portal, search Storage accounts and click on it.

  2. A list of your storage accounts will appear.

  3. See the name in the list or click on the storage account you need and the Storage Account Name is displayed at the top of the page.

Access Key

Add the access key from your Secrets or create one. To find your access key:

  1. In the storage account menu, click Access Keys under the Security + Networking section.

  2. You will see Key1 and Key2 and their connection strings.

Connection string

Add the connection string from your Secrets or create one. To communicate with an event hub or a namespace, you need a connection string. Locate it here:

  1. Click the Event Hub name in the list to open it.

  2. In the left menu, go to Shared Access Policies.

  3. If no policy has been created for an event hub, create one with Manage, Send, or Listen access.

  4. Select the policy from the list.

  5. Select the copy button next to the Connection string-primary key field.

Depending on the version of Azure you are using, the corresponding field may have a different name, so to help you find it, look for the string with the same format:

Endpoint=sb://.servicebus.windows.net/; SharedAccessKeyName=RootManageSharedAccessKey; SharedAccessKey=

Azure Blob Configuration

After entering the general Azure Storage settings, you must specify a blob container to send to.

Parameters
Description

Container name*

Connect to the exact container in your storage unit.

  1. Click your storage account (as previously shown) and go to Data Storage > Containers.

  2. See the names of your existing containers.

Path format

The Azure Blob Storage Path Format follows a standard URL structure that depends on the storage account, container, and blob location.

  1. In the left menu, click Data Storage > Containers.

  2. Click the container where your blob is stored.

  3. Click on the blob (file) you wish to connect to.

The URL represents the full path. Use it to find the prefix and decide how to partition.

Parameters
Description

Prefix*

The path prefix found in the URL field.

Partition by*

Choose between year, month, day or hour.

Proxy configuration

If you use a proxy connection, set it here:

Parameters
Description

Proxy address

Enter your proxy address.

Proxy port

Required proxy port.

Proxy username

Add your proxy username from your Secrets or create one.

Proxy password

Add your proxy password from your Secrets or create one.

Proxy scheme

Set the required proxy scheme (HTTP or HTTPS).

Click Finish when complete. Your new Data sink will appear in the Data sinks area list.

Pipeline configuration

When it comes to using this Data sink in a Pipeline, you must configure the following output parameters. To do it, simply click the Data sink on the canvas and select Configuration.

Output configuration

Parameter
Description

Event field*

Select the incoming field containing the event to send on.

Click Save to save your configuration.

Last updated

Was this helpful?