Send data to Azure Blob Storage
Most recent version: v0.0.1
Overview
Onum supports integration with Azure Blob Storage.
By integrating with Azure Storage, your organization leverages the advantages of Azure to enhance operational efficiency, reduce costs, and ensure the security and availability of data, all while scaling and innovating rapidly.
Prerequisites
A valid Microsoft Azure subscription
An Azure Resource Group
A Storage Account with the Blob service enabled.
A Container. Create this in the the Azure Portal > Storage Account > Containers > + Container.
Azure Blob Storage Setup
Once you have your project to connect to, make sure your user or service account has the proper roles e.g.
roles/storage.adminGo to Azure Portal > IAM > Add role assignment.
Onum setup
Log in to your Onum tenant and click Data Sinks> New Data sink.
Double-click the Azure Blob Storage Sink.
Enter a Name for the new Data Sink. Optionally, add a Description and some Tags to identify the Sink.
Decide whether or not to include this Data sink info in the metrics and graphs of the Home area.
Enter the Storage account name* to connect to.
In the Azure Portal, search Storage accounts and click on it.
A list of your storage accounts will appear.
See the name in the list or click on the storage account you need and the Storage Account Name is displayed at the top of the page.
Add the authentication credentials
Add the Access Key from your Secrets or create one. To find your access key:
In the storage account menu, click Access Keys under the Security + Networking section.
You will see Key1 and Key2 and their connection strings.
Add the Connection string from your Secrets or create one. To communicate with an event hub or a namespace, you need a connection string. Locate it here:
Click the Event Hub name in the list to open it.
In the left menu, go to Shared Access Policies.
If no policy has been created for an event hub, create one with Manage, Send, or Listen access.
Select the policy from the list.
Select the copy button next to the Connection string-primary key field.
Depending on the version of Azure you are using, the corresponding field may have a different name, so to help you find it, look for the string with the same format:
Endpoint=sb://.servicebus.windows.net/; SharedAccessKeyName=RootManageSharedAccessKey; SharedAccessKey=
Click New secret to create a new one:
Give the secret a Name.
Turn off the Expiration date option.
Click Add new value and paste the secret corresponding to the JWT token you generated before. Remember that the token will be added in the Zscaler configuration.
Click Save.
Learn more about secrets in Onum in this article.
After entering the general Azure Storage settings, you must specify a blob container to send to.
Connect to the exact Container name* in your storage unit.
Click your storage account (as previously shown) and go to Data Storage > Containers.
See the names of your existing containers.
The Azure Blob Storage Path Format follows a standard URL structure that depends on the storage account, container, and blob location.
In the left menu, click Data Storage > Containers.
Click the container where your blob is stored.
Click on the blob (file) you wish to connect to.
The URL represents the full path. Use it to find the prefix and decide how to partition.
The path Prefix* is found in the URL field.
Partition by* year, month, day or hour.
Proxy configuration
If you use a proxy connection, set it here:
Click Create data sink when complete.
Your new Data sink will appear in the Data sinks area list.
Pipeline configuration
When it comes to using this Data sink in a Pipeline, you must configure the following output parameters. To do it, simply click the Data sink on the canvas and select Configuration.
Output configuration
Event field*
Select the incoming field containing the event to send on.
Click Save to save your configuration.
Last updated
Was this helpful?