Enrichment
Enrich your data using lookup tables
Last updated
Was this helpful?
Enrich your data using lookup tables
Last updated
Was this helpful?
The Onum Enrichment feature allows you to upload tables and use them as lookups to enhance existing data by adding new information from external sources to your Pipelines.
Go to Your Vault > Enrichment to start creating your lookups.
You will see a general overview of all the lookups uploaded in your Tenant and the events generated, if there are any. Here's what you will find:
Each lookup card displays the following information:
The Key column assigned to your lookup upon upload.
The total number of columns it contains.
The size of the lookup (in KB).
When your lookup was last updated.
The lookup version and any tags assigned to it. You can create these tags here, by clicking Add tag or the number that indicates the tags added. Press the Enter key to confirm the tag, then Save.
Follow these steps to create a new lookup table:
Click the New enrichment button at the top right corner of the Enrichment area.
Enter a unique Name for your new lookup.
Optionally, add a Description and any Tags to identify your uploaded data easily.
Click to upload your file or drag it to add it. You can include a Version description for the first version of your lookup.
You'll see your lookup preview with the data types of each column. You can click the ellipsis button and select Change type if you want to modify any of your column types.
To avoid performance problems, note that you will only see a preview of the columns of your lookups so you can choose your key column.
Click the header of the column you want to set as key. The key column is the field in the lookup table that will be used to match the original data. Additional values will be added to the original table whenever there is a match between the key column values and the original table.
Choose if you want to use the first row as a header or not.
Click Create once you're done. You're lookup will appear as a card in the general view once it is processed.
Note that there's a file size limit of 3.91 GB.
You can update a lookup to its newest version without deleting a previous one. To do it, simply click a lookup card and click the Create version button. Then, click Update to save any modifications.
Note that tables you upload as new versions must have the same columns as the previous ones, plus additional columns you may want to include. You can only change the data types of those new columns when you define a new version.
The last version you update will become the active one automatically. All versions are available to access via the version tree that appears in the lookup details. Click one to see details of the logs it contains.
You can see the status of your lookups in their details, checking the version tree. These are the available statuses:
The latest and active version of the lookup.
Previous lookup versions.
Lookups with any processing errors. The lookup card version will appear in red when the lookup has any errors.
You can add filters to narrow down the lookups you see in the list. Click the + Add filter button and select the required filter type(s). You can filter by:
Name: Select a Condition (Contains, Equals, or Matches) and a Value to filter lookups by their names.
Status: Choose the required status(es) among the available ones in your lookups.
The filters applied will appear as tags at the top of the view.
Note that you can only add one filter of each type.
You can also choose to view only those lookups that have been assigned the desired tags. To filter by tags, click the + Tags button, select the required tag(s), and click Save.
Click the ellipsis icon in a lookup card and select Download CSV to download the last version of the lookup as a CSV file. You'll receive an email with the Download file button once it is processed.
If you need to download a previous version of a lookup, access its details and click the ellipsis icon > Download CSV in the required lookup version to do it.
To remove a lookup, click the ellipses icon in the card and select Remove.
If your lookup is in use, you can see where it is being used in the window that appears before deleting it. Pipelines with removed lookups will be paused automatically.
You can use the Action Lookup in your Pipelines to enrich your information. There, you'll be able to select any of the lookups in your Tenant. To learn more about how to use the Lookup Action, go to .
