Collect data from Google Pub/Sub
Most recent version: v0.0.2
This is a Pull Listener and therefore should not be used in environments with more than one cluster.
Overview
Onum supports integration with Google Pub/Sub.
Google Pub/Sub is an asynchronous and scalable messaging service that decouples services producing messages from services processing those messages. Pub/Sub allows services to communicate asynchronously.
Google Cloud Storage Setup
To source data from Google Cloud Pub/Sub you need to have a Google Cloud project, appropriate roles and permissions to run Pub/Sub, and enable the Pub/Sub API.
See Google Cloud Pub/Sub documentation for help on how to set these up.
Onum Setup
Log in to your Onum tenant and click Listeners > New listener.


Double-click the Google Pub/Sub Listener.


Enter a Name for the new Listener. Optionally, add a Description and some Tags to identify the Listener.


The Project ID* is a unique string with the following format: my-project-123456. To get it:
Go to the Google Cloud Console.
In the top left corner, click on the project drop-down next to the Google Cloud logo (where your current project name is shown).
Each project will have a Project Name and a Project ID.
You can also find it in the Settings tab on the left-hand side.

Enter your Subscription Name*
Go to Pub/Sub in the Google Cloud Console.
In the top left corner, click on the menu and select View all Products.
Then go to Analytics and find Pub/Sub. Click it to go to Pub/Sub (you can also use the search bar and type "Pub/Sub").
In the Pub/Sub dashboard, select the Subscriptions tab on the left.
The Subscription Name will be displayed in this list.

The Google Cloud connector uses OAuth 2.0 credentials for authentication and authorization. Select the credentials from your Secrets or click New secret to generate a new one.
To find the Google Cloud credentials file, go to Settings > Interoperability.
Scroll down to the Service Account area.
You need to generate and download a service account key from the Google Cloud Console. You will not be able to view this key, so you must have it copied somewhere already. Otherwise, create one here and save it to paste here.
To see existing Service Accounts, go to the menu in the top left and select APIs & Services > Credentials.



Bulk Messages Configuration
Decide whether or not to activate the bulk message option using the Enabled* field.
Then, choose the required message format and enter the characters you want to use as delimiters, if required. A delimiter character code refers to the numerical representation (usually in ASCII or Unicode) of a delimiter.


Finally, click Create labels. Optionally, you can set labels to be used for internal Onum routing of data. By default, data will be set as Unlabeled. Click Create listener when you're done.
Learn more about labels in this article.


Click Create listener when you're done.
Last updated
Was this helpful?

