Google Cloud Storage
Most recent version: v1.0.0
Last updated
Was this helpful?
Most recent version: v1.0.0
Last updated
Was this helpful?
This is a Pull Listener and therefore should not be used in environments with more than one cluster.
Source events from a Google Cloud Storage bucket using the HTTP protocol.
Select Google Cloud Storage from the list of Listener types and click Configuration to start.
Now you need to specify how and where to collect the data, and establish a connection with your Google account.
Enter the basic information for the new Listener.
Name*
Enter a name for the new Listener.
Description
Optionally, enter a description for the Listener.
Tags
Add tags to easily identify your Listener. Hit the Enter key after you define each tag.
Now add the configuration to establish the connection.
Credentials File*
The Google Cloud connector uses OAuth 2.0 credentials for authentication and authorization. Create a secret containing these credentials or select one already created.
To find the Google Cloud credentials file, go to Settings>Interoperability.
Scroll down to the Service Account area.
You need to generate and download a service account key from the Google Cloud Console. You will not be able to view this key, so you must have it copied somewhere already. Otherwise, create one here and save it to paste here.
To see existing Service Accounts, go to the menu in the top left and select APIs & Services>Credentials.
Delimiter Char Codes
Assign an optional delimiter to simulate a hierarchical directory structure within a flat namespace.
Read Bucket Once
Select true and enter a prefix and start time in the fields that appear.
Prefix: The optional string that acts like a folder path or directory structure when organizing objects within a bucket.
Project ID*
This is a unique string with the following format my-project-123456
Go to the Google Cloud Console.
In the top left corner, click on the project drop-down next to the Google Cloud logo (where your current project name is shown).
Each project will have a Project Name and a Project ID.
You can also find it in the Settings tab on the left-hand side.
Subscription*
Follow these steps to get the subscription name:
Go to Pub/Sub in the Google Cloud Console.
In the top left corner, click on the menu and select View all Products.
Then go to Analytics and find Pub/Sub and click it to go to Pub/Sub (you can also use the search bar and type "Pub/Sub").
In the Pub/Sub dashboard, select the Subscriptions tab on the left.
The Subscription Name will be displayed in this list.
Click Create labels to move on to the next step and define the required Labels if needed.
