(v22) Manage the BigQuery Connector

Manage the BigQuery Connector

The Composer BigQuery connector lets you access the data available in Google BigQuery storage using the Composer client. The Composer BigQuery connector supports the current version of this software as a microservice (SaaS) product.

The Composer BigQuery connector is a cloud connector that connects to Google BigQuery via the BigQuery API. See Manage Connectors and Connector Servers for general instructions and Connect to BigQuery for details specific to the BigQuery connector.

After the connector has been set up, you can create data source configurations that specify the necessary connection information and identify the data you want to use. See Manage Data Source Configurations for more information. After data sources are configured, they can be used to create dashboards and visuals from your data. See Create Dashboards.

Composer Feature Support

BigQuery connector support for specific Composer features is shown in the following table.

Key: Y - Supported; N - Not Supported; N/A - not applicable

Feature	Supported?
Admin-Defined Functions	Y
Box Plots	Y
Custom SQL Queries	Y
Derived Fields (Row-Level Expressions)	Y
Distinct Counts	Y
Fast Distinct Values	N/A
Group By Multiple Fields	Y
Group By Time	Y
Group By UNIX Time	Y
Histogram Floating Point Values	Y
Histograms	Y
Kerberos Authentication	N/A
Last Value	Y
Live Mode and Playback	Y
Multivalued Fields	N/A
Nested Fields	N/A
Partitions	Y
Pushdown Joins for Fusion Data Sources	Y
Schemas	Y
Text Search	N/A
TLS	N/A
User Delegation	N
Wildcard Filters	Y
Wildcard Filters, Case-Insensitive Mode	Y
Wildcard Filters, Case-Sensitive Mode	Y

Connect to BigQuery

When connecting to BigQuery, provide the following information:

• Key Path: you have to specify the absolute path to the file that must be available for the connector.
• Public Project IDs.

For more information about these values, refer to Google BigQuery's documentation.

Authorize the BigQuery Connection

To authorize the BigQuery connection, you need to create a security key for it. Before you can create the security key, you must access or create a BigQuery microservice account.

To create a BigQuery microservice account, perform the following steps:

1. Login to your Google API Console.

2. Select the required project from the list.

3. Make sure that current account is linked to a billing account. To check this, select the menu () icon and then select Billing.

4. On the API Manager page, select Credentials:

   

5. On the Credentials page, select Manage service accounts.

6. On the Service Accounts page, select Create Service Account and specify the following:

   • Service account name
   • Role - grant this microservice account role based access to the project. From the list, select the BigQuery category and then select BigQuery Data Viewer and BigQuery User roles.
   • Service account ID

   

7. Select Create.

After you have created an account, create a security key for it.

To create a security key:

1. On the Service Accounts page, find the required account.

2. From the menu, select Create key.

3. In the Create private key dialog, select JSON for the key type and select Create. The local copy of the key is saved on your computer.

   For more information, see the following Google resource: BigQuery Introduction to Authentication.

4. Move the file with the key to the server, on which the connector is running.