Google BigQuery
Integrating Google BigQuery with Osano
Connecting to Google BigQuery
In order for Osano to discover data stored in your systems, we must connect to those data providers via an API. We require, at minimum, read-only access to establish a connection to these providers. Each provider you connect may require different information. Please see the linked vendor documentation for instructions on where and how to obtain this data.
Setup
An admin must create a Service Account JSON Key with the required scopes (BigQuery Data Viewer, BigQuery Job User) and enter that information in Osano to establish a connection via apiKey.
Authenticated Roles
admin
Authentication Actions
-
Service Account JSON Key -Instructions for creating your Service Account JSON Key. It's important to use the JSON key type and have an account with the appropriate scopes.
-
Here are links to instructions from Google on how to locate the Tables and Service Account Key listed as required above.
-
Required Scopes
- BigQuery Data Viewer
- BigQuery Job User
Authentication Methods
- oauth
- apiKey
Service account JSON key
Core Functionality
- Data Discovery
- User Search
- Data Deletion
Base URL
https://cloud.google.com/bigquery/docs/reference/libraries-overview
User Search
- name
- phoneNumber
- address
- birthday
- userId
Endpoints
Used for data discovery
- SQL
SELECT * FROM $dataset.$table LIMIT @SAMPLE_RESULT_LIMIT
-BigQuery Data Viewer,BigQuery Job User
Used for user search
SQL SELECT * FROM $dataset.$table WHERE SEARCH($table, @email) LIMIT @SEARCH_RESULT_LIMIT
- BigQuery Data Viewer,BigQuery Job User
Data Deletion
Data deletion is not fully implemented as the user will need to confirm the data returned is correct
Last Modified: 2025-03-26