Skip to main content

Google BigQuery

Integrating Google BigQuery with Osano​

Connecting to Google BigQuery​

In order for Osano to discover data stored in your systems, we must connect to those data providers via an API. We require, at minimum, read-only access to establish a connection to these providers. Each provider you connect may require different information. Please see the linked vendor documentation for instructions on where and how to obtain this data.

Setup​

An admin must create a Service Account JSON Key with the required scopes (BigQuery Data Viewer, BigQuery Job User) and enter that information in Osano to establish a connection via apiKey.

Authenticated Roles​

admin

Authentication Actions​

  • Service Account JSON Key -Instructions for creating your Service Account JSON Key. It's important to use the JSON key type and have an account with the appropriate scopes.

  • Here are links to instructions from Google on how to locate the Tables and Service Account Key listed as required above.

  • Required Scopes

    • BigQuery Data Viewer
    • BigQuery Job User

Authentication Methods​

  • oauth
  • apiKey

Service account JSON key

Core Functionality​

  • Data Discovery
  • User Search
  • Data Deletion

Base URL​

https://cloud.google.com/bigquery/docs/reference/libraries-overview

  • email
  • name
  • phoneNumber
  • address
  • birthday
  • userId

Endpoints​

Used for data discovery

  • SQL SELECT * FROM $dataset.$table LIMIT @SAMPLE_RESULT_LIMIT - BigQuery Data Viewer,BigQuery Job User

Used for user search

SQL SELECT * FROM $dataset.$table WHERE SEARCH($table, @email) LIMIT @SEARCH_RESULT_LIMIT - BigQuery Data Viewer,BigQuery Job User

Data Deletion​

Data deletion is not fully implemented as the user will need to confirm the data returned is correct

Last Modified: 2025-03-26