Skip to main content

Google BigQuery

Integrating Google BigQuery with Osano

Connecting to Google BigQuery


In order for Osano to discover data stored in your systems, we must connect to those data providers via an API. We require, at minimum, read-only access to establish a connection to these providers. Each provider you connect may require different information. Please see the linked vendor documentation for instructions on where and how to obtain this data.


Setup

An admin must create a Service Account JSON Key with the required scopes (BigQuery Data Viewer, BigQuery Job User) and enter that information in Osano to establish a connection via apiKey.

Authenticated Roles

admin

Authentication Actions

  • Service Account JSON Key -Instructions for creating your Service Account JSON Key. It's important to use the JSON key type and have an account with the appropriate scopes.

  • Here are links to instructions from Google on how to locate the Tables and Service Account Key listed as required above.

  • Required Scopes

    • BigQuery Data Viewer
    • BigQuery Job User

Authentication Methods

  • oauth
  • apiKey

Service account JSON key

Core Functionality

  • Data Discovery
  • User Search
  • Data Deletion

Base URL

https://cloud.google.com/bigquery/docs/reference/libraries-overview

  • email
  • name
  • phoneNumber
  • address
  • birthday
  • userId

Endpoints

Used for data discovery

  • SQL SELECT * FROM $dataset.$table LIMIT @SAMPLE_RESULT_LIMIT - BigQuery Data Viewer,BigQuery Job User

Used for user search

SQL SELECT * FROM $dataset.$table WHERE SEARCH($table, @email) LIMIT @SEARCH_RESULT_LIMIT - BigQuery Data Viewer,BigQuery Job User

Data Deletion

Data deletion is not fully implemented as the user will need to confirm the data returned is correct

Last Modified: 2025-03-26