Skip to main content

Google BigQuery

Integrating Google Big Query with Osano

Connecting to Google Big QUery


In order for Osano to discover data stored in your systems, we must connect to those data providers via an API. We require, at minimum, read-only access to establish a connection to these providers. Each provider you connect may require different information. Please see the linked vendor documentation for instructions on where and how to obtain this data.


Prerequisites

  • Create a service account in Google Cloud Console. Instructions here.
    • Go to the Create service account page.
    • Select your Google Cloud project.
    • Enter a service account name.
    • Optional: Enter a description of the service account.
    • For roles, enter the following roles:
      • BigQuery Data Viewer
      • BigQuery Job User
    • Press Done to finish creating the service account.
  • Create your Service Account Key. Instructions here.
    • Go to the Service Accounts page in the Google Cloud Console.
    • Select your Google Cloud project.
    • Click the email address of the service account that you want to create a key for.
    • Click the Keys tab.
    • Click the Add key drop-down menu, then select Create new key.
    • Select JSON as the Key type and click Create. A JSON file that contains your key downloads to your computer.

Step by step guide

  1. Access Data Mapping Settings:

    • Navigate to the Data Mapping page in the Osano application.
    • Select Sources from the left-hand navigation menu.
  2. Select Cloud DB Services as Source type

  3. From the available sources, select BigQuery.

  4. Configure BigQuery Integration:

    • Follow the on-screen instructions to configure your BigQuery integration.
    • Enter your dataset name.
    • Enter your service key JSON.
    • Click Save.
  5. View BigQuery Integration:

    • Once saved, you will see your BigQuery integration in the list of configured sources.
    • Your integration will include tables that already exist in your BigQuery environment.
  6. Click into the Discovered Data to view the tables that synced from BigQuery.

  7. Create a new data store:

    • To proceed with creating a new data store, click on Review.
    • Follow the prompts to create a new data store.