BigQuery
Steps to prepare and connect to BigQuery
Lightup account setup
Lightup needs a service account with a JSON key and three BigQuery roles:
- BigQuery > BigQuery Data Editor
- BigQuery > BigQuery Job User
- BigQuery > BigQuery Read Session User
Create a service account and download the JSON credentials certificate
You must have Google Cloud admin permissions to create a service account. Google has documentation on creating a service account and generating a private key.
- Open the credentials page in the Google Cloud Platform API Manager and, if necessary, select your project:
- Click CREATE CREDENTIALS and choose Service account:
- Enter a name for the new service account, optionally add a description, and click CREATE:
-
Your service account requires three Google BigQuery predefined roles:
- BigQuery > BigQuery Data Viewer
- BigQuery > BigQuery Job User
- BigQuery > BigQuery Read Session User
Select the first role in the Select a role field, then click ADD ANOTHER ROLE and select the next role.
Repeat to add the third role, then click CONTINUE.
- Click CREATE KEY:
- Select JSON and click CREATE:
- The JSON key will be saved to your computer. BE SURE TO REMEMBER WHERE IT IS SAVED. After noting the download location, click CLOSE:
- At the bottom left, click DONE.
Connector setting
Do either of the following:
- Drag the service account key file to the Upload tab; or select BROWSE on the Upload tab and then browse to and select your key file.
- Open the key and copy/paste its JSON code into the JSON tab.\
Read about BigQuery service account keys.
Schema scan frequency
You can adjust how often scans run for a datasource.
- In section 3 - Advanced, select a value for Schema scan frequency: Hourly, Daily, or Weekly.
Query governance
BigQuery datasources support the Query history, Scheduling, Enable data storage, and Maximum backfill duration settings. For steps, see Set query governance settings for a datasource.
Updated 8 days ago