Export

This sync can be used to load data from your data warehouse into Google BigQuery platform.

SETUP

Configuring the Credentials

Select the account credentials which has access to relevant Google BigQuery account from the given list & Click Next

Credentials not listed ?: Click on + for adding new credentials and fill the form that pops-up.

Data Sync Details

Data Sync: Select Export & click Next

How do you want to fetch data?: Select whether you want to fetch data from the Data Model or from Table/ View.
Data Model: In case you want to fetch data using Data Model, select the data model that you would like to use for this sync. Checkout how to configure a model here.
Data Warehouse: In case you want to fetch data using Table/ View, select the data warehouse that you would like to use for this sync.
Table / View: Select the Table/ view in the data warehouse that you would like to use for this sync.

Setting Parameters

Parameter Description Values

Parameter	Description	Values
Fields Selection	*Required* Select the field(s) you would like to push in your Google BigQuery here. You can also rename any data model field here.	{Target Field, Data Model Field}
Fetch Mode	*Required* This refers to the manner in which data will get updated : FULL will update the entire column(s) from the selected data, INCREMENTAL will update the fresh record(s) added since last fetch.	`FULL`, `INCREMENTAL` *Default Value:* FULL
Incremental Key *Dependant*	*Required (If Fetch Mode = Incremental)* Choose the field which will serve as Incremental key.	Select Incremental Key
Insert Mode	*Required* This refers to the manner in which data will be updated in Google BigQuery; with 'Upsert' selected, the data will be updated (only existing records) and with 'Append' selected, all data fetched will be inserted. Selecting 'Replace' will ensure the table is dropped and recreated with fresh data on each run. Recommended to use "Upsert" option unless there is a specific requirement.	`Upsert`, `Append`, `Replace` *Default Value:* Replace
Upsert Key *Dependant*	*Required (If Insert Mode = Upsert)* Choose the field which will serve as Upsert key.	Select Upsert Key

Fields Selection

Required

Select the field(s) you would like to push in your Google BigQuery here. You can also rename any data model field here.

{Target Field, Data Model Field}

Fetch Mode

Required

This refers to the manner in which data will get updated : FULL will update the entire column(s) from the selected data, INCREMENTAL will update the fresh record(s) added since last fetch.

FULL, INCREMENTAL

Default Value: FULL

Incremental Key Dependant

Required (If Fetch Mode = Incremental)

Choose the field which will serve as Incremental key.

Select Incremental Key

Insert Mode

Required

This refers to the manner in which data will be updated in Google BigQuery; with 'Upsert' selected, the data will be updated (only existing records) and with 'Append' selected, all data fetched will be inserted. Selecting 'Replace' will ensure the table is dropped and recreated with fresh data on each run. Recommended to use "Upsert" option unless there is a specific requirement.

Upsert, Append, Replace

Default Value: Replace

Upsert Key Dependant

Required (If Insert Mode = Upsert)

Choose the field which will serve as Upsert key.

Select Upsert Key

Data Sync Scheduling

Set the schedule for the sync to run. Detailed explanation on scheduling of syncs can be found here

Dataset & Name

Give your sync a name and some description (optional) and click on Finish to save it. Read more about naming and saving your syncs including the option to save them as templates here

Still have Questions?

We’ll be happy to help you with any questions you might have! Send us an email at info@datachannel.co.

Subscribe to our Newsletter for latest updates at DataChannel.