Export

Fields Selection

Dependent Required

Select the field(s) you would like to push in your Weaviate Vector database here. To push all the fields, simply select "Select All Fields". Using the checkboxes indicate whether you would like to push metadata/ embeddings.

{Model Field Name, Destination Field Name, Metadata, Embeddings}

Fetch Mode

Required

This refers to the manner in which data will get fetched from the warehouse: FULL will fetch all records available in the data model / segment and will send tham to the Weaviate Vector database,and INCREMENTAL will fetch only new records since the last sync and will send them to the Weaviate Vector database.

Incremental, Full

Default Value: FULL

Incremental Key Dependant

Required (If Fetch Mode = Incremental) This refers to the field using which the rows will be incrementally fetched for upload.

String value

Insert Mode

Required

This refers to the manner in which data will be updated in the Pinecone Vector database; with 'Upsert' selected, the data will be upserted (only new records or records with changes) and with 'Append' selected, all data fetched will be inserted.

Upsert, Append

Default Value: Upsert

Upsert Key Dependant

Required (If Insert Mode = Upsert)

Specify the upsert key based on which data is to be upserted.

String value