JSON

Insert Mode

Required

Specifies the manner in which data will get updated in the data warehouse : UPSERT will insert only new records or records with changes, APPEND will insert all fetched data at the end, and REPLACE will drop the existing table and recreate a fresh one on each run. Recommended to use "Upsert" option unless there is a specific requirement.

Upsert, Append, Replace

Default Value: Replace

Upsert Key

Dependant

Required

(If Upsert is chosen as the Insert Mode Type)

Enter the column name based on which data is to be upserted.

String value

Attempt Schema Inference

Required

If Yes then value types will be fetched as it is, eg: Float will be fetched as float. If No then everything will be fetched as string irrespective of its type.

Yes, No

Default Value: No

Compressed

Required

Choose Yes or No depending on the file compression

Yes, No

Default Value: No

Compression Type

Dependant

Required (If Compressed = Yes)

Specify the file compression type

Zip, Gzip

Include Source File Name

Required

Set this parameter to 'YES' if you want to include source file name in the data warehouse. Default: 'NO'.

Yes, `No

Default Value: No

Content structure

Required

This refers to the manner in which your data in a file can be structured. In the case of Newline Delimited JSON, each line in the file represents a JSON object. On the other hand, for the Array of Objects structure, the data is wrapped within an array.

Array of Objects, Newline Delimited JSON

Default Value: Newline Delimited JSON