JSON

Folder Path

Required

Points to the path along which the files are present

String value (eg:folder/subfolder)

File Name

Required

Specify the File Name. In cases where the user doesn’t remember complete name of file, specify file name match type using the operator which takes values as 'Exact, Startswith, Endswith, and Contains'.

String value (eg:abc.csv)

Default Value: Exact (For the operator)

Process All Matching Files

Required

Select Yes or No, depending on if all matching files are to be processed or not

{Yes,No}

Default Value: No

File Selection Criteria

Dependant

Required

(If Process All Files in Folder = NO)

Choose File’s creation or modification Date

{Date Created,Date Modified}

Default Value: Date Created

Attempt Schema Inference

Required

If Yes then value types will be fetched as it is, eg: Float will be fetched as float. If No then everything will be fetched as string irrespective of its type.

{Yes,No}

Default Value: No

Insert Mode

Required

Specifies the manner in which data will get updated in the data warehouse : Upsert will insert only new records or records with changes, Append will insert all fetched data at the end, Replace will drop the existing table and recreate a fresh one on each run.

{Upsert,Append,Replace}

Default Value: Replace

Key

Dependant

Required

(If Upsert is chosen as the Insert Mode Type)

Enter the column name based on which data is to be upserted.

String value

Container Name

Required

Enter the container name in lowercase.

String value

Compressed

Required

Choose Yes or No depending on the file compression

{Yes,No}

Default Value: No

Compression Type

Dependant

Required (If Compressed = Yes)

Specify the file compression type

{Zip,Gzip}

Post Processing Actions

Required

Actions to be performed once the file processing has been completed

{No Action,Move Files}

Default Value: No Action

Move File Destination

Dependant

Required

(If Post Processing Actions = Move Files)

Specify the folder where the files are to be moved

String value (eg:test_folder/)

Include Source File Name

Required

Set this parameter to 'YES' if you want to include source file name in the data warehouse.

{Yes,No}

Default Value: No

Content Structure

Required

This refers to the manner in which your data in a file can be structured. In the case of Newline Delimited JSON, each line in the file represents a JSON object. On the other hand, for the Array of Objects structure, the data is wrapped within an array.

{Newline Delimited JSON, Array of Objects}

Default Value: Newline Delimited JSON