Manual Range

The Manual Range pipeline can be used to request and retrieve data stored in a worksheet selectively. It allows selecting which subsets of spreadsheet data to return by specifying a dataFilters parameter. Multiple DataFilters can be specified. Specifying one or more data filters will return the portions of the spreadsheet that intersect ranges matched by any of the filters.

Read more about this here

Configuring the Credentials

Select the account credentials which has access to relevant Freshdesk data from the dropdown menu & Click Next

Credentials not listed in dropdown ?

Click on + Add New for adding new credentials

Sheet

Select a sheet from the drop-down

All sheets which your credentials have access to should be available here. If they are not, please check the credentials selected / configured by you.
Worksheet Name

Select the worksheet you would like to fetch from the selected sheet.

Data Pipelines Details

Data Pipeline

Select Manual Range from the dropdown

Setting Parameters

Parameter Description Values

Header Dimension

Required

Select if the header dimension is of row type or column type.

{Row, Column}

Default Value: Row

Insert Mode

Required

Specifies the manner in which data will get updated in the data warehouse : UPSERT will insert only new records or records with changes, APPEND will insert all fetched data at the end, and REPLACE will drop the existing table and recreate a fresh one on each run. Recommended to use "Upsert" option unless there is a specific requirement.

{Upsert, Append, Replace}

Default Value: UPSERT

Attempt Schema Inference

Required

If Yes then value types will be fetched as it is, eg: Float will be fetched as float. If No then everything will be fetched as string irrespective of its type.

{Yes,No}

A1 Notation

Required

Enter the A1 notation here to selectively choose the data range. This is a string like Sheet1!A1:B2, that refers to a group of cells in the spreadsheet, and is typically used in formulas.

String

Valid Examples: Sheet1!A1:B2, Sheet1!A:A, Sheet1!1:2, Sheet1!A5:A, A1:B2, Sheet1 etc.

Header Columns Present

Required

Choose Yes or No depending on if the file has a header column or not

{Yes,No}

Default Value: No

Datapipeline Scheduling

Scheduling specifies the frequency with which data will get updated in the data warehouse. You can choose between Manual Run, Normal Scheduling or Advance Scheduling.

Manual Run

If scheduling is not required, you can use the toggle to run the pipeline manually.

Normal Scheduling

Use the dropdown to select an interval-based hourly, monthly, weekly, or daily frequency.

Advance Scheduling

Set schedules fine-grained at the level of Months, Days, Hours, and Minutes.

Detailed explanation on scheduling of pipelines can be found here

Dataset & Name

Dataset Name

Key in the Dataset Name(also serves as the table name in your data warehouse).Keep in mind, that the name should be unique across the account and the data source. Special characters (except underscore _) and blank spaces are not allowed. It is best to follow a consistent naming scheme for future search to locate the tables.

Dataset Description

Enter a short description (optional) describing the dataset being fetched by this particular pipeline.

Notifications

Choose the events for which you’d like to be notified: whether "ERROR ONLY" or "ERROR AND SUCCESS".

Once you have finished click on Finish to save it. Read more about naming and saving your pipelines including the option to save them as templates here

Still have Questions?

We’ll be happy to help you with any questions you might have! Send us an email at info@datachannel.co.

Subscribe to our Newsletter for latest updates at DataChannel.