Objects

The Objects pipeline can be used to request and retrieve data objects along with their metadata and child resources from Oracle Cloud.

Any type of data, regardless of content type, is stored as an object. An object is composed of the object itself and metadata about the object.

Read more about the pipeline here

Configuring the Credentials

Select the account credentials which has access to relevant Oracle Transactional Business Intelligence data from the dropdown menu & Click Next

Credentials not listed in dropdown ?

Click on + Add New for adding new credentials

Data Pipelines Details

Data Pipeline

Select Objects from the dropdown

otbi objects list
Select Object

Select object from the drop-down

Setting Parameters

Parameter Description Values

Fetch Mode

Optional

Specifies the manner in which data will fetched from the Salesforce API : FULL will fetch the entire object and INCREMENTAL will only fetch the new records after the latest update.

Full, Incremental

Default Value: Incremental

Incremental Key

Dependant

Required

(If Incremental is chosen as the Fetch Mode Type)

Specify the field which will serve as Incremental key.

String value

Insert Mode

Optional

This refers to the manner in which data will get updated in the data warehouse, with 'Upsert' selected, the data will be upserted (only new records or records with changes) and with 'Append' selected, all data fetched will be inserted. Selecting 'Replace' will ensure the table is dropped and recreated with fresh data on each run. Recommended to use "Upsert" option unless there is a specific requirement.

Upsert, Append, Replace

Default Value: Upsert

Upsert Key

Dependant

Required

(If Upsert is chosen as the Insert Mode Type)

Specify the upsert key(s) based on which data is to be upserted.

String value

Require Child?

Required

Specify whether to create child tables.

Yes, No

Default Value: No

otbi objects config

Datapipeline Scheduling

Scheduling specifies the frequency with which data will get updated in the data warehouse. You can choose between Manual Run, Normal Scheduling or Advance Scheduling.

Manual Run

If scheduling is not required, you can use the toggle to run the pipeline manually.

Normal Scheduling

Use the dropdown to select an interval-based hourly, monthly, weekly, or daily frequency.

Advance Scheduling

Set schedules fine-grained at the level of Months, Days, Hours, and Minutes.

Detailed explanation on scheduling of pipelines can be found here

Dataset & Name

Dataset Name

Key in the Dataset Name(also serves as the table name in your data warehouse).Keep in mind, that the name should be unique across the account and the data source. Special characters (except underscore _) and blank spaces are not allowed. It is best to follow a consistent naming scheme for future search to locate the tables.

Dataset Description

Enter a short description (optional) describing the dataset being fetched by this particular pipeline.

Notifications

Choose the events for which you’d like to be notified: whether "ERROR ONLY" or "ERROR AND SUCCESS".

Once you have finished click on Finish to save it. Read more about naming and saving your pipelines including the option to save them as templates here

Still have Questions?

We’ll be happy to help you with any questions you might have! Send us an email at info@datachannel.co.

Subscribe to our Newsletter for latest updates at DataChannel.