View Data Source Details

Overview

This section explains you how to add new pipelines and edit / view your configured pipelines, manage credentials, view a summary for data moved in each run, view logs for recent runs, view templates, view table schema, preview data and more such functions.

data source main ui

Managing Credentials

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. From the Setup tab you can access various functionalities such as adding new credentials, refresing the list of credentials, editing or deleting a saved credential (Refer image).

    data source setup credentials

  3. Located below the credentials, you will be able to view the warehouse connected to the data source. Click on the View button to view the details of the added warehouse .

Adding a new pipeline

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. There are two methods to add a new pipeline:

    • Method 1 : From the Data Pipelines tab you can view the various different types of pipelines that are supported by DataChannel for your selected Data Source. Select/ Add the credentials that you want to use to add the new pipeline. Click on + to add the desired pipeline. Enter the desired report configuration and set the schedule as needed.

data source data pipelines add

  • Method 2 : Click on the + Data Pipeline button on top right side of the screen near the data source description to add new pipelines. Select/ Add the credentials that you want to use to add the new pipeline. Click on Next to view the various different types of pipelines that are supported by DataChannel for your selected Data Source. Click on the desired pipeline and click on Next to add the desired pipeline. Enter the desired report configuration and set the schedule as needed.

data source detail data pipelines add

Editing / viewing Configured pipelines

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. From the Configured Data Pipelines tab you can view a summary of your configured pipelines for a connector, details of number of runs and rows/data moved. Also, here you can access various functionalities such as editing/ running an existing pipeline, copying a pipeline, viewing details of last pipeline run, viewing the change history of the pipeline, and deleting the pipeline(Refer image).

    data source configured data pipelines

  3. From the Configured Data Pipelines tab, you can also use the toggle to change the status of a pipeline from 'active' to 'paused' or vice versa.

Viewing Logs

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. From the Configured Data Pipelines tab you can click on the icon to view details of last pipeline run (Refer image) for the required pipeline.

    data source last pipeline run

  3. You will be redirected to the Number of Runs tab which displays a pictorial and tabular representation of the previous pipeline runs.

    data source number of runs

  4. Click on the View Logs button to access the logs of the pipeline run. Please keep in mind that this feature is available for only your recent pipeline runs.

    data source view logs

  5. Logs will be displayed for the run as shown in image above.

Viewing Templates

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. From the Templates tab you can click the icon on the right of the required data pipeline template.

    data source viewing templates

  3. You will be able to view the detailed configuration and scheduling frequency as saved in the template .

data source templates

Viewing Table Schema

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. From the Configured Data Pipelines tab you can click on the edit pipeline icon to view details of the required pipeline.

    data source edit pipeline

  3. You will be redirected to the Setup tab which displays presently saved configuration of the required pipeline. By clicking on the Table Schema tab, you will be able to view the names and datatypes of the fields being fetched by the selected pipeline.

data source table schema

Previewing Data

  1. Go to the ETL tab on the sidebar and search and select the required data source from the All Connectors menu option.

  2. From the Data Preview tab you can select the required data pipeline from the dropdown. Click on the Get Data button.

    data source preview data

  3. You will be able to preview the data for the selected pipeline.

data source view data

Can’t wait to find out?

Send us an email at info@datachannel.co.