Dataset Subscription

Dataset Subscription pipeline can be used to request and retrieve datasets that advertisers have subscribed to. Each dataset supports different performance metrics or campaign metadata.

Read more about the Dataset Subscription pipeline here

Configuring the Credentials

Select the account credentials which has access to relevant Amazon Marketing Stream data from the dropdown menu & Click Next

Credentials not listed in dropdown ?: Click on + Add New for adding new credentials

Data Pipelines Details

Data Pipeline: Select Dataset Subscription from the dropdown

Data Pipeline configuration: Enter the configuration for this pipeline in the screen that shows up. Detailed description for each parameter is given below.
Profile: Profiles represent an advertiser and their account’s marketplace. Select a profile from the drop-down.

All profiles which your credentials have access to should be available here. If they are not, please check the credentials selected / configured by you.

Setting Parameters

Parameter Description Values

Parameter	Description	Values
Insert Mode	*Required* Specifies the manner in which data will get updated in the data warehouse : APPEND will insert all fetched data at the end, REPLACE will drop the existing table and recreate a fresh one on each run.	`Append`, `Replace` *Default Value:* Replace
Dataset	*Required* Each dataset supports different performance metrics or campaign metadata. Specify the dataset that you have subscribed to and need to fetch.	`sp-traffic`, `sp-conversion`, `sd-traffic`, `sd-conversion`, `sb-traffic`, `sb-conversion`, `sb-clickstream`, `sb-rich-media`, `budget-usage`, `sponsored-ads-campaign-diagnostics-recommendations`, `campaigns`, `ad-groups`, `ads`, `targets`
SQS Region	*Required* Specify the SQS Region name. Using the advertiser region you can determine which region to create your queue in: NA - us-east-1` , EU - eu-west-1 , FE - us-west-2. To understand what countries are supported click here	`us-east-1` , `eu-west-1` , `us-west-2` *Default Value:* us-east-1
DC Managed SQS	*Required* Specify whether you want to use DC Managed SQS. (It is recommended to use DC Managed SQS queue.)	`True`, `False` *Default Value:* True
AWS Secret Key *Dependant*	*Required (If DC Managed SQS = False)* Enter your AWS secret key.	AWS secret key.
AWS Access Key *Dependant*	*Required (If DC Managed SQS = False)* Enter your AWS access key ID that identifies your AWS account.	AWS Access Key
SQS Queue URL *Dependant*	*Required (If DC Managed SQS = False)* Enter the URL of the Amazon SQS queue.	SQS Queue URL

Insert Mode

Required

Specifies the manner in which data will get updated in the data warehouse : APPEND will insert all fetched data at the end, REPLACE will drop the existing table and recreate a fresh one on each run.

Append, Replace

Default Value: Replace

Dataset

Required

Each dataset supports different performance metrics or campaign metadata. Specify the dataset that you have subscribed to and need to fetch.

sp-traffic, sp-conversion, sd-traffic, sd-conversion, sb-traffic, sb-conversion, sb-clickstream, sb-rich-media, budget-usage, sponsored-ads-campaign-diagnostics-recommendations, campaigns, ad-groups, ads, targets

SQS Region

Required

Specify the SQS Region name. Using the advertiser region you can determine which region to create your queue in: NA - us-east-1` , EU - eu-west-1 , FE - us-west-2. To understand what countries are supported click here

us-east-1 , eu-west-1 , us-west-2

Default Value: us-east-1

DC Managed SQS

Required

Specify whether you want to use DC Managed SQS. (It is recommended to use DC Managed SQS queue.)

True, False

Default Value: True

AWS Secret Key Dependant

Required (If DC Managed SQS = False)

Enter your AWS secret key.

AWS secret key.

AWS Access Key Dependant

Required (If DC Managed SQS = False)

Enter your AWS access key ID that identifies your AWS account.

AWS Access Key

SQS Queue URL Dependant

Required (If DC Managed SQS = False)

Enter the URL of the Amazon SQS queue.

SQS Queue URL

Datapipeline Scheduling

Scheduling specifies the frequency with which data will get updated in the data warehouse. You can choose between Manual Run, Normal Scheduling or Advance Scheduling.

Manual Run: If scheduling is not required, you can use the toggle to run the pipeline manually.
Normal Scheduling: Use the dropdown to select an interval-based hourly, monthly, weekly, or daily frequency.
Advance Scheduling: Set schedules fine-grained at the level of Months, Days, Hours, and Minutes.

Detailed explanation on scheduling of pipelines can be found here

Dataset & Name

Dataset Name: Key in the Dataset Name(also serves as the table name in your data warehouse).Keep in mind, that the name should be unique across the account and the data source. Special characters (except underscore _) and blank spaces are not allowed. It is best to follow a consistent naming scheme for future search to locate the tables.
Dataset Description: Enter a short description (optional) describing the dataset being fetched by this particular pipeline.
Notifications: Choose the events for which you’d like to be notified: whether "ERROR ONLY" or "ERROR AND SUCCESS".

Once you have finished click on Finish to save it. Read more about naming and saving your pipelines including the option to save them as templates here

Still have Questions?

We’ll be happy to help you with any questions you might have! Send us an email at info@datachannel.co.

Subscribe to our Newsletter for latest updates at DataChannel.