Skip to main content

Dataset Check Targets

The dataset check targets run the checks defined on a dataset whenever it is updated. They keep data quality checks running as part of an event-driven pipeline.

IdNameTemplateIcon
odsl.qualitycheckRun dataset quality checksrun quality checks on [dsid]ui-checks text-red
odsl.criticalcheckRun dataset critical checksrun critical checks on [dsid]ui-checks text-red

Both targets only work with the dataset service and the update action. Neither supports @transformer or property-change filtering.

Inputs​

InputDescription
dsidThe id of the dataset whose checks should run

How it works​

The target runs the dataset's quality or critical checks for the ondate of the update. The checks themselves are defined on the dataset, not on the automation; the automation only decides when they run.

Dataset automations use the dataset service, the private source, and the dataset id (provider.feed.product) as the condition id.


Example: run quality checks when a dataset is updated​

a = AutomationBuilder("dataset", "private", "MY.PROVIDER.FEED").build()

c = SimpleObject()
c.source = "private"
c.service = "dataset"
c.id = "MY.PROVIDER.FEED"
c.action = "update"
conds = []
conds.add(c)
a.conditions = conds

a.target = "odsl.qualitycheck"
a.template = "When 'MY.PROVIDER.FEED' is updated, run quality checks on [dsid]"
a.icon = "ui-checks text-red"
a.properties.dsid = "MY.PROVIDER.FEED"
a.enabled = true
save ${automation:a}

Example: run critical checks when a dataset is updated​

a = AutomationBuilder("dataset", "private", "MY.PROVIDER.FEED").build()

c = SimpleObject()
c.source = "private"
c.service = "dataset"
c.id = "MY.PROVIDER.FEED"
c.action = "update"
conds = []
conds.add(c)
a.conditions = conds

a.target = "odsl.criticalcheck"
a.template = "When 'MY.PROVIDER.FEED' is updated, run critical checks on [dsid]"
a.icon = "ui-checks text-red"
a.properties.dsid = "MY.PROVIDER.FEED"
a.enabled = true
save ${automation:a}