Module 06: Dataset Monitoring Dashboard

Every day, data arrives from exchanges, brokers, data vendors and your own systems. The dataset monitoring dashboard tells you, at a glance, whether each delivery arrived, whether it arrived on time and in full, and whether it passed its quality checks. In this module you will learn to read it.

Learning Objectives​

By the end of this module you will be able to:

• Explain what a dataset, a dataset feed and a dataset delivery are
• Choose which datasets you monitor
• Read the status icons on each dataset: delivery, score, quality, smart loader and alerts
• Use the dataset tabs to see the completeness and quality check results for a date
• Filter the list to find the datasets that need attention

Prerequisites​

• You have completed Module 01

Step 1: Understand the Terms​

A dataset id is always PROVIDER.FEED.PRODUCT.

A day in the life of a delivery​

1. At the start of the day each monitored dataset gets a new delivery record with status waiting and a score of 4
2. When data arrives, the platform checks for corrections, counts what was loaded against what is expected, and sets the status to partial or loaded
3. Quality checks run on the full dataset after each load
4. A background check lowers the score if the data is late, and raises an alert if it is late or missing

Step 2: Open the Dashboard and Read the Overview​

Open the dataset monitoring dashboard from the portal menu. It has three parts:

• Overview: a summary of the current status of all monitored datasets and alerts
• Dataset list: detailed information about each monitored dataset
• Reports: public and private reports about datasets

On the overview, use the view by dropdown to summarise the status by Provider, Category or Priority. Category and priority are labels your company assigns to datasets, so you can, for example, look at all your high-priority gas datasets together.

Step 3: Choose What You Monitor​

The dataset list shows only the datasets you have chosen to monitor.

1. Select the Monitored button at the top left . The list now shows every dataset you are entitled to see
2. Select the add button on each dataset you want to monitor
3. Select Monitored again to go back to your monitored list

Step 4: Read the Status Icons​

Each dataset in the list shows a row of status icons:

Delivery scores​

Step 5: Look at One Delivery​

Select a dataset to open its tabs on the right of the screen, for the selected date.

Other tabs may appear with documentation about the dataset, written by OpenDataDSL or by your own teams.

Step 6: Filter the List​

To find the datasets that need attention quickly, filter the list by:

• Delivery Status or Quality Status, for example only late and missing
• Provider, Feed, Product or DSID
• Category or Priority
• Smart Feed Status
• Source: private, common or public

Exercise​

1. Open the dataset monitoring dashboard and look at the overview by Provider, then by Priority
2. Add two datasets to your monitored list, for example ECB.FX.SPOT and one your team relies on
3. For each, note the delivery status, score and quality status for today
4. Open the General tab of one dataset. How many tenors were expected, and how many arrived?
5. Filter the list to show only datasets that are late or missing. If any are listed, open the Timeline tab to see what happened

Summary​

Further reading: Dataset Monitoring dashboard guide, Data Monitoring topic, Dataset Monitoring overview