Skip to main content

Introduction

Detailed information on Active Variables and the services used by them

Active variables are the defining feature of OpenDataDSL which allows the user to interact directly with the Data Management System through the use of a well-defined, simple to use variable construct.

In OpenDataDSL, active variables provide a way to interact with the database and services to help you collect, validate, manage and report on your data.

The syntax of an active variable is as follows:

${service (:source)? }
${service: (source/)? id (:version)? (,option)* } (for range)?

Examples:

actvar = ${action:"#name"}
save ${action:actvar}
tag ${action:actvar} as PROD
actvarprod = ${action:"#name":PROD}

objects = find ${object:public} where dataset == "BOE_FX"

External Data Collection Services​

A list of services that help you collect data from various locations and various file formats

Azure File Service (azfile)​

A service to read files from an Azure Storage Account

CSV​

A service to read CSV files as a list of row variables or as a table variable

DHTML​

A service to read Dynamic HTML pages as an object variable

File​

A service to read files from the local file system

FTP​

A service to read files from an FTP site

GZIP​

A service to handle the extraction of data from a compressed zip file

HTML​

A service to read a HTML page as an object variable

JSON​

A service to read a JSON format file as an object variable

ODS​

A service to read an ODS (OpenDocument) format file as a spreadsheet variable

PDF​

A service to read a PDF format file as an object variable

S3​

A service to read files from an AWS S3 bucket

XLS​

A service to read XLS spreadsheet files as a spreadsheet variable

XML​

A service to read XML format files as an object or list variable

Archive​

A service to keep a copy of a source file in your file archive

Azure Blob Service (azblob)​

A service to read and write files in Azure Blob Storage

CURL​

A service to download files with the curl tool

Kafka​

A service to read JSON messages from Apache Kafka topics

Mail​

A service to read emails and their attachments from a mailbox

OpenDataDSL Remote Services​

This is a list of active variable services that interact with the OpenDataDSL remote services

Action Service​

Workflow actions allow you to personalise your processes with snippets of code to perform a specialised action within a workflow

Audit Service​

The audit service allows you to view all the changes that have happened in your environment

Calendar Service​

The calendar service allows you to create and use all the calendars in the system

Currency Service​

A service to use the publically available FX rates

Curve Service​

The curve service is used for interacting with Forward Curve configurations

Environment Service​

This service allows you to manage your data environments

Expiry Calendar Service​

The expiry calendar service allows you to manage and use expiry calendars in your scripts

Extractor Service​

The extractor service allows you to manage and use data extractors

Object Service​

The object service allows you to manage, browse, search for and use stored objects

Process Service​

The process service allows you to manage your scheduled and event driven remote processes

Secret Service​

The secret service allows you to securely store secrets such as passwords or security tokens

Script Service​

The script service allows you to store and retrieve ODSL scripts

Tenant Service​

A service to view and record your company information and tenancy configuration

Transformer Service​

The transformer service allows you to store and manage data transformers

Type Service​

The type service allows you to store and maintain data types used in data modelling

User Service​

A service to view and record your user information

Workflow Service​

The workflow services allows you to store and manage workflows

AI Agent Service​

Your Fusion AI agents

AI Assistant Service​

The Fusion AI assistants, built-in and custom

AI Playbook Service​

Fusion AI playbooks

AI Run Service​

The records of Fusion AI playbook runs

AI Task Service​

Fusion AI playbook tasks

AI Tool Service​

Your Fusion AI custom tools

AI Usage Service​

Fusion AI token usage

Alert Service​

Alerts about your data and the shared data you use

Automation Service​

Your automations

Automation Target Service​

Automation targets

Automation Log Service​

The log of each automation run

Batch Service​

The summaries of batch updates

Correction Service​

Corrections to dataset data

Data Service​

Timeseries, curves and other data

Dataset Service​

Dataset monitoring

Dataset Delivery Service​

Dataset deliveries

Documentation Service​

Documentation for items and services

Group Service​

Groups of items

Index Service​

Database indexes

Metric Service​

Usage metrics

Policy Service​

Security policies

Process Execution Service​

Process execution logs

Queue Service​

Message queues

Queue Log Service​

The log of queue messages

Report Service​

Stored reports

Report Configuration Service​

Report configurations

Report Creator Service​

Report creators

Script Log Service​

The log of each script run

Task Service​

Tasks assigned to users

Validation Service​

Validation records

Validation Config Service​

Validation configurations

Variable Services​

These services help you work with OpenDataDSL variables

Date Service​

Create and utilise dates

Memory Service​

Recreate the current session by saving all variables in memory, then re-loading them later