Skip to main content

Introduction

Detailed information on Active Variables and the services used by them

Active variables are the defining feature of OpenDataDSL which allows the user to interact directly with the Data Management System through the use of a well-defined, simple to use variable construct.

In OpenDataDSL, active variables provide a way to interact with the database and services to help you collect, validate, manage and report on your data.

The syntax of an active variable is as follows:

${service (:source)? }
${service: (source/)? id (:version)? (,option)* } (for range)?

Examples:

actvar = ${action:"#name"}
save ${action:actvar}
tag ${action:actvar} as PROD
actvarprod = ${action:"#name":PROD}

objects = find ${object:public} where dataset == "BOE_FX"

External Data Collection Services

A list of services that help you collect data from various locations and various file formats

Azure File Service (azfile)

A service to read files from an Azure Storage Account

CSV

A service to read CSV files as a list of row variables or as a table variable

DHTML

A service to read Dynamic HTML pages as an object variable

File

A service to read files from the local file system

FTP

A service to read files from an FTP site

GZIP

A service to handle the extraction of data from a compressed zip file

HTML

A service to read a HTML page as an object variable

JSON

A service to read a JSON format file as an object variable

ODS

A service to read an ODS (OpenDocument) format file as a spreadsheet variable

PDF

A service to read a PDF format file as an object variable

S3

A service to read files from an AWS S3 bucket

XLS

A service to read XLS spreadsheet files as a spreadsheet variable

XML

A service to read XML format files as an object or list variable

OpenDataDSL Remote Services

This is a list of active variable services that interact with the OpenDataDSL remote services

Action Service

Workflow actions allow you to personalise your processes with snippets of code to perform a specialised action within a workflow

Audit Service

The audit service allows you to view all the changes that have happened in your environment

Calendar Service

The calendar service allows you to create and use all the calendars in the system

Currency Service

A service to use the publically available FX rates

Curve Service

The curve service is used for interacting with Forward Curve configurations

Environment Service

This service allows you to manage your data environments

Expiry Calendar Service

The expiry calendar service allows you to manage and use expiry calendars in your scripts

Extractor Service

The extractor service allows you to manage and use data extractors

Object Service

The object service allows you to manage, browse, search for and use stored objects

Process Service

The process service allows you to manage your scheduled and event driven remote processes

Secret Service

The secret service allows you to securely store secrets such as passwords or security tokens

Script Service

The script service allows you to store and retrieve ODSL scripts

Tenant Service

A service to view and record your company information and tenancy configuration

Transformer Service

The transformer service allows you to store and manage data transformers

Type Service

The type service allows you to store and maintain data types used in data modelling

User Service

A service to view and record your user information

Workflow Service

The workflow services allows you to store and manage workflows

Variable Services

These services help you work with OpenDataDSL variables

Date Service

Create and utilise dates

Memory Service

Recreate the current session by saving all variables in memory, then re-loading them later