Datacenter User Guide

Version 2.2 | Published May 16, 2024 ©

Fluid Data Services

This section provides the steps to configure a Fluid Data Services dataset.

  1. Create a new dataset of type Fluid Data Services, specifying a name and (optionally) a prefix to use to identify the dataset and its values, respectively:

    images/download/thumbnails/149925203/image-2024-1-25_16-53-23.png
  2. Click Add. The dataset is added to the list, and it has an initial WARNING status as it contains no configured endpoints yet.

    images/download/thumbnails/149925203/image-2023-8-16_14-27-2.png
  3. Select one or more endpoints from the table in the Dataset configuration panel by double clicking a row. A new endpoint card is then created.
    images/download/attachments/149925203/image-2024-1-25_16-54-2.png
    Alternatively, you can enter a new endpoint by clicking Add new endpoint on the right-side of the panel, and then clicking on the empty endpoint that is added at the bottom of the table to configure it.
    images/download/attachments/149925203/image-2023-8-16_14-6-47.png
    This reveals the new endpoint details, where its properties can be entered.
    images/download/attachments/149925203/image-2024-1-25_16-54-26.png

    Endpoint Options: When adding a new endpoint, parameters (for example, parts of the endpoint whose value should be fetched from other endpoints) should be encapsulated in curly braces: {part_name}.
    The value inside curly braces is then resolved either using other endpoints present in the Dataset configuration table, or the ones specified in the Endpoint fixed options section of the main view.

    Using as example the images above, the following endpoint /Competitions/{Competition}/{%year%}/teams/{Team}/actors, would use the {Competition} and {Team} options from the respective endpoint in the table. The {%year%} option, on the other hand, is a special token used to list years as date.

  4. Once an endpoint is added to a dataset, you can select the endpoint card in the Dataset configuration panel. You can now edit the endpoint configuration (for example, Sport, Competition and Year shown in the picture below) in the Endpoint parameters panel on the right.

    images/download/attachments/149925203/image-2024-1-25_16-58-54.png
  5. To change the polling rate (how often the Fluid remote host is polled for data, in s) for the dataset, select an endpoint card from the list and edit the Polling field in the Dataset parameters on the right-most column. images/download/thumbnails/149925203/image-2024-1-25_17-0-44.png

  6. When done, the data is added to the Dataset output table.

    images/download/attachments/149925203/image-2024-1-25_16-59-36.png

Filter a Dataset

Values read from a file into a dataset can be filtered with the Filtering tool. To do so, select the dataset card, click on the hamburger menu and then press the Filter button.

images/download/attachments/149925203/image-2023-8-16_15-52-50.png

A dialog visualizing the file's payload schema opens, through which a user can filter the source data.

images/download/attachments/149925203/image-2023-8-16_15-53-12.png

Please refer to the Filtering and Manipulating the Dataset Entries page to learn how to enable, disable and edit the entries added.