Workflows

A Workflow represents an ETL flow. In most cases, a workflow will consist of the following:

• Extraction from a source connection

• Transformation of the extracted data

• Upload into a destination connection

Workflow Editor

The Workflow Editor is the interface where you build your workflow. It's a node-based editor where you describe the data flow by adding and connecting various nodes.

In the image above, you can see an example of a complete workflow. Here's a general overview of the various aspects of the interface:

1. The name of the workflow.

2. The environment the workflow is being viewed in.

3. An Extract node, where the source data originates from.

4. A Transform node, where source columns are modified and/or mapped to new columns.

5. A Load node, where the modified data is loaded into.

6. Node options (e.g., rename, delete, etc.).

7. Node connection points and edges.

8. Button to access workflow settings.

9. Button to access the workflow scheduler.

At the moment, each node can only have one incoming connection (if available) and one outgoing connection (if available).

Settings

Beyond configuring the individual nodes that make up a workflow, each workflow has various settings that can be configured.

Nodes

For more information about the individual nodes, please refer to their specific reference pages.

ExtractTransformLoadFilter