Workflows #

Workflows are tasks that manipulate data by transforming it and moving to a specified target (e.g. different database or a file). A Workflow must have a valid structure.

The structure validation happens in the Modeler, where you connect various Components with each other. A valid structure is one that has at least one Data Source and one Data Target. All Components need to have a correct number of inputs and outputs and all must be correctly configured (i.e. have correct columns mapped for the Join Transformation, the Excel source has a valid sheet name chosen, etc.)

Workflow run logs #

When you click the small Status icon in the upper right corner of the Workflow, a popup for the Workflow run log will present details of the latest log entry:

1. the name of the Process in which this Workflow is used,
2. the name of this Workflow,
3. the Status of the last execution,
4. the Task id ,
5. the Parent task id,
6. when the Workflow entered the queue to be run,
7. the date this Workflow was last executed,
8. the Duration how long this Workflow has been running; only available if the Workflow Status is SUCCESS or ERROR,
9. a table of errors that occured during the execution (if there were any):
   • Node (A) - the Component which caused the error,
   • Driver (B) - the driver used in the Component,
   • Field (C) - the element that caused the error (if applicable),
   • Error message (D) - the error message returned,
10. the Stack trace generated by the error (if there was any).

Clicking the Show whole history button will navigate you to the list of all of this Workflow’s logs. At the top you will see the name of the Process in which this Workflow is used, the step it is used in and the name of this Workflow. There you will see a list of all logs of previous Workflow executions. Each element on the list consists of:

1. its ID,
2. the date it has been queued to be run,
3. its start date,
4. its duration (only available if the Workflow Status is SUCCESS or ERROR),
5. the Celery task id the log refers to,
6. the Celery parent task id the log refers to,
7. its Status; click it to view the log details.

At the bottom you will find navigation tools (8) if there are more recorded logs.

Export Workflows #

You can export Workflows by clicking Export Workkflow in the Workkflow actions (accessible by clicking the icon on the Workkflow).

This will navigate you to the Export Workkflow section where you need to provide:

1. a Filename for the exported Workkflow,
2. a Password for the file (Optional),
3. additional options:
   • whether to include in the exported file the Predefined Data Sources used in the modifier,
   • whether to include in the exported file the Predefined Data Targets used in the modifier,

All exported Predefined Data Sources and Predefined Data Targets include database and user names as well as passwords!

Only the user with the predef_target_management and predef_source_management permissions (respectively) or the administration permission can include Predefined Sources and Targets!

After clicking the Check content button, you will be navigated to a view where you will see all the Predefined Data Sources and Predefined Data Targets that will be included in the export (if Include predefined targets and/or Include predefined sources was checked).

Clicking the Cancel button will return you to the Export Workflow section.

By clicking the Save button, you will download a file containing the exported Workflow. The file can be then imported to any Process.