1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
|
DAGMan Workflows
================
DAGMan is a HTCondor tool that allows multiple jobs to be organized in
**workflows**, represented as a directed acyclic graph (DAG). A DAGMan workflow
automatically submits jobs in a particular order, such that certain jobs need
to complete before others start running. This allows the outputs of some jobs
to be used as inputs for others, and makes it easy to replicate a workflow
multiple times in the future.
.. sidebar:: Example DAG Visualized
.. mermaid::
:align: center
flowchart TD
A --> B
A simple example is a workflow that requires output from node ``A`` to become
input for node ``B``. This can be described as a DAGMan workflow as follows:
.. code-block:: condor-dagman
:caption: Example DAG description file
# Example DAGMan Workflow
JOB A produce_data.sub
JOB B process_data.sub
PARENT A CHILD B
.. note::
A video introducing the DAGman tool for beginners is available at
https://www.youtube.com/watch?v=1MvVHxRs7iU and another video, for
intermediate users, is available at
https://www.youtube.com/watch?v=C2RkdxE_ph0 . A link to the slides is
available in the videos' description.
.. toctree::
:maxdepth: 2
:glob:
dagman-introduction
dagman-interaction
dagman-completion
dagman-using-other-dags
dagman-advance-functionality
dagman-information-files
dagman-reference
|
