File: checkpointing_code.rst

package info (click to toggle)
python-ruffus 2.6.3%2Bdfsg-4
  • links: PTS, VCS
  • area: main
  • in suites: stretch
  • size: 20,828 kB
  • ctags: 2,843
  • sloc: python: 15,745; makefile: 180; sh: 14
file content (57 lines) | stat: -rw-r--r-- 1,832 bytes parent folder | download | duplicates (6)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
.. include:: ../../global.inc
.. include:: manual_chapter_numbers.inc

.. _new_manual.checkpointing.code:

#################################################################################################################
|new_manual.checkpointing.chapter_num|: Python Code for Checkpointing: Interrupted Pipelines and Exceptions
#################################################################################################################

.. seealso::

    * :ref:`Manual Table of Contents <new_manual.table_of_contents>`
    * :ref:`Back to |new_manual.checkpointing.chapter_num|: Interrupted Pipelines and Exceptions <new_manual.checkpointing>`


************************************************************************
Code for the "Interrupting tasks" example
************************************************************************

    .. <<python

    .. code-block:: python



        from ruffus import *

        from ruffus import *
        import sys, time

        #   create initial files
        @originate(['job1.start'])
        def create_initial_files(output_file):
            with open(output_file, "w") as oo: pass


        #---------------------------------------------------------------
        #
        #   long task to interrupt
        #
        @transform(create_initial_files, suffix(".start"), ".output")
        def long_task(input_files, output_file):
            with open(output_file, "w") as ff:
                ff.write("Unfinished...")
                # sleep for 2 seconds here so you can interrupt me
                sys.stderr.write("Job started. Press ^C to interrupt me now...\n")
                time.sleep(2)
                ff.write("\nFinished")
                sys.stderr.write("Job completed.\n")


        #       Run
        pipeline_run([long_task])

    ..
        python