Example Tasks

Example tasks can be found in TASKS_DIR which is configured in pydra_settings. By default pydra_settings is located in /etc/pydra and TASKS_DIR is set to /var/lib/pydra/tasks ' There are several demo classes available:

• demo_task.py
  • TestTask - runs simple counting
  • TestContainerTask - runs a series of TestTasks sequentially using TaskContainer
  • ParallelTestTask - runs a series of TestTasks in parallel using ParallelTask.

• mapreduce.py
  • CountWords - uses MapReduceTask to count words in a set of dictionaries.

• fail_tasks.py
  • FailTask, FaillingContainerTask, FaillingParallelTask - demonstrates tasks failing.