dpgen.dispatcher package

Submodules

dpgen.dispatcher.Dispatcher module

dpgen.dispatcher.Dispatcher.make_submission(mdata_machine, mdata_resources, commands, work_path, run_tasks, group_size, forward_common_files, forward_files, backward_files, outlog, errlog)[source]
dpgen.dispatcher.Dispatcher.make_submission_compat(machine: dict, resources: dict, commands: list[str], work_path: str, run_tasks: list[str], group_size: int, forward_common_files: list[str], forward_files: list[str], backward_files: list[str], outlog: str = 'log', errlog: str = 'err', api_version: str = '1.0') None[source]

Make submission with compatibility of both dispatcher API v0 and v1.

If api_version is less than 1.0, raise RuntimeError. If api_version is large than 1.0, use make_submission.

Parameters:
machinedict

machine dict

resourcesdict

resource dict

commandslist[str]

list of commands

work_pathstr

working directory

run_taskslist[str]

list of paths to running tasks

group_sizeint

group size

forward_common_fileslist[str]

forwarded common files shared for all tasks

forward_fileslist[str]

forwarded files for each task

backward_fileslist[str]

backwarded files for each task

outlogstr, default=log

path to log from stdout

errlogstr, default=err

path to log from stderr

api_versionstr, default=1.0

API version. 1.0 is required

dpgen.dispatcher.Dispatcher.mdata_arginfo() list[Argument][source]

This method generates arginfo for a single mdata.

A submission requires the following keys: command, machine, and resources.

Returns:
list[Argument]

arginfo