DPDispatcher API
- dpdispatcher package
DistributedShellDpCloudServerDpCloudServerContextHDFSContextJobLSFLazyLocalContextLazyLocalContext.bind_submission()LazyLocalContext.block_call()LazyLocalContext.block_checkcall()LazyLocalContext.call()LazyLocalContext.check_file_exists()LazyLocalContext.check_finish()LazyLocalContext.clean()LazyLocalContext.download()LazyLocalContext.get_job_root()LazyLocalContext.get_return()LazyLocalContext.load_from_dict()LazyLocalContext.read_file()LazyLocalContext.upload()LazyLocalContext.write_file()
LebesgueLebesgueContextLocalContextLocalContext.bind_submission()LocalContext.block_call()LocalContext.block_checkcall()LocalContext.call()LocalContext.check_file_exists()LocalContext.check_finish()LocalContext.clean()LocalContext.download()LocalContext.get_job_root()LocalContext.get_return()LocalContext.load_from_dict()LocalContext.read_file()LocalContext.upload()LocalContext.write_file()
MachineMachine.aliasMachine.arginfo()Machine.bind_context()Machine.check_finish_tag()Machine.check_if_recover()Machine.check_status()Machine.default_resources()Machine.deserialize()Machine.do_submit()Machine.gen_command_env_cuda_devices()Machine.gen_script()Machine.gen_script_command()Machine.gen_script_custom_flags_lines()Machine.gen_script_end()Machine.gen_script_env()Machine.gen_script_header()Machine.gen_script_wait()Machine.kill()Machine.load_from_dict()Machine.load_from_json()Machine.optionsMachine.resources_arginfo()Machine.resources_subfields()Machine.serialize()Machine.sub_script_cmd()Machine.sub_script_head()Machine.subclasses_dict
PBSResourcesSSHContextSSHContext.bind_submission()SSHContext.block_call()SSHContext.block_checkcall()SSHContext.call()SSHContext.check_file_exists()SSHContext.check_finish()SSHContext.clean()SSHContext.close()SSHContext.download()SSHContext.get_job_root()SSHContext.get_return()SSHContext.load_from_dict()SSHContext.machine_subfields()SSHContext.read_file()SSHContext.sftpSSHContext.sshSSHContext.upload()SSHContext.write_file()
ShellSlurmSubmissionSubmission.bind_machine()Submission.check_all_finished()Submission.check_ratio_unfinished()Submission.clean_jobs()Submission.deserialize()Submission.download_jobs()Submission.generate_jobs()Submission.get_hash()Submission.handle_unexpected_submission_state()Submission.register_task()Submission.register_task_list()Submission.remove_unfinished_tasks()Submission.run_submission()Submission.serialize()Submission.submission_from_json()Submission.submission_to_json()Submission.try_recover_from_json()Submission.update_submission_state()Submission.upload_jobs()
TaskTorqueinfo()- Subpackages
- Submodules
- dpdispatcher.JobStatus module
- dpdispatcher.arginfo module
- dpdispatcher.base_context module
BaseContextBaseContext.aliasBaseContext.bind_submission()BaseContext.check_finish()BaseContext.clean()BaseContext.download()BaseContext.load_from_dict()BaseContext.machine_arginfo()BaseContext.machine_subfields()BaseContext.optionsBaseContext.read_file()BaseContext.subclasses_dictBaseContext.upload()BaseContext.write_file()
- dpdispatcher.distributed_shell module
- dpdispatcher.dp_cloud_server module
- dpdispatcher.dp_cloud_server_context module
BohriumContextBohriumContext.aliasBohriumContext.bind_submission()BohriumContext.check_file_exists()BohriumContext.check_home_file_exits()BohriumContext.clean()BohriumContext.download()BohriumContext.load_from_dict()BohriumContext.machine_subfields()BohriumContext.read_file()BohriumContext.read_home_file()BohriumContext.upload()BohriumContext.upload_job()BohriumContext.write_file()BohriumContext.write_home_file()BohriumContext.write_local_file()
DpCloudServerContextLebesgueContext
- dpdispatcher.dpdisp module
- dpdispatcher.hdfs_cli module
- dpdispatcher.hdfs_context module
- dpdispatcher.lazy_local_context module
LazyLocalContextLazyLocalContext.bind_submission()LazyLocalContext.block_call()LazyLocalContext.block_checkcall()LazyLocalContext.call()LazyLocalContext.check_file_exists()LazyLocalContext.check_finish()LazyLocalContext.clean()LazyLocalContext.download()LazyLocalContext.get_job_root()LazyLocalContext.get_return()LazyLocalContext.load_from_dict()LazyLocalContext.read_file()LazyLocalContext.upload()LazyLocalContext.write_file()
SPRetObj
- dpdispatcher.local_context module
LocalContextLocalContext.bind_submission()LocalContext.block_call()LocalContext.block_checkcall()LocalContext.call()LocalContext.check_file_exists()LocalContext.check_finish()LocalContext.clean()LocalContext.download()LocalContext.get_job_root()LocalContext.get_return()LocalContext.load_from_dict()LocalContext.read_file()LocalContext.upload()LocalContext.write_file()
SPRetObj
- dpdispatcher.lsf module
- dpdispatcher.machine module
MachineMachine.aliasMachine.arginfo()Machine.bind_context()Machine.check_finish_tag()Machine.check_if_recover()Machine.check_status()Machine.default_resources()Machine.deserialize()Machine.do_submit()Machine.gen_command_env_cuda_devices()Machine.gen_script()Machine.gen_script_command()Machine.gen_script_custom_flags_lines()Machine.gen_script_end()Machine.gen_script_env()Machine.gen_script_header()Machine.gen_script_wait()Machine.kill()Machine.load_from_dict()Machine.load_from_json()Machine.optionsMachine.resources_arginfo()Machine.resources_subfields()Machine.serialize()Machine.sub_script_cmd()Machine.sub_script_head()Machine.subclasses_dict
- dpdispatcher.pbs module
- dpdispatcher.shell module
- dpdispatcher.slurm module
- dpdispatcher.ssh_context module
SSHContextSSHContext.bind_submission()SSHContext.block_call()SSHContext.block_checkcall()SSHContext.call()SSHContext.check_file_exists()SSHContext.check_finish()SSHContext.clean()SSHContext.close()SSHContext.download()SSHContext.get_job_root()SSHContext.get_return()SSHContext.load_from_dict()SSHContext.machine_subfields()SSHContext.read_file()SSHContext.sftpSSHContext.sshSSHContext.upload()SSHContext.write_file()
SSHSession
- dpdispatcher.submission module
JobResourcesSubmissionSubmission.bind_machine()Submission.check_all_finished()Submission.check_ratio_unfinished()Submission.clean_jobs()Submission.deserialize()Submission.download_jobs()Submission.generate_jobs()Submission.get_hash()Submission.handle_unexpected_submission_state()Submission.register_task()Submission.register_task_list()Submission.remove_unfinished_tasks()Submission.run_submission()Submission.serialize()Submission.submission_from_json()Submission.submission_to_json()Submission.try_recover_from_json()Submission.update_submission_state()Submission.upload_jobs()
Task
- dpdispatcher.utils module