Celery Tasks#

Distributed task definitions executed by Celery workers.

staging_tasks#

Celery tasks for data staging - delegates to data-transfer staging infrastructure.

ccat_data_transferccat_workflow_manager.tasks.staging_tasks.check_staging_complete(executed_step_id: int)#

Check if staging job for a reduction step run has completed.

hpc_tasks#

Celery tasks for HPC job submission.

ccat_data_transferccat_workflow_manager.tasks.hpc_tasks.submit_hpc_job(executed_step_id: int)#

Submit a reduction step run to the HPC backend.

result_tasks#

Celery tasks for result collection.

ccat_data_transferccat_workflow_manager.tasks.result_tasks.check_hpc_status(executed_step_id: int)#

Check HPC job status for a reduction step run.