add ability to resume a task

[anwarfg]

Is this the right issue type?

• Yes, I'm planning work for this project team.

Summary

If the client code has to stop running (e.g., auth failure, connection failure), the task is orphaned and can't be picked up again.
Should include polling, caching data, and aggregation.
Separate submission from polling and retrieval.

Acceptance Criteria

• Orphaned tasks can be resumed.
• Submission result is checked
• Data is polled for on minio, or a message is returned dependent on state of submission.
• Returned data is cached as normal
• Returned data is aggregated.
• Tests pass.
• Documentation added.

Tasks

• Can be run separately to resume, given an existing ID.
• Unit tests.
• Documentation.

Confirm creation

• Ready to create this deliverable?

[anwarfg]

Basically, the second half of the runner needs to be runnable separately - from the part where is sends the message and collects results. But it needs to be simplified, and with a minimum of instantiating classes and passing variables around.