Patch Motion Correction failed on CS v 4.0.3 with error "worker thread with PID 2645589 terminating self"

Hi
my Patch Motion Correction job keeps failing with the error “worker thread with PID 2645589 terminating self”.
It does not fail instantly, it processes some movies (sometimes 1000, sometimes 2000) but never completes. I have tried dedicated computer with 2 GPUs as well as cluster, but no success.

Full error message:

Error occurred while processing J8/imported/011427049371696467516_FoilHole_26246118_Data_26235292_26235294_20230426_221134_fractions.tiff
Traceback (most recent call last):
File “/lmb/home/sislam/soft/cryosparc/cryosparc_worker/cryosparc_compute/jobs/pipeline.py”, line 60, in exec
return self.process(item)
File “cryosparc_worker/cryosparc_compute/jobs/motioncorrection/run_patch.py”, line 324, in cryosparc_compute.jobs.motioncorrection.run_patch.run_patch_motion_correction_multi.motionworker.process
AssertionError: Job is not in running state - worker thread with PID 2645589 terminating self.

Marking J8/imported/011427049371696467516_FoilHole_26246118_Data_26235292_26235294_20230426_221134_fractions.tiff as incomplete and continuing…

Any help will be appreciated!
Saif

Welcome to the forum @SaifCam. Please can you post relevant messages from the job log, accessible via Metadata|Log.