Hi,
I am facing a recurrent problem of jobs ending with “job process terminated abnormally”. Below is a log file for more details. I get this error with different data sets and parameters and it happens at different stages of running jobs. I added CRYOSPARC_NO_PAGELOCK=true to worker config but didn’t help. It mainly happens at 2D but also in Ab-initio.
I have a workstation with 4 RTX 2080 Ti, 24 CPUs, Centos 7, box size: 90-360
I was wondering if there is a fix for it? or it’s related to the computational setup?
Thanks,
Yashar
/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/sigproc.py:890: RuntimeWarning: invalid value encountered in true_divide
frc[k, :copylen] = (AB / n.sqrt(AA*BB))[:copylen]
========= sending heartbeat
set status to waiting
set status to running
HOST ALLOCATION FUNCTION: using n.empty (CRYOSPARC_NO_PAGELOCK==true)
HOST ALLOCATION FUNCTION: using n.empty (CRYOSPARC_NO_PAGELOCK==true)
HOST ALLOCATION FUNCTION: using n.empty (CRYOSPARC_NO_PAGELOCK==true)
HOST ALLOCATION FUNCTION: using n.empty (CRYOSPARC_NO_PAGELOCK==true)
========= main process now complete.
========= monitor process now complete.