Error when attempting to run multiple jobs simulatneously

Troubleshooting
1

Hello csparc community!

I’ve a 4xGPU machine that I’ve been able to run multiple ab-initio jobs at the same time before, but recently when trying to do so I get this error:

Traceback (most recent call last):
File “/opt/packages/cryosparc/cryosparc-compute/sparcjob.py”, line 84, in
import engine
File “/opt/packages/cryosparc/cryosparc-compute/engine/init.py”, line 8, in
from engine import *
File “/opt/packages/cryosparc/cryosparc-compute/engine/engine.py”, line 22, in
import symmetry
File “/opt/packages/cryosparc/cryosparc-compute/symmetry.py”, line 11, in
from quadrature import sk97,icosphere
File “/opt/packages/cryosparc/cryosparc-compute/quadrature/init.py”, line 22, in
from domain import FixedCircleDomain, FixedDirectionalDomain,
File “/opt/packages/cryosparc/cryosparc-compute/quadrature/domain.py”, line 10, in
import cryoops as cops
File “/opt/packages/cryosparc/cryosparc-compute/cryoops.py”, line 12, in
import sincint
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/pyximport/pyximport.py”, line 445, in load_module
language_level=self.language_level)
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/pyximport/pyximport.py”, line 234, in load_module
exec(“raise exc, None, tb”, {‘exc’: exc, ‘tb’: tb})
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/pyximport/pyximport.py”, line 216, in load_module
inplace=build_inplace, language_level=language_level)
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/pyximport/pyximport.py”, line 192, in build_module
reload_support=pyxargs.reload_support)
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/pyximport/pyxbuild.py”, line 143, in pyx_to_dll
raise ImportError(“reload count for %s reached maximum”%org_path)
ImportError: Building module sincint failed: [‘ImportError: reload count for /home/tlaughlin/.pyxbld/lib.linux-x86_64-2.7/sincint.so reached maximum\n’]

I can still run jobs in isolation. Explicitly specifying difference gid’s for each job doesn’t resolve this issue.

Any suggestions appreciated!

2

Also getting this error at the end homogeneous refinement runs complete. The jobs finished but the results can’t be used as input for subsequent jobs.

Traceback (most recent call last):
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/atexit.py”, line 24, in _run_exitfuncs
func(*targs, **kargs)
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/IPython/core/interactiveshell.py”, line 3212, in atexit_operations
self.history_manager.end_session()
File “/opt/packages/cryosparc/anaconda2/lib/python2.7/site-packages/IPython/core/history.py”, line 583, in end_session
len(self.input_hist_parsed)-1, self.session_number))
OperationalError: unable to open database file

3

Hi @t.laughlin, which version of cryoSPARC are you running?

4

I am running version 0.6.5

5