hello. I have been running CryoSPARC v4.4 + on our cluster, However, a separate reinstall of the latest version, v4.4.1, won’t work, even though I updated the NVIDIA driver to v545.23.08. Our graphics card is a Tesla V100S-PCIE-32GB
v4.4.1 The following error occurs when using ‘cryosparcm woerks P1 --test gpu’
Traceback (most recent call last):
File "cryosparc_master/cryosparc_compute/run.py", line 95, in cryosparc_master.cryosparc_compute.run.main
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/cryosparc_compute/jobs/instance_testing/run.py", line 124, in run_gpu_job
gpucore.initialize(cuda_devs)
File "cryosparc_master/cryosparc_compute/gpu/gpucore.py", line 47, in cryosparc_master.cryosparc_compute.gpu.gpucore.initialize
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/site-packages/numba/cuda/cudadrv/driver.py", line 3318, in get_version
return driver.get_version()
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/site-packages/numba/cuda/cudadrv/driver.py", line 465, in get_version
version = driver.cuDriverGetVersion()
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/site-packages/numba/cuda/cudadrv/driver.py", line 296, in __getattr__
self.ensure_initialized()
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/site-packages/numba/cuda/cudadrv/driver.py", line 258, in ensure_initialized
self.cuInit(0)
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/site-packages/numba/cuda/cudadrv/driver.py", line 352, in safe_cuda_api_call
return self._check_cuda_python_error(fname, libfn(*args))
File "cuda/cuda.pyx", line 11326, in cuda.cuda.cuInit
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/enum.py", line 339, in __call__
return cls.__new__(cls, value)
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.8/enum.py", line 663, in __new__
raise ve_exc
ValueError: 4294967295 is not a valid CUresult
v4.4.1-240110 shows the following error when using ‘cryosparcm woerks P1 --test gpu’
Traceback (most recent call last):
File "cryosparc_master/cryosparc_compute/run.py", line 95, in cryosparc_master.cryosparc_compute.run.main
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/cryosparc_compute/jobs/instance_testing/run.py", line 85, in run_gpu_job
from ...gpu import driver, gpucore, gpuarray
File "cryosparc_master/cryosparc_compute/gpu/gpucore.py", line 30, in init cryosparc_master.cryosparc_compute.gpu.gpucore
File "/Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/cryosparc_compute/gpu/gpuarray.py", line 16, in <module>
from cryosparc_compute.skcuda_internal import gpufft
ImportError: /Share2/home/xxx/app/cryosparc_v4/cryosparc_worker/cryosparc_compute/skcuda_internal/gpufft.so: undefined symbol: cuDevicePrimaryCtxRelease_v2