CUDA error in NU refine

Traceback (most recent call last): File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 254, in ensure_initialized self.cuInit(0) File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 348, in safe_cuda_api_call return self._check_cuda_python_error(fname, libfn(*args)) File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 408, in _check_cuda_python_error raise CudaAPIError(retcode, msg) numba.cuda.cudadrv.driver.CudaAPIError: [CUresult.CUDA_ERROR_NO_DEVICE] Call to cuInit results in CUDA_ERROR_NO_DEVICE During handling of the above exception, another exception occurred: Traceback (most recent call last): File “cryosparc_master/cryosparc_compute/run.py”, line 129, in cryosparc_master.cryosparc_compute.run.main File “cryosparc_master/cryosparc_compute/jobs/refine/newrun.py”, line 392, in cryosparc_master.cryosparc_compute.jobs.refine.newrun.run_homo_refine File “cryosparc_master/cryosparc_compute/engine/engine.py”, line 971, in cryosparc_master.cryosparc_compute.engine.engine.process File “cryosparc_master/cryosparc_compute/gpu/gpucore.py”, line 49, in cryosparc_master.cryosparc_compute.gpu.gpucore.initialize File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 3216, in get_version return driver.get_version() File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 461, in get_version version = driver.cuDriverGetVersion() File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 292, in _getattr_ self.ensure_initialized() File “/home/test/cryosparcuser/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/site-packages/numba/cuda/cudadrv/driver.py”, line 258, in ensure_initialized raise CudaSupportError(f"Error at driver init: {description}") numba.cuda.cudadrv.error.CudaSupportError: Error at driver init: Call to cuInit results in CUDA_ERROR_NO_DEVICE (100)

More information would be useful. What version of CryoSPARC? What GPUs? What driver version? Output of nvidia-smi?

cryoSPARC version: v4.7.0

01:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1)

Output of nvidia-smi

NVIDIA-SMI has failed because it couldn’t communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

You probably did an update and the driver is not installed in the current kernel.

Reboot the system and try running nvidia-smi again, it will probably work. If, not you need to re-install the driver.

I have rebooted , it still doesnt work

Find the appropriate version of Linux you are running on this website, and follow the instructions. It’s usually pretty easy. :slight_smile:

Good luck!

Despite the “smart” linking feature reporting that site is CUDA 12.1, it’s actually 13.1 update 1.