GPU error - Deep Picker Train

Hi CS Team

I am getting following assertion error when I try to run Deep Picker Train. I have tried with 1 parallel thread as well as 4.
AssertionError: Input number of GPUs must be less than or equal to number of available GPUs. Please check job log for more information.

Any ideas?

Please could you share the job log, which can be retrieved with this command:
cryosparcm joblog <project_id> <job_id>
Please also post a screenshot of the failed job’s Parameters and Inputs tab.

Here you go:


The following suggestion has worked for a user who was facing a very similar issue:

In your case, the directory seems to be /usr/local/cuda-11.4/lib64, where you first would want to confirm that the file libcusolver.so.11 exists.

Yes, the file libcusolver.so.11 does exist.

Did you try linking (requires write privileges in /usr/local/cuda-11.4)

and running the Deep Picker Train job again?

1 Like

Hi @wtempel

The solution worked like a charm.

Thank you for your help.

Prash

As an alternative to hard linking libcusolver.so.11, we created a directory containing a symlink to libcusolver.so.11 and added it to $LD_LIBRARY_PATH.

export LD_LIBRARY_PATH=/path/to/directory:$LD_LIBRARY_PATH
{{ run_cmd }}

1 Like