How do I reinstall an update to the worker

[cryosparc_user@xingcryoem2 cryosparc2_worker]$ nvidia-smi
Wed Mar 1 16:00:19 2023
±----------------------------------------------------------------------------+
| NVIDIA-SMI 525.85.12 Driver Version: 525.85.12 CUDA Version: 12.0 |
|-------------------------------±---------------------±---------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce … Off | 00000000:1B:00.0 Off | N/A |
| 30% 28C P8 1W / 250W | 0MiB / 11264MiB | 0% Default |
| | | N/A |
±------------------------------±---------------------±---------------------+
| 1 NVIDIA GeForce … Off | 00000000:3E:00.0 Off | N/A |
| 29% 27C P8 12W / 250W | 0MiB / 11264MiB | 0% Default |
| | | N/A |
±------------------------------±---------------------±---------------------+
| 2 NVIDIA GeForce … Off | 00000000:88:00.0 Off | N/A |
| 29% 25C P8 11W / 250W | 0MiB / 11264MiB | 0% Default |
| | | N/A |
±------------------------------±---------------------±---------------------+
| 3 NVIDIA GeForce … Off | 00000000:B1:00.0 Off | N/A |
| 31% 28C P8 1W / 250W | 0MiB / 11264MiB | 0% Default |
| | | N/A |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| No running processes found |
±----------------------------------------------------------------------------+
[cryosparc_user@xingcryoem2 cryosparc2_worker]$

I believe that master is not allowed to use the worker.

Will register using ssh string: cryosparc_user@xingcryoem2.oncology.wisc.edu

The outputs of the nvidia- and cuda-related commands look as expected. It is possible that job-related logs and documents contain additional information. Would you like to email us the job report?

I discovered how I need to connect the worker to the master. I messed it up. Then I started over and did correctly and now it works. However, the worker did not update initially because we upgraded the drivers and nvidia installed cuda 12.0, which bombed the pycuda. Once I fixed and ran ‘install.sh’ with the correct link to v11.5, pycuda compiled and then I needed to connect the worker to master. But thanks for your patience and I learned a lot about how cryosparc is installed.

1 Like