Version mismatch between worker and master

Install, Configure and Update
1

Hi. I recently updated cryosparc to version v4.7.1. Everything seemed to go well and cryosparc is running, the only issue is that there is a version mismatch between worker and master that pops up every time we run a manually curate exposures job. See below:

[CPU: 90.5 MB Avail: 201.68 GB]
Traceback (most recent call last):
File “cryosparc_master/cryosparc_compute/run.py”, line 79, in cryosparc_master.cryosparc_compute.run.main
AssertionError: Version mismatch! Worker version (v4.7.1) and Master version (v4.6.2) are not the same. Please update

From looking at some old posts, it seems like the thing to do is navigate to the cryosparc worker directory and manually update the worker (or maybe in the case, manually update the master?). However, I only recently took over as the cryosparc administrator and was not involved in the initial install. I do not know where the cryosparc worker directory is located, or how to find it. I do not see a folder in our cryosparc directory called “cryosparc worker” or anything like that.

Any advice would be appreciated.

Thanks!

2

Welcome to the forum @Nmorano1 . Here are a few things that you may want to try:

  1. Confirm that the CryoSPARC installation that you updated is the same CryoSPARC installation whose web UI you are using. A confusion may have occurred, for example, if on a given server multiple CryoSPARC instances (with distinct installation paths, databases, port ranges and license IDs) are operated. What is the output of the command (on the CryoSPARC master server):
    ps -eo user,pid,ppid,start,cmd | grep supervisord
  2. Consider the possibility that pre-update CryoSPARC master processes may still be running. Perform a thorough shutdown of CryoSPARC, followed by a CryoSPARC startup. Does the version mismatch issue persist afterward?

The path(s) to cryosparc_worker/ associated with a CryoSPARC instance can be viewed by running the command (on the CryoSPARC master):

/absolute_path_to/cryosparc_master/bin/cryosparcm cli "get_scheduler_targets()"
3

Hi, I was able to solve this with two fold steps. First, I realized that cryosparcm stop wasnt working. So, I killed all jobs manually using the kill command, and then started cryosparc. This caused the problem to flip. Instead, the error was with GPU running jobs and the error was below:

AssertionError: Version mismatch! Worker version (v4.6.1) and Master version (v4.7.1) are not the same. Please update

This did not really make sense to me, but I then updated the worker with the following commands from the worker directory (with cryosparc stopped and where XXX-XXX-XXX is my license ID):

[cryosparc@gates cryosparc_worker]$ export CRYOSPARC_LICENSE_ID="XXX-XXX-XXX"
[cryosparc@gates cryosparc_worker]$ curl -L https://get.cryosparc.com/download/worker-latest/$CRYOSPARC_LICENSE_ID -o cryosparc_worker.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
100 3993M  100 3993M    0     0  39.9M      0  0:01:40  0:01:40 --:--:-- 34.0M
[cryosparc@gates cryosparc_worker]$ 
[cryosparc@gates cryosparc_worker]$ 
[cryosparc@gates cryosparc_worker]$ 
[cryosparc@gates cryosparc_worker]$ ./bin/cryosparcw update
Updating... checking versions
Current version v4.6.2 - New version v4.7.1 
=============================
Updating worker...
=============================
  Deleting old files...
  Extracting...
  Cleaning up...
  Done.
  Updating dependencies...
Checking dependencies... 
Dependencies for python have not changed.
Currently checking hash for ctffind
Dependencies for ctffind have not changed.
Currently checking hash for gctf
Dependencies for gctf have not changed.
Completed dependency check.

Successfully updated.

I then restarted cryosparc and everything works fine

1 Like
4

Sorry, formatting above is weird. Exact commands are below:

export CRYOSPARC_LICENSE_ID=“XXX-XXX-XXX”

curl -L https://get.cryosparc.com/download/worker-latest/$CRYOSPARC_LICENSE_ID -o cryosparc_worker.tar.gz

./bin/cryosparcw update

5

Thanks for the update @Nmorano1 .

No worries. You may want to have a look at markdown syntax for code blocks: Formatting posts using markdown, BBCode, and HTML - Using Discourse - Discourse Meta