Hi all,
We have a new server in the lab that came with pre-installed Cryosparc. I have started cryosparc without any problem using cryosparcm start and I was able to import images of the Cryosparc test dataset.
Satisfied with the result, I stopped cryosparc using cryosparc stop and restarted it again.
This time I got a new error upon startup:
$ cryosparcm start
Starting cryoSPARC System master process..
CryoSPARC is not already running.
database: started
command_core: started
command_core connection succeeded
command_vis: started
command_rtp: ERROR (spawn error)
Here is the excerpt from the log file using cryosparcm log command_core | grep [Ee]rror
[]$ cryosparcm log command_core | grep [Ee]rror
Failed to connect link: HTTP Error 502: Bad Gateway
...
Error connecting to cryoSPARC license server during instance heartbeat.
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
FileNotFoundError: [Errno 2] No such file or directory: '/data/euchi/cryosparc/2 0210314_testdataset/P2/workspaces.json'
FileNotFoundError: [Errno 2] No such file or directory: '/data/euchi/cryosparc/2 0210314_testdataset/P2/workspaces.json'
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
FileNotFoundError: [Errno 2] No such file or directory: '/data/euchi/cryosparc/2 0210314_testdataset/P2/workspaces.json'
FileNotFoundError: [Errno 2] No such file or directory: '/data/euchi/cryosparc/2 0210314_testdataset/P2/workspaces.json'
FileNotFoundError: [Errno 2] No such file or directory: '/data/euchi/cryosparc/2 0210314_testdataset/P2/workspaces.json'
AssertionError: Project directory does not exist
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
AssertionError: Project directory does not exist
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Error connecting to cryoSPARC license server during instance heartbeat.
Error connecting to cryoSPARC license server. Checking local license file.
Queue message : Error connecting to cryoSPARC license server. Checking local license file. Local license file is expired. Please re-establish your connectio n to the license servers.
Error connecting to cryoSPARC license server. Checking local license file.
Queue message : Error connecting to cryoSPARC license server. Checking local license file. Local license file is expired. Please re-establish your connectio n to the license servers.
Error connecting to cryoSPARC license server. Checking local license file.
Queue message : Error connecting to cryoSPARC license server. Checking local license file. Local license file is expired. Please re-establish your connectio n to the license servers.
Failed to connect link: <urlopen error [Errno 104] Connection reset by peer>
Here is the excerpt from the log file using cryosparcm log command_rtp
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/cryosparc_command/command_rtp/__init__.py", line 38, in <module>
rc.connect(os.environ['CRYOSPARC_MASTER_HOSTNAME'], int(os.environ['CRYOSPARC_COMMAND_CORE_PORT']))
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/cryosparc_compute/jobs/runcommon.py", line 92, in connect
cli = client.CommandClient(master_hostname, int(master_command_core_port))
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/cryosparc_compute/client.py", line 35, in __init__
self._reload()
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/cryosparc_compute/client.py", line 63, in _reload
system = self._get_callable('system.describe')()
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/cryosparc_compute/client.py", line 52, in func
res = r.json()
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.7/site-packages/requests/models.py", line 898, in json
return complexjson.loads(self.text, **kwargs)
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.7/json/__init__.py", line 348, in loads
return _default_decoder.decode(s)
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.7/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/home/cryosparc_user/software/cryosparc/cryosparc_master/deps/anaconda/envs/cryosparc_master_env/lib/python3.7/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
*** client.py: command (http://c112175:39002/api) did not reply within timeout of 300 seconds, attempt 1 of 3
*** client.py: command (http://c112175:39002/api) did not reply within timeout of 300 seconds, attempt 2 of 3
*** client.py: command (http://c112175:39002/api) did not reply within timeout of 300 seconds, attempt 3 of 3
Furthermore, on the master, the curl test doesn’t show the same output as it did before I started having problems:
Before:
`[]$ curl https://get.cryosparc.com`
resulted in:
`{"message":"Missing Authentication Token"}`
After:
[]$ curl http://get.cryosparc.com
<html>
<head><title>301 Moved Permanently</title></head>
<body bgcolor="white">
<center><h1>301 Moved Permanently</h1></center>
<hr><center>CloudFront</center>
</body>
</html>
Best,
euchi