Cryosparc not starting

Hi,

After installation first time cryosparc started but second time it is not starting and hanging on command_core started forever
image


It is cluster installation on redhat os. Kindly help!
Regards,
Aparna

Welcome to the forum @aparna .
What are the outputs of the following commands in a fresh shell

cryosparcm log command_core | tail -n 20
eval $(cryosparcm env)
curl ${CRYOSPARC_MASTER_HOSTNAME}:${CRYOSPARC_MONGO_PORT}
curl 127.0.0.1:${CRYOSPARC_MONGO_PORT}
host ${CRYOSPARC_MASTER_HOSTNAME}
exit # exit the shell

Please post the outputs of these commands as text.
[edited 2024-10-16 to correct eval command]

Hi Cryosparc Team,
Thank you for the response could figure out my issue. I am facin issue due to proxy. Now when I put proxy details cryosparc does not start and when I do not provide proxy details, it is unable to connect to cryosparc server for License validation. Providing information as requested by you

  1. cryosparcm log command_core | tail -n 20
    
    2024-10-16 10:37:41,768 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/[redacted] (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x155549ae5390>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:37:41,768 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:39:22,004 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554fbdbf40>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:39:22,004 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:41:02,260 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554fbda3b0>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:41:02,260 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:42:42,508 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554891f760>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:42:42,508 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:44:26,307 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554891e200>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:44:26,307 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:46:07,346 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554891f430>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:46:07,346 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:47:47,586 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554fbda1a0>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:47:47,586 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:49:28,597 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554fbda0b0>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:49:28,597 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:51:11,182 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554891ef50>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:51:11,182 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    2024-10-16 10:52:52,187 heartbeat_manager    ERROR    | HTTPSConnectionPool(host='get.cryosparc.com', port=443): Max retries exceeded with url: /heartbeat/466c270c-7f2c-11ef-86e6-1bfceec8334d (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x15554891e590>, 'Connection to get.cryosparc.com timed out. (connect timeout=10)'))
    2024-10-16 10:52:52,188 heartbeat_manager    WARNING  | Error connecting to cryoSPARC license server during instance heartbeat.
    
  2. val $(cryosparcm_env)
    -bash: cryosparcm_env: command not found
    
  3. curl ${CRYOSPARC_MASTER_HOSTNAME}:${CRYOSPARC_MONGO_PORT}
    curl: (3) Bad URL, colon is first character
    
  4. curl 127.0.0.1:${CRYOSPARC_MONGO_PORT}
    curl: (7) Failed to connect to 127.0.0.1 port 80: Connection refused
    
  5. host ${CRYOSPARC_MASTER_HOSTNAME}
    Usage: host [-aCdilrTvVw] [-c class] [-N ndots] [-t type] [-W time]
                [-R number] [-m flag] hostname [server]
           -a is equivalent to -v -t ANY
           -c specifies query class for non-IN data
           -C compares SOA records on authoritative nameservers
           -d is equivalent to -v
           -i IP6.INT reverse lookups
           -l lists all hosts in a domain, using AXFR
           -m set memory debugging flag (trace|record|usage)
           -N changes the number of dots allowed before root lookup is done
           -p specifies the port on the server to query
           -r disables recursive processing
           -R specifies number of retries for UDP packets
           -s a SERVFAIL response should stop query
           -t specifies the query type
           -T enables TCP/IP mode
           -U enables UDP mode
           -v enables verbose output
           -V print version number and exit
           -w specifies to wait forever for a reply
           -W specifies how long to wait for a reply
           -4 use IPv4 query transport only
           -6 use IPv6 query transport only
    

I apologize for initially posting an incorrect command.
The command should have been

eval $(cryosparcm env)

Please can you run that command and the subsequent commands again and post their outputs.

Hi wtempel,
I am still getting the same error:

$ eval $(cryosparcm env)
-bash: cryosparcm: command not found

Regards,
Aparna

cryosparcm may not be in your $PATH. In this case, you may run the command specifying the absolute path to cryosparcm, in your case

eval $(/home/janesh/cryosparc/cryosparc_master/bin/cryosparcm env)

Hi,

  1. eval $(/home/janesh/cryosparc/cryosparc_master/bin/cryosparcm env)

Returns the blank prompt
2 host ${CRYOSPARC_MASTER_HOSTNAME}

champ2.cm.cluster has address 10.20.5.253
3(curl ${CRYOSPARC_MASTER_HOSTNAME}:${CRYOSPARC_MONGO_PORT}). and 4(curl 127.0.0.1:${CRYOSPARC_MONGO_PORT}) both returned below:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html><head>
<meta type="copyright" content="Copyright (C) 1996-2022 The Squid Software Foundation and contributors">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>ERROR: The requested URL could not be retrieved</title>
<style type="text/css"><!--
 /*
 * Copyright (C) 1996-2022 The Squid Software Foundation and contributors
 *
 * Squid software is distributed under GPLv2+ license and includes
 * contributions from numerous individuals and organizations.
 * Please see the COPYING and CONTRIBUTORS files for details.
 */

/*
 Stylesheet for Squid Error pages
 Adapted from design by Free CSS Templates
 http://www.freecsstemplates.org
 Released for free under a Creative Commons Attribution 2.5 License
*/

/* Page basics */
* {
        font-family: verdana, sans-serif;
}

html body {
        margin: 0;
        padding: 0;
        background: #efefef;
        font-size: 12px;
        color: #1e1e1e;
}

/* Page displayed title area */
#titles {
        margin-left: 15px;
        padding: 10px;
        padding-left: 100px;
        background: url('/squid-internal-static/icons/SN.png') no-repeat left;
}

/* initial title */
#titles h1 {
        color: #000000;
}
#titles h2 {
        color: #000000;
}

/* special event: FTP success page titles */
#titles ftpsuccess {
        background-color:#00ff00;
        width:100%;
}

/* Page displayed body content area */
#content {
        padding: 10px;
        background: #ffffff;
}

/* General text */
p {
}

/* error brief description */
#error p {
}

/* some data which may have caused the problem */
#data {
}

/* the error message received from the system or other software */
#sysmsg {
}

pre {
}

/* special event: FTP directory listing */
#dirmsg {
    font-family: courier, monospace;
    color: black;
    font-size: 10pt;
}
#dirlisting {
    margin-left: 2%;
    margin-right: 2%;
}
#dirlisting tr.entry td.icon,td.filename,td.size,td.date {
    border-bottom: groove;
}
#dirlisting td.size {
    width: 50px;
    text-align: right;
    padding-right: 5px;
}

/* horizontal lines */
hr {
        margin: 0;
}

/* page displayed footer area */
#footer {
        font-size: 9px;
        padding-left: 10px;
}


body
:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }
:lang(he) { direction: rtl; }
 --></style>
</head><body id=ERR_CANNOT_FORWARD>
<div id="titles">
<h1>ERROR</h1>
<h2>The requested URL could not be retrieved</h2>
</div>
<hr>

<div id="content">
<p>The following error was encountered while trying to retrieve the URL: <a href="http://champ2.cm.cluster:45001/">http://champ2.cm.cluster:45001/</a></p>

<blockquote id="error">
<p><b>Unable to forward this request at this time.</b></p>
</blockquote>

<p>This request could not be forwarded to the origin server or to any parent caches.</p>

<p>Some possible problems are:</p>
<ul>
<li id="network-down">An Internet connection needed to access this domains origin servers may be down.</li>
<li id="no-peer">All configured parent caches may be currently unreachable.</li>
<li id="permission-denied">The administrator may not allow this cache to make direct connections to origin servers.</li>
</ul>

<p>Your cache administrator is <a href="mailto:root?subject=CacheErrorInfo%20-%20ERR_CANNOT_FORWARD&amp;body=CacheHost%3A%20nknproxy.cmmacs.ernet.in%0D%0AErrPage%3A%20ERR_CANNOT_FORWARD%0D%0AErr%3A%20%5Bnone%5D%0D%0ATimeStamp%3A%20Fri,%2018%20Oct%202024%2008%3A49%3A13%20GMT%0D%0A%0D%0AClientIP%3A%20192.168.103.52%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2F%20HTTP%2F1.1%0AUser-Agent%3A%20curl%2F7.61.1%0D%0AAccept%3A%20*%2F*%0D%0AProxy-Connection%3A%20Keep-Alive%0D%0AHost%3A%20champ2.cm.cluster%3A45001%0D%0A%0D%0A%0D%0A">root</a>.</p>

<br>
</div>

<hr>
<div id="footer">
<p>Generated Fri, 18 Oct 2024 08:49:13 GMT by nknproxy.cmmacs.ernet.in (squid/5.5)</p>
<!-- ERR_CANNOT_FORWARD -->
</div>
</body></html>

Regards,
Aparna

You could try:

  1. providing proxy details (how do you currently provide those)
  2. and adding to the bottom of the cryosparc_master/config.sh file a line (curl docs)
    export NO_PROXY="${CRYOSPARC_MASTER_HOSTNAME},localhost,127.0.0.1"
    
  3. then restarting CryoSPARC

Does this help?

Hi… Thank you for the help! I am sorry for delay in response as I was not well. It is working now.

Regards,
Aparna