Unable to queue P1 J1: ServerError:Scheduler error

Hi,

I met with a problem. "Unable to queue P1 J1: ServerError:Scheduler error: no scheduler lanes found.Please connect a worker using ‘cryosparcwconnect’

I followed the install instruction of single workstation. Here is the output of these three commands:

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ /mnt/data/cryosparc_master/bin/cryosparcm status | grep -v LICENSE
----------------------------------------------------------------------------
CryoSPARC System master node installed at
/mnt/data/cryosparc_master
Current cryoSPARC version: v4.5.3
----------------------------------------------------------------------------

CryoSPARC process status:

app                              RUNNING   pid 54965, uptime 2 days, 3:52:33
app_api                          RUNNING   pid 54986, uptime 2 days, 3:52:31
app_api_dev                      STOPPED   Not started
command_core                     RUNNING   pid 54915, uptime 2 days, 3:52:45
command_rtp                      RUNNING   pid 54951, uptime 2 days, 3:52:37
command_vis                      RUNNING   pid 54937, uptime 2 days, 3:52:39
database                         RUNNING   pid 54810, uptime 2 days, 3:52:49

----------------------------------------------------------------------------
License is valid
----------------------------------------------------------------------------

global config variables:
export CRYOSPARC_MASTER_HOSTNAME="icrc4lcga001"
export no_proxy=localhost,::1,127.0.0.1,${CRYOSPARC_MASTER_HOSTNAME},.columbia.edu
export CRYOSPARC_DB_PATH="/mnt/data/cryosparc_database"
export CRYOSPARC_BASE_PORT=39000
export CRYOSPARC_DB_CONNECTION_TIMEOUT_MS=20000
export CRYOSPARC_INSECURE=false
export CRYOSPARC_DB_ENABLE_AUTH=true
export CRYOSPARC_CLUSTER_JOB_MONITOR_INTERVAL=10
export CRYOSPARC_CLUSTER_JOB_MONITOR_MAX_RETRIES=1000000
export CRYOSPARC_PROJECT_DIR_PREFIX='CS-'
export CRYOSPARC_DEVELOP=false
export CRYOSPARC_CLICK_WRAP=true

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ hostname -f
icrc4lcga001
jk4882@icrc4lcga001:/mnt/data/cryosparc_master$ host $(hostname -f)
icrc4lcga001 has address 127.0.1.1

I also notice that I cannot connect to CryoSPARC with localhost:39000 and icrc4lcga001:39000, but can connect with IP: like 10.115.231.55:39000

Thank for your time and help!

Best,
Junqing

If your question concerns the same CryoSPARC installation as in Installation Freeze,
the cryosparc_worker/install.sh and/or cryosparcw connect steps that were supposed to occur automatically during a
--standalone installation may have failed.
In this case, you may need to manually complete worker installation and connection, as appropriate.

a localhost URL is appropriate only if either

  • the web browser is running on the CryoSPARC master host
  • local port forwarding is in effect between the computer where the browser runs and the CryoSPARC master host

suggests that the computer on which the browser runs cannot resolve the icrc4lcga001 address. Your IT support may be able to help.

Hi,

Thank you very much for your assistance! Since the letter I need to send exceeds 32,000 characters, I will need to send it in separate parts. I apologize for any inconvenience this may cause.

As I am the fresher to linux, I thought made some mistakes before I got your response. I successfully installed the cryosparcw but forgot to input master and worker parameter.


jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ sudo /mnt/data/cryosparc_worker/install.sh --license **********

******* CRYOSPARC SYSTEM: WORKER INSTALLER ***********************

 

Installation Settings:

   License ID              : XXXXX

   Root Directory          : /mnt/data/cryosparc_worker

   Standalone Installation : false

   Version                 : v4.5.3

 

******************************************************************

 

NVIDIA driver check..

Found nvidia-smi at /usr/bin/nvidia-smi

 

 

******************************************************************

 

Setting up hard-coded config.sh environment variables

 

******************************************************************

 

Installing all dependencies.

 

Checking dependencies...

Dependencies for python have changed - reinstalling...

  ------------------------------------------------------------------------

  Installing anaconda python...

  ------------------------------------------------------------------------

PREFIX=/mnt/data/cryosparc_worker/deps/anaconda

Unpacking payload ...

Extracting _libgcc_mutex-0.1-conda_forge.tar.bz2

Extracting ca-certificates-2024.2.2-hbcca054_0.conda

Extracting ld_impl_linux-64-2.40-h41732ed_0.conda

Extracting libstdcxx-ng-13.2.0-h7e041cc_5.conda

Extracting pybind11-abi-4-hd8ed1ab_3.tar.bz2

Extracting python_abi-3.10-4_cp310.conda

Extracting tzdata-2024a-h0c530f3_0.conda

Extracting libgomp-13.2.0-h807b86a_5.conda

Extracting _openmp_mutex-4.5-2_gnu.tar.bz2

Extracting libgcc-ng-13.2.0-h807b86a_5.conda

Extracting bzip2-1.0.8-hd590300_5.conda

Extracting c-ares-1.27.0-hd590300_0.conda

Extracting fmt-10.2.1-h00ab1b0_0.conda

Extracting icu-73.2-h59595ed_0.conda

Extracting keyutils-1.6.1-h166bdaf_0.tar.bz2

Extracting libev-4.33-hd590300_2.conda

Extracting libffi-3.4.2-h7f98852_5.tar.bz2

Extracting libiconv-1.17-hd590300_2.conda

Extracting libnsl-2.0.1-hd590300_0.conda

Extracting libuuid-2.38.1-h0b41bf4_0.conda

Extracting libxcrypt-4.4.36-hd590300_1.conda

Extracting libzlib-1.2.13-hd590300_5.conda

Extracting lz4-c-1.9.4-hcb278e6_0.conda

Extracting lzo-2.10-h516909a_1000.tar.bz2

Extracting ncurses-6.4.20240210-h59595ed_0.conda

Extracting openssl-3.2.1-hd590300_1.conda

Extracting reproc-14.2.4.post0-hd590300_1.conda

Extracting xz-5.2.6-h166bdaf_0.tar.bz2

Extracting yaml-cpp-0.8.0-h59595ed_0.conda

Extracting libedit-3.1.20191231-he28a2e2_2.tar.bz2

Extracting libnghttp2-1.58.0-h47da74e_1.conda

Extracting libsolv-0.7.28-hfc55251_0.conda

Extracting libsqlite-3.45.2-h2797004_0.conda

Extracting libssh2-1.11.0-h0841786_0.conda

Extracting libxml2-2.12.6-h232c23b_0.conda

Extracting readline-8.2-h8228510_1.conda

Extracting reproc-cpp-14.2.4.post0-h59595ed_1.conda

Extracting tk-8.6.13-noxft_h4845f30_101.conda

Extracting zstd-1.5.5-hfc55251_0.conda

Extracting krb5-1.21.2-h659d440_0.conda

Extracting libarchive-3.7.2-h2aa1ff5_1.conda

Extracting python-3.10.14-hd12c33a_0_cpython.conda

Extracting libcurl-8.6.0-hca28451_0.conda

Extracting menuinst-2.0.2-py310hff52083_0.conda

Extracting archspec-0.2.3-pyhd8ed1ab_0.conda

Extracting boltons-23.1.1-pyhd8ed1ab_0.conda

Extracting brotli-python-1.1.0-py310hc6cd4ac_1.conda

Extracting certifi-2024.2.2-pyhd8ed1ab_0.conda

Extracting charset-normalizer-3.3.2-pyhd8ed1ab_0.conda

Extracting colorama-0.4.6-pyhd8ed1ab_0.tar.bz2

Extracting distro-1.9.0-pyhd8ed1ab_0.conda

Extracting idna-3.6-pyhd8ed1ab_0.conda

Extracting jsonpointer-2.4-py310hff52083_3.conda

Extracting libmamba-1.5.7-had39da4_0.conda

Extracting packaging-24.0-pyhd8ed1ab_0.conda

Extracting platformdirs-4.2.0-pyhd8ed1ab_0.conda

Extracting pluggy-1.4.0-pyhd8ed1ab_0.conda

Extracting pycosat-0.6.6-py310h2372a71_0.conda

Extracting pycparser-2.21-pyhd8ed1ab_0.tar.bz2

Extracting pysocks-1.7.1-pyha2e5f31_6.tar.bz2

Extracting ruamel.yaml.clib-0.2.8-py310h2372a71_0.conda

Extracting setuptools-69.2.0-pyhd8ed1ab_0.conda

Extracting truststore-0.8.0-pyhd8ed1ab_0.conda

Extracting wheel-0.43.0-pyhd8ed1ab_0.conda

Extracting cffi-1.16.0-py310h2fee648_0.conda

Extracting jsonpatch-1.33-pyhd8ed1ab_0.conda

Extracting libmambapy-1.5.7-py310h39ff949_0.conda

Extracting pip-24.0-pyhd8ed1ab_0.conda

Extracting ruamel.yaml-0.18.6-py310h2372a71_0.conda

Extracting tqdm-4.66.2-pyhd8ed1ab_0.conda

Extracting urllib3-2.2.1-pyhd8ed1ab_0.conda

Extracting requests-2.31.0-pyhd8ed1ab_0.conda

Extracting zstandard-0.22.0-py310h1275a96_0.conda

Extracting conda-package-streaming-0.9.0-pyhd8ed1ab_0.conda

Extracting conda-package-handling-2.2.0-pyh38be061_0.conda

Extracting conda-24.1.2-py310hff52083_0.conda

Extracting conda-libmamba-solver-24.1.0-pyhd8ed1ab_0.conda

Extracting mamba-1.5.7-py310h51d5547_0.conda

 

Installing base environment...

 

 

                                           __

          __  ______ ___  ____ _____ ___  / /_  ____ _

         / / / / __ `__ \/ __ `/ __ `__ \/ __ \/ __ `/

        / /_/ / / / / / / /_/ / / / / / / /_/ / /_/ /

       / .___/_/ /_/ /_/\__,_/_/ /_/ /_/_.___/\__,_/

      /_/

 

Transaction

 

  Prefix: /mnt/data/cryosparc_worker/deps/anaconda

 

  Updating specs:

 

   - conda-forge/linux-64::_libgcc_mutex==0.1=conda_forge[md5=d7c89558ba9fa0495403155b64376d81]

   - conda-forge/linux-64::ca-certificates==2024.2.2=hbcca054_0[md5=2f4327a1cbe7f022401b236e915a5fef]

   - conda-forge/linux-64::ld_impl_linux-64==2.40=h41732ed_0[md5=7aca3059a1729aa76c597603f10b0dd3]

   - conda-forge/linux-64::libstdcxx-ng==13.2.0=h7e041cc_5[md5=f6f6600d18a4047b54f803cf708b868a]

   - conda-forge/noarch::pybind11-abi==4=hd8ed1ab_3[md5=878f923dd6acc8aeb47a75da6c4098be]

   - conda-forge/linux-64::python_abi==3.10=4_cp310[md5=26322ec5d7712c3ded99dd656142b8ce]

   - conda-forge/noarch::tzdata==2024a=h0c530f3_0[md5=161081fc7cec0bfda0d86d7cb595f8d8]

   - conda-forge/linux-64::libgomp==13.2.0=h807b86a_5[md5=d211c42b9ce49aee3734fdc828731689]

   - conda-forge/linux-64::_openmp_mutex==4.5=2_gnu[md5=73aaf86a425cc6e73fcf236a5a46396d]

   - conda-forge/linux-64::libgcc-ng==13.2.0=h807b86a_5[md5=d4ff227c46917d3b4565302a2bbb276b]

   - conda-forge/linux-64::bzip2==1.0.8=hd590300_5[md5=69b8b6202a07720f448be700e300ccf4]

   - conda-forge/linux-64::c-ares==1.27.0=hd590300_0[md5=f6afff0e9ee08d2f1b897881a4f38cdb]

   - conda-forge/linux-64::fmt==10.2.1=h00ab1b0_0[md5=35ef8bc24bd34074ebae3c943d551728]

   - conda-forge/linux-64::icu==73.2=h59595ed_0[md5=cc47e1facc155f91abd89b11e48e72ff]

   - conda-forge/linux-64::keyutils==1.6.1=h166bdaf_0[md5=30186d27e2c9fa62b45fb1476b7200e3]

   - conda-forge/linux-64::libev==4.33=hd590300_2[md5=172bf1cd1ff8629f2b1179945ed45055]

   - conda-forge/linux-64::libffi==3.4.2=h7f98852_5[md5=d645c6d2ac96843a2bfaccd2d62b3ac3]

   - conda-forge/linux-64::libiconv==1.17=hd590300_2[md5=d66573916ffcf376178462f1b61c941e]

   - conda-forge/linux-64::libnsl==2.0.1=hd590300_0[md5=30fd6e37fe21f86f4bd26d6ee73eeec7]

   - conda-forge/linux-64::libuuid==2.38.1=h0b41bf4_0[md5=40b61aab5c7ba9ff276c41cfffe6b80b]

   - conda-forge/linux-64::libxcrypt==4.4.36=hd590300_1[md5=5aa797f8787fe7a17d1b0821485b5adc]

   - conda-forge/linux-64::libzlib==1.2.13=hd590300_5[md5=f36c115f1ee199da648e0597ec2047ad]

   - conda-forge/linux-64::lz4-c==1.9.4=hcb278e6_0[md5=318b08df404f9c9be5712aaa5a6f0bb0]

   - conda-forge/linux-64::lzo==2.10=h516909a_1000[md5=bb14fcb13341b81d5eb386423b9d2bac]

   - conda-forge/linux-64::ncurses==6.4.20240210=h59595ed_0[md5=97da8860a0da5413c7c98a3b3838a645]

   - conda-forge/linux-64::openssl==3.2.1=hd590300_1[md5=9d731343cff6ee2e5a25c4a091bf8e2a]

   - conda-forge/linux-64::reproc==14.2.4.post0=hd590300_1[md5=82ca53502dfd5a64a80dee76dae14685]

   - conda-forge/linux-64::xz==5.2.6=h166bdaf_0[md5=2161070d867d1b1204ea749c8eec4ef0]

   - conda-forge/linux-64::yaml-cpp==0.8.0=h59595ed_0[md5=965eaacd7c18eb8361fd12bb9e7a57d7]

   - conda-forge/linux-64::libedit==3.1.20191231=he28a2e2_2[md5=4d331e44109e3f0e19b4cb8f9b82f3e1]

   - conda-forge/linux-64::libnghttp2==1.58.0=h47da74e_1[md5=700ac6ea6d53d5510591c4344d5c989a]

   - conda-forge/linux-64::libsolv==0.7.28=hfc55251_0[md5=66d4f5d8256542d9ebfa341d690c5e03]

   - conda-forge/linux-64::libsqlite==3.45.2=h2797004_0[md5=866983a220e27a80cb75e85cb30466a1]

   - conda-forge/linux-64::libssh2==1.11.0=h0841786_0[md5=1f5a58e686b13bcfde88b93f547d23fe]

   - conda-forge/linux-64::libxml2==2.12.6=h232c23b_0[md5=d86653ff5ccb88bf7f13833fdd8789e0]

   - conda-forge/linux-64::readline==8.2=h8228510_1[md5=47d31b792659ce70f470b5c82fdfb7a4]

   - conda-forge/linux-64::reproc-cpp==14.2.4.post0=h59595ed_1[md5=715e1d720ec1a03715bebd237972fca5]

   - conda-forge/linux-64::tk==8.6.13=noxft_h4845f30_101[md5=d453b98d9c83e71da0741bb0ff4d76bc]

   - conda-forge/linux-64::zstd==1.5.5=hfc55251_0[md5=04b88013080254850d6c01ed54810589]

   - conda-forge/linux-64::krb5==1.21.2=h659d440_0[md5=cd95826dbd331ed1be26bdf401432844]

   - conda-forge/linux-64::libarchive==3.7.2=h2aa1ff5_1[md5=3bf887827d1968275978361a6e405e4f]

   - conda-forge/linux-64::python==3.10.14=hd12c33a_0_cpython[md5=2b4ba962994e8bd4be9ff5b64b75aff2]

   - conda-forge/linux-64::libcurl==8.6.0=hca28451_0[md5=704739398d858872cb91610f49f0ef29]

   - conda-forge/linux-64::menuinst==2.0.2=py310hff52083_0[md5=4837faab0d3e665df57fef662148c6a3]

   - conda-forge/noarch::archspec==0.2.3=pyhd8ed1ab_0[md5=192278292e20704f663b9c766909d67b]

   - conda-forge/noarch::boltons==23.1.1=pyhd8ed1ab_0[md5=56febe65315cc388a5d20adf2b39a74d]

   - conda-forge/linux-64::brotli-python==1.1.0=py310hc6cd4ac_1[md5=1f95722c94f00b69af69a066c7433714]

   - conda-forge/noarch::certifi==2024.2.2=pyhd8ed1ab_0[md5=0876280e409658fc6f9e75d035960333]

   - conda-forge/noarch::charset-normalizer==3.3.2=pyhd8ed1ab_0[md5=7f4a9e3fcff3f6356ae99244a014da6a]

   - conda-forge/noarch::colorama==0.4.6=pyhd8ed1ab_0[md5=3faab06a954c2a04039983f2c4a50d99]

   - conda-forge/noarch::distro==1.9.0=pyhd8ed1ab_0[md5=bbdb409974cd6cb30071b1d978302726]

   - conda-forge/noarch::idna==3.6=pyhd8ed1ab_0[md5=1a76f09108576397c41c0b0c5bd84134]

   - conda-forge/linux-64::jsonpointer==2.4=py310hff52083_3[md5=08ec1463dbc5c806a32fc431874032ca]

   - conda-forge/linux-64::libmamba==1.5.7=had39da4_0[md5=9fff450354fbcd1510ef178730732241]

   - conda-forge/noarch::packaging==24.0=pyhd8ed1ab_0[md5=248f521b64ce055e7feae3105e7abeb8]

   - conda-forge/noarch::platformdirs==4.2.0=pyhd8ed1ab_0[md5=a0bc3eec34b0fab84be6b2da94e98e20]

   - conda-forge/noarch::pluggy==1.4.0=pyhd8ed1ab_0[md5=139e9feb65187e916162917bb2484976]

   - conda-forge/linux-64::pycosat==0.6.6=py310h2372a71_0[md5=0adaac9a86d59adae2bc86b3cdef2df1]

   - conda-forge/noarch::pycparser==2.21=pyhd8ed1ab_0[md5=076becd9e05608f8dc72757d5f3a91ff]

   - conda-forge/noarch::pysocks==1.7.1=pyha2e5f31_6[md5=2a7de29fb590ca14b5243c4c812c8025]

   - conda-forge/linux-64::ruamel.yaml.clib==0.2.8=py310h2372a71_0[md5=dcf6d2535586c77b31425ed835610c54]

   - conda-forge/noarch::setuptools==69.2.0=pyhd8ed1ab_0[md5=da214ecd521a720a9d521c68047682dc]

   - conda-forge/noarch::truststore==0.8.0=pyhd8ed1ab_0[md5=08316d001eca8854392cf2837828ea11]

   - conda-forge/noarch::wheel==0.43.0=pyhd8ed1ab_0[md5=6e43a94e0ee67523b5e781f0faba5c45]

   - conda-forge/linux-64::cffi==1.16.0=py310h2fee648_0[md5=45846a970e71ac98fd327da5d40a0a2c]

   - conda-forge/noarch::jsonpatch==1.33=pyhd8ed1ab_0[md5=bfdb7c5c6ad1077c82a69a8642c87aff]

   - conda-forge/linux-64::libmambapy==1.5.7=py310h39ff949_0[md5=58d84efb37d517c64f4e48f75fd6180d]

   - conda-forge/noarch::pip==24.0=pyhd8ed1ab_0[md5=f586ac1e56c8638b64f9c8122a7b8a67]

   - conda-forge/linux-64::ruamel.yaml==0.18.6=py310h2372a71_0[md5=50b7d9b39099cdbabf65bf27df73a793]

   - conda-forge/noarch::tqdm==4.66.2=pyhd8ed1ab_0[md5=2b8dfb969f984497f3f98409a9545776]

   - conda-forge/noarch::urllib3==2.2.1=pyhd8ed1ab_0[md5=08807a87fa7af10754d46f63b368e016]

   - conda-forge/noarch::requests==2.31.0=pyhd8ed1ab_0[md5=a30144e4156cdbb236f99ebb49828f8b]

   - conda-forge/linux-64::zstandard==0.22.0=py310h1275a96_0[md5=54698ba13cd3494547b289cd86a2176a]

   - conda-forge/noarch::conda-package-streaming==0.9.0=pyhd8ed1ab_0[md5=38253361efb303deead3eab39ae9269b]

   - conda-forge/noarch::conda-package-handling==2.2.0=pyh38be061_0[md5=8a3ae7f6318376aa08ea753367bb7dd6]

   - conda-forge/linux-64::conda==24.1.2=py310hff52083_0[md5=d7a8a166cf89ed19a7d3ee41b71a5d6f]

   - conda-forge/noarch::conda-libmamba-solver==24.1.0=pyhd8ed1ab_0[md5=304dc78ad6e52e0fd663df1d484c1531]

   - conda-forge/linux-64::mamba==1.5.7=py310h51d5547_0[md5=5977cafef2904d1588d0c23b94846f2c]

 

 

  Package                         Version  Build               Channel           Size

───────────────────────────────────────────────────────────────────────────────────────

  Install:

───────────────────────────────────────────────────────────────────────────────────────

 

  + _libgcc_mutex                     0.1  conda_forge         conda-forge     Cached

  + _openmp_mutex                     4.5  2_gnu               conda-forge     Cached

  + archspec                        0.2.3  pyhd8ed1ab_0        conda-forge     Cached

  + boltons                        23.1.1  pyhd8ed1ab_0        conda-forge     Cached

  + brotli-python                   1.1.0  py310hc6cd4ac_1     conda-forge     Cached

  + bzip2                           1.0.8  hd590300_5          conda-forge     Cached

  + c-ares                         1.27.0  hd590300_0          conda-forge     Cached

  + ca-certificates              2024.2.2  hbcca054_0          conda-forge     Cached

  + certifi                      2024.2.2  pyhd8ed1ab_0        conda-forge     Cached

  + cffi                           1.16.0  py310h2fee648_0     conda-forge     Cached

  + charset-normalizer              3.3.2  pyhd8ed1ab_0        conda-forge     Cached

  + colorama                        0.4.6  pyhd8ed1ab_0        conda-forge     Cached

  + conda                          24.1.2  py310hff52083_0     conda-forge     Cached

  + conda-libmamba-solver          24.1.0  pyhd8ed1ab_0        conda-forge     Cached

  + conda-package-handling          2.2.0  pyh38be061_0        conda-forge     Cached

  + conda-package-streaming         0.9.0  pyhd8ed1ab_0        conda-forge     Cached

  + distro                          1.9.0  pyhd8ed1ab_0        conda-forge     Cached

  + fmt                            10.2.1  h00ab1b0_0          conda-forge     Cached

  + icu                              73.2  h59595ed_0          conda-forge     Cached

  + idna                              3.6  pyhd8ed1ab_0        conda-forge     Cached

  + jsonpatch                        1.33  pyhd8ed1ab_0        conda-forge     Cached

  + jsonpointer                       2.4  py310hff52083_3     conda-forge     Cached

  + keyutils                        1.6.1  h166bdaf_0          conda-forge     Cached

  + krb5                           1.21.2  h659d440_0          conda-forge     Cached

  + ld_impl_linux-64                 2.40  h41732ed_0          conda-forge     Cached

  + libarchive                      3.7.2  h2aa1ff5_1          conda-forge     Cached

  + libcurl                         8.6.0  hca28451_0          conda-forge     Cached

  + libedit                  3.1.20191231  he28a2e2_2          conda-forge     Cached

  + libev                            4.33  hd590300_2          conda-forge     Cached

  + libffi                          3.4.2  h7f98852_5          conda-forge     Cached

  + libgcc-ng                      13.2.0  h807b86a_5          conda-forge     Cached

  + libgomp                        13.2.0  h807b86a_5          conda-forge     Cached

  + libiconv                         1.17  hd590300_2          conda-forge     Cached

  + libmamba                        1.5.7  had39da4_0          conda-forge     Cached

  + libmambapy                      1.5.7  py310h39ff949_0     conda-forge     Cached

  + libnghttp2                     1.58.0  h47da74e_1          conda-forge     Cached

  + libnsl                          2.0.1  hd590300_0          conda-forge     Cached

  + libsolv                        0.7.28  hfc55251_0          conda-forge     Cached

  + libsqlite                      3.45.2  h2797004_0          conda-forge     Cached

  + libssh2                        1.11.0  h0841786_0          conda-forge     Cached

  + libstdcxx-ng                   13.2.0  h7e041cc_5          conda-forge     Cached

  + libuuid                        2.38.1  h0b41bf4_0          conda-forge     Cached

  + libxcrypt                      4.4.36  hd590300_1          conda-forge     Cached

  + libxml2                        2.12.6  h232c23b_0          conda-forge     Cached

  + libzlib                        1.2.13  hd590300_5          conda-forge     Cached

  + lz4-c                           1.9.4  hcb278e6_0          conda-forge     Cached

  + lzo                              2.10  h516909a_1000       conda-forge     Cached

  + mamba                           1.5.7  py310h51d5547_0     conda-forge     Cached

  + menuinst                        2.0.2  py310hff52083_0     conda-forge     Cached

  + ncurses                  6.4.20240210  h59595ed_0          conda-forge     Cached

  + openssl                         3.2.1  hd590300_1          conda-forge     Cached

  + packaging                        24.0  pyhd8ed1ab_0        conda-forge     Cached

  + pip                              24.0  pyhd8ed1ab_0        conda-forge     Cached

  + platformdirs                    4.2.0  pyhd8ed1ab_0        conda-forge     Cached

  + pluggy                          1.4.0  pyhd8ed1ab_0        conda-forge     Cached

  + pybind11-abi                        4  hd8ed1ab_3          conda-forge     Cached

  + pycosat                         0.6.6  py310h2372a71_0     conda-forge     Cached

  + pycparser                        2.21  pyhd8ed1ab_0        conda-forge     Cached

  + pysocks                         1.7.1  pyha2e5f31_6        conda-forge     Cached

  + python                        3.10.14  hd12c33a_0_cpython  conda-forge     Cached

  + python_abi                       3.10  4_cp310             conda-forge     Cached

  + readline                          8.2  h8228510_1          conda-forge     Cached

  + reproc                   14.2.4.post0  hd590300_1          conda-forge     Cached

  + reproc-cpp               14.2.4.post0  h59595ed_1          conda-forge     Cached

  + requests                       2.31.0  pyhd8ed1ab_0        conda-forge     Cached

  + ruamel.yaml                    0.18.6  py310h2372a71_0     conda-forge     Cached

  + ruamel.yaml.clib                0.2.8  py310h2372a71_0     conda-forge     Cached

  + setuptools                     69.2.0  pyhd8ed1ab_0        conda-forge     Cached

  + tk                             8.6.13  noxft_h4845f30_101  conda-forge     Cached

  + tqdm                           4.66.2  pyhd8ed1ab_0        conda-forge     Cached

  + truststore                      0.8.0  pyhd8ed1ab_0        conda-forge     Cached

  + tzdata                          2024a  h0c530f3_0          conda-forge     Cached

  + urllib3                         2.2.1  pyhd8ed1ab_0        conda-forge     Cached

  + wheel                          0.43.0  pyhd8ed1ab_0        conda-forge     Cached

  + xz                              5.2.6  h166bdaf_0          conda-forge     Cached

  + yaml-cpp                        0.8.0  h59595ed_0          conda-forge     Cached

  + zstandard                      0.22.0  py310h1275a96_0     conda-forge     Cached

  + zstd                            1.5.5  hfc55251_0          conda-forge     Cached

 

  Summary:

 

  Install: 78 packages

 

  Total download: 0 B

 

───────────────────────────────────────────────────────────────────────────────────────

 

 

 

Transaction starting

Linking _libgcc_mutex-0.1-conda_forge

Linking ca-certificates-2024.2.2-hbcca054_0

Linking ld_impl_linux-64-2.40-h41732ed_0

Linking libstdcxx-ng-13.2.0-h7e041cc_5

Linking pybind11-abi-4-hd8ed1ab_3

Linking python_abi-3.10-4_cp310

Linking tzdata-2024a-h0c530f3_0

Linking libgomp-13.2.0-h807b86a_5

Linking _openmp_mutex-4.5-2_gnu

Linking libgcc-ng-13.2.0-h807b86a_5

Linking bzip2-1.0.8-hd590300_5

Linking c-ares-1.27.0-hd590300_0

Linking fmt-10.2.1-h00ab1b0_0

Linking icu-73.2-h59595ed_0

Linking keyutils-1.6.1-h166bdaf_0

Linking libev-4.33-hd590300_2

Linking libffi-3.4.2-h7f98852_5

Linking libiconv-1.17-hd590300_2

Linking libnsl-2.0.1-hd590300_0

Linking libuuid-2.38.1-h0b41bf4_0

Linking libxcrypt-4.4.36-hd590300_1

Linking libzlib-1.2.13-hd590300_5

Linking lz4-c-1.9.4-hcb278e6_0

Linking lzo-2.10-h516909a_1000

Linking ncurses-6.4.20240210-h59595ed_0

Linking openssl-3.2.1-hd590300_1

Linking reproc-14.2.4.post0-hd590300_1

Linking xz-5.2.6-h166bdaf_0

Linking yaml-cpp-0.8.0-h59595ed_0

Linking libedit-3.1.20191231-he28a2e2_2

Linking libnghttp2-1.58.0-h47da74e_1

Linking libsolv-0.7.28-hfc55251_0

Linking libsqlite-3.45.2-h2797004_0

Linking libssh2-1.11.0-h0841786_0

Linking libxml2-2.12.6-h232c23b_0

Linking readline-8.2-h8228510_1

Linking reproc-cpp-14.2.4.post0-h59595ed_1

Linking tk-8.6.13-noxft_h4845f30_101

Linking zstd-1.5.5-hfc55251_0

Linking krb5-1.21.2-h659d440_0

Linking libarchive-3.7.2-h2aa1ff5_1

Linking python-3.10.14-hd12c33a_0_cpython

Linking libcurl-8.6.0-hca28451_0

Linking menuinst-2.0.2-py310hff52083_0

Linking archspec-0.2.3-pyhd8ed1ab_0

Linking boltons-23.1.1-pyhd8ed1ab_0

Linking brotli-python-1.1.0-py310hc6cd4ac_1

Linking certifi-2024.2.2-pyhd8ed1ab_0

Linking charset-normalizer-3.3.2-pyhd8ed1ab_0

Linking colorama-0.4.6-pyhd8ed1ab_0

Linking distro-1.9.0-pyhd8ed1ab_0

Linking idna-3.6-pyhd8ed1ab_0

Linking jsonpointer-2.4-py310hff52083_3

Linking libmamba-1.5.7-had39da4_0

Linking packaging-24.0-pyhd8ed1ab_0

Linking platformdirs-4.2.0-pyhd8ed1ab_0

Linking pluggy-1.4.0-pyhd8ed1ab_0

Linking pycosat-0.6.6-py310h2372a71_0

Linking pycparser-2.21-pyhd8ed1ab_0

Linking pysocks-1.7.1-pyha2e5f31_6

Linking ruamel.yaml.clib-0.2.8-py310h2372a71_0

Linking setuptools-69.2.0-pyhd8ed1ab_0

Linking truststore-0.8.0-pyhd8ed1ab_0

Linking wheel-0.43.0-pyhd8ed1ab_0

Linking cffi-1.16.0-py310h2fee648_0

Linking jsonpatch-1.33-pyhd8ed1ab_0

Linking libmambapy-1.5.7-py310h39ff949_0

Linking pip-24.0-pyhd8ed1ab_0

Linking ruamel.yaml-0.18.6-py310h2372a71_0

Linking tqdm-4.66.2-pyhd8ed1ab_0

Linking urllib3-2.2.1-pyhd8ed1ab_0

Linking requests-2.31.0-pyhd8ed1ab_0

Linking zstandard-0.22.0-py310h1275a96_0

Linking conda-package-streaming-0.9.0-pyhd8ed1ab_0

Linking conda-package-handling-2.2.0-pyh38be061_0

Linking conda-24.1.2-py310hff52083_0

Linking conda-libmamba-solver-24.1.0-pyhd8ed1ab_0

Linking mamba-1.5.7-py310h51d5547_0

Transaction finished

installation finished.

  ------------------------------------------------------------------------

    Done.

    anaconda python installation successful.

  ------------------------------------------------------------------------

  Extracting all conda packages...

  ------------------------------------------------------------------------

.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

  ------------------------------------------------------------------------

    Done.

    conda packages installation successful.

  ------------------------------------------------------------------------

  Main dependency installation completed. Continuing...

  ------------------------------------------------------------------------

Completed.

Currently checking hash for ctffind

Dependencies for ctffind have changed - reinstalling...

  ------------------------------------------------------------------------

  ctffind 4.1.14 installation successful.

  ------------------------------------------------------------------------

Completed.

Currently checking hash for gctf

Dependencies for gctf have changed - reinstalling...

  ------------------------------------------------------------------------

  Gctf v1.06 installation successful.

  ------------------------------------------------------------------------

Completed.

Completed dependency check.

 

******* CRYOSPARC WORKER INSTALLATION COMPLETE *******************

 

In order to run processing jobs, you will need to connect this

worker to a cryoSPARC master.

 

******************************************************************

 

Thank you so much for your time and help.

Best,
Junqing

Hi,

Thanks for your patience. Here is the second letter I want to send to you.

When I tried the cryosparcw connect, it failed with the following error.


jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ /mnt/data/cryosparc_worker/bin/cryosparcw connect

Traceback (most recent call last):

  File "/mnt/data/cryosparc_worker/bin/connect.py", line 65, in <module>

    assert master_hostname is not None, "--master is required"

AssertionError: --master is required

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ find /mnt/data/cryosparc_worker -name config.sh

/mnt/data/cryosparc_worker/config.sh

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ /mnt/data/cryosparc_worker/bin/cryosparcw connect --master cryosparc_master

Traceback (most recent call last):

  File "/mnt/data/cryosparc_worker/bin/connect.py", line 66, in <module>

    assert worker_hostname is not None, "--worker is required"

AssertionError: --worker is required

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ /mnt/data/cryosparc_worker/bin/cryosparcw connect --master cryosparc_master --worker cryosparc_worker01

---------------------------------------------------------------

  CRYOSPARC CONNECT --------------------------------------------

---------------------------------------------------------------

  Attempting to register worker cryosparc_worker01 to command cryosparc_master:39002

  Connecting as unix user jk4882

  Will register using ssh string: jk4882@cryosparc_worker01

  If this is incorrect, you should re-run this command with the flag --sshstr <ssh string>

 ---------------------------------------------------------------

/mnt/data/cryosparc_worker/cryosparc_tools/cryosparc/command.py:135: UserWarning: *** CommandClient: (http://cryosparc_master:39002/api) HTTP Error 503 Service Unavailable; please check cryosparcm log command_core for additional information.

Response from server: b'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" http://www.w3.org/TR/html4/loose.dtd>\n<HTML><HEAD><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">\n<TITLE>ERROR: The requested URL could not be retrieved</TITLE>\n<STYLE>\n\nbody {\n   display: block;\n   font-family: \'Helvetica Neue\', Helvetica, Arial, sans-serif;\n   text-rendering: optimizelegibility;\n   text-align: center;\n}\n\n#sign {\n   color: #5A5A5A;\n   font-weight: 600;\n   margin: 60px 0 20px 0;\n}\n\n#headline {\n   color: #5A5A5A;\n   font-size: 48px;\n   font-weight: 200;\n   min-height: 48px;\n   letter-spacing: -1px;\n   line-height: 48px;\n   margin: 0 0 10px 0;\n}\n\n#byline {\n   color: #999999;\n   font-size: 20px;\n   font-weight: 300;\n   min-height: 25px;\n   line-height: 25px;\n   margin: 0 0 30px 0;\n}\n\n#details {\n   color: #5A5A5A;\n   font-size: 16px;\n   height: 24px;\n   line-height: 24px;\n   margin: 20px 0 0 0;\n}\n    .icon,\n    .icon::before,\n    .icon::after\n    {\n        position: relative;\n        padding: 0;\n        margin: 0;\n    }\n\n    .icon {\n        font-size: 88px;\n        color: transparent;\n    }\n    .icon.warning {\n        display: inline-block;\n\n        top: 0.225em;\n        width: 1.15em;\n        height: 1.15em;\n        overflow: hidden;\n        border: none;\n        background-color: transparent;\n        border-radius: 0.625em;\n    }\n\n    .icon.warning::before {\n        content: "";\n        display: block;\n        top: -0.08em;\n        left: 0.0em;\n        position: absolute;\n        border: transparent 0.6em solid;\n        border-bottom-color: #5a5a5a;\n        border-bottom-width: 1em;\n        border-top-width: 0;\n        box-shadow: #999 0 1px 1px;\n    }\n\n    .icon.warning::after {\n        display: block;\n        position: absolute;\n        top: 0.3em;\n        left: 0;\n        width: 100%;\n        padding: 0 1px;\n        text-align: center;\n        Xfont-family: "Garamond";\n        font-family: "Arial";\n        content: "!";\n        font-size: 0.65em;\n        font-weight: bold;\n        color: #FFFFFF;\n    }\n</STYLE>\n</HEAD><BODY>\n<div id="error-container" class="container">\n    <div style="align: center; padding-bottom: 10px;">\n       <span id="sign" class="icon warning"></span>\n       <h1 id="headline">The requested URL could not be retrieved.</h1>\n       <p id="byline">Unable to determine IP address from host name for <I>cryosparc_master</I></p>\n     </div>\n</div>\n</BODY>\n</HTML>\n'

  system = self._get_callable("system.describe")()

Traceback (most recent call last):

  File "/mnt/data/cryosparc_worker/cryosparc_tools/cryosparc/command.py", line 105, in func

    with make_json_request(self, "/api", data=data, _stacklevel=4) as request:

  File "/mnt/data/cryosparc_worker/deps/anaconda/envs/cryosparc_worker_env/lib/python3.10/contextlib.py", line 135, in __enter__

    return next(self.gen)

  File "/mnt/data/cryosparc_worker/cryosparc_tools/cryosparc/command.py", line 226, in make_request

    raise CommandError(error_reason, url=url, code=code, data=resdata)

cryosparc_tools.cryosparc.errors.CommandError: *** (http://cryosparc_master:39002/api, code 503) HTTP Error 503 Service Unavailable; please check cryosparcm log command_core for additional information.

Response from server: b'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" http://www.w3.org/TR/html4/loose.dtd>\n<HTML><HEAD><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">\n<TITLE>ERROR: The requested URL could not be retrieved</TITLE>\n<STYLE>\n\nbody {\n   display: block;\n   font-family: \'Helvetica Neue\', Helvetica, Arial, sans-serif;\n   text-rendering: optimizelegibility;\n   text-align: center;\n}\n\n#sign {\n   color: #5A5A5A;\n   font-weight: 600;\n   margin: 60px 0 20px 0;\n}\n\n#headline {\n   color: #5A5A5A;\n   font-size: 48px;\n   font-weight: 200;\n   min-height: 48px;\n   letter-spacing: -1px;\n   line-height: 48px;\n   margin: 0 0 10px 0;\n}\n\n#byline {\n   color: #999999;\n   font-size: 20px;\n   font-weight: 300;\n   min-height: 25px;\n   line-height: 25px;\n   margin: 0 0 30px 0;\n}\n\n#details {\n   color: #5A5A5A;\n   font-size: 16px;\n   height: 24px;\n   line-height: 24px;\n   margin: 20px 0 0 0;\n}\n    .icon,\n    .icon::before,\n    .icon::after\n    {\n        position: relative;\n        padding: 0;\n        margin: 0;\n    }\n\n    .icon {\n        font-size: 88px;\n        color: transparent;\n    }\n    .icon.warning {\n        display: inline-block;\n\n        top: 0.225em;\n        width: 1.15em;\n        height: 1.15em;\n        overflow: hidden;\n        border: none;\n        background-color: transparent;\n        border-radius: 0.625em;\n    }\n\n    .icon.warning::before {\n        content: "";\n        display: block;\n        top: -0.08em;\n        left: 0.0em;\n        position: absolute;\n        border: transparent 0.6em solid;\n        border-bottom-color: #5a5a5a;\n        border-bottom-width: 1em;\n        border-top-width: 0;\n        box-shadow: #999 0 1px 1px;\n    }\n\n    .icon.warning::after {\n        display: block;\n        position: absolute;\n        top: 0.3em;\n        left: 0;\n        width: 100%;\n        padding: 0 1px;\n        text-align: center;\n        Xfont-family: "Garamond";\n        font-family: "Arial";\n        content: "!";\n        font-size: 0.65em;\n        font-weight: bold;\n        color: #FFFFFF;\n    }\n</STYLE>\n</HEAD><BODY>\n<div id="error-container" class="container">\n    <div style="align: center; padding-bottom: 10px;">\n       <span id="sign" class="icon warning"></span>\n       <h1 id="headline">The requested URL could not be retrieved.</h1>\n       <p id="byline">Unable to determine IP address from host name for <I>cryosparc_master</I></p>\n     </div>\n</div>\n</BODY>\n</HTML>\n'

 

The above exception was the direct cause of the following exception:

 

Traceback (most recent call last):

  File "/mnt/data/cryosparc_worker/bin/connect.py", line 78, in <module>

    cli = client.CommandClient(host=master_hostname, port=command_core_port, service="command_core")

  File "/mnt/data/cryosparc_worker/cryosparc_compute/client.py", line 38, in __init__

    super().__init__(service, host, port, url, timeout, headers, cls=NumpyEncoder)

  File "/mnt/data/cryosparc_worker/cryosparc_tools/cryosparc/command.py", line 97, in __init__

    self._reload()  # attempt connection immediately to gather methods

  File "/mnt/data/cryosparc_worker/cryosparc_tools/cryosparc/command.py", line 135, in _reload

    system = self._get_callable("system.describe")()

  File "/mnt/data/cryosparc_worker/cryosparc_tools/cryosparc/command.py", line 108, in func

    raise CommandError(

cryosparc_tools.cryosparc.errors.CommandError: *** (http://cryosparc_master:39002, code 503) Encounted error from JSONRPC function "system.describe" with params ()

I tried to debug but I failed to pinpoint the problem… In case these information has some value…


jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ cryosparcm status | grep -v LICENSE

cryosparcm: command not found

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ /mnt/data/cryosparcm status | grep -v LICENSE

0817/                 cryosparc_database/   cryosparc_worker/     .Trash-290217128/    

CryoSPARC_data/       cryosparc_master/     master-v4.5.3.tar.gz  worker-v4.5.3.tar.gz 

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ /mnt/data/cryosparc_master/bin/cryosparcm status | grep -v LICENSE

----------------------------------------------------------------------------

CryoSPARC System master node installed at

/mnt/data/cryosparc_master

Current cryoSPARC version: v4.5.3

----------------------------------------------------------------------------

 

CryoSPARC process status:

 

app                              RUNNING   pid 54965, uptime 2 days, 3:52:33

app_api                          RUNNING   pid 54986, uptime 2 days, 3:52:31

app_api_dev                      STOPPED   Not started

command_core                     RUNNING   pid 54915, uptime 2 days, 3:52:45

command_rtp                      RUNNING   pid 54951, uptime 2 days, 3:52:37

command_vis                      RUNNING   pid 54937, uptime 2 days, 3:52:39

database                         RUNNING   pid 54810, uptime 2 days, 3:52:49

 

----------------------------------------------------------------------------

License is valid

----------------------------------------------------------------------------

 

global config variables:

export CRYOSPARC_MASTER_HOSTNAME="icrc4lcga001"

export no_proxy=localhost,::1,127.0.0.1,${CRYOSPARC_MASTER_HOSTNAME},.columbia.edu

export CRYOSPARC_DB_PATH="/mnt/data/cryosparc_database"

export CRYOSPARC_BASE_PORT=39000

export CRYOSPARC_DB_CONNECTION_TIMEOUT_MS=20000

export CRYOSPARC_INSECURE=false

export CRYOSPARC_DB_ENABLE_AUTH=true

export CRYOSPARC_CLUSTER_JOB_MONITOR_INTERVAL=10

export CRYOSPARC_CLUSTER_JOB_MONITOR_MAX_RETRIES=1000000

export CRYOSPARC_PROJECT_DIR_PREFIX='CS-'

export CRYOSPARC_DEVELOP=false

export CRYOSPARC_CLICK_WRAP=true

 

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ hostname -f

icrc4lcga001

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ host $(hostname -f)

icrc4lcga001 has address 127.0.1.1

jk4882@icrc4lcga001:/mnt/data/cryosparc_worker$ cd ..

I wondered if you could shed some light on these problem. If I need to delete cryosparcw and re-install it, I would like to know how to complete delete it?

Thanks for your time and help again!

Best,

Junqing

Hi,
Thank you so much for your help.
I have solved this problem. It is the problem with the connect step that I input wrong parameters.
In case others have the same problem. I put the commands I used here.

cd cryosparc_worker

./bin/cryosparcw connect --worker <worker_hostname> \
                         --master <master_hostname> \
                         --port <port_num> \
                         --ssdpath <ssd_path> \
                        

Additionally, the worker name and master name is

--worker <worker_hostname> = worker.cryosparc.hostname.com
# [required] hostname of the worker node to connect to your 
# cryoSPARC instance

--master <master_hostname> = your.cryosparc.hostname.com
# [required] hostname of the server where the master is 
# installed on

--port <port_number> = 39000
# [required] base port number for the cryoSPARC instance you 
# are connecting the worker node to

--ssdpath <ssd_path>
# [optional] path to directory on local SSD
# replace this with --nossd to connect a worker node without an SSD

Thank you so much for your help.

Best,
Junqing

1 Like