Cached files of running jobs deleted

Troubleshooting
7

Thanks @fbeck for posting additional details.
The CryoSPARC cache system does not currently support a configuration where

  1. multiple connected workers share the same cache_path attribute
  2. and the underlying cache storage is shared

We propose the following workaround (execute commands under the Linux account that runs CryoSPARC processes):

  1. stop CryoSPARC (this would disrupt currently runningCryoSPARC jobs)
  2. delete the instance_${CRYOSPARC_MASTER_HOSTNAME}:$[${CRYOSPARC_BASE_PORT}+1] subdirectory inside the /fs/pool/pool-briggs-scratch/cryosparc directory
  3. for each worker,
  • create a cache subdirectory named after the workers hostname, like
mkdir /fs/pool/pool-briggs-scratch/cryosparc/hpcl8001
  • update the cache_path property, like
cryosparcm cli "set_scheduler_target_property('hpcl8001', 'cache_path', '/fs/pool/pool-briggs-scratch/cryosparc/hpcl8001')"
  1. cryosparcm start
  2. reset the cache system (see guide).

Do these steps resolve the issue?