2D classification failed at the very end

2D Classification
1

Hello,
We have cryosparc 3.3.1. 2D classification jobs usually work without problem. However, with one set of 1.6M extracted particles, everything was fine until the very end, when an error happened:

[CPU: 11.08 GB] Compiling job outputs…
[CPU: 11.08 GB] Passing through outputs for output group particles from input group particles

[CPU: 11.57 GB] Traceback (most recent call last):
File “cryosparc_worker/cryosparc_compute/run.py”, line 89, in cryosparc_compute.run.main
File “/home/lab/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py”, line 881, in passthrough_outputs
output_dset = load_output_group_direct(_project_uid, _job_uid, output_group_name, outputted_result_names, outputted_result_names)
File “/home/lab/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py”, line 502, in load_output_group_direct
d = load_output_result_dset(project_uid, output_result, version, slot_name)
File “/home/lab/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py”, line 476, in load_output_result_dset
d.from_file(abspath)
File “/home/lab/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py”, line 709, in from_file
self.data = Dataset._convert_strings(indata, to_fixed=False)
File “/home/lab/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py”, line 770, in _convert_strings
newdata[name][:] = n.array([s.decode() for s in data[name]], dtype=‘O’)
File “/home/lab/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py”, line 770, in
newdata[name][:] = n.array([s.decode() for s in data[name]], dtype=‘O’)
UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0xaa in position 87: invalid start byte

When attempting to mark the job as complete, a very similar error happens.
Thank you in advance for any help.

2

Just in case: could either the project directory or the worker’s particle cache (if enabled) have run out of space? Is the particle cache device exclusively used by this cryoSPARC instance?
Please can you post:

  • job.log from the from the 2d classification job’s directory
  • number of particles
  • box size
  • number of micrographs used for particle picking
  • number of 2D classes

along with cryoSPARC worker system information: