UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe9 in position 86: invalid continuation byte

Hi,

2d jobs fail with this error message below. Does anyone know how to fix it?

[CPU: 9.41 GB]   Traceback (most recent call last):
  File "cryosparc_worker/cryosparc_compute/run.py", line 88, in cryosparc_compute.run.main
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py", line 877, in passthrough_outputs
    output_dset = load_output_group_direct(_project_uid, _job_uid, output_group_name, outputted_result_names, outputted_result_names)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py", line 492, in load_output_group_direct
    d = load_output_result_dset(project_uid, output_result, version, slot_name)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py", line 466, in load_output_result_dset
    d.from_file(abspath)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py", line 696, in from_file
    self.data = Dataset._convert_strings(indata, to_fixed=False)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py", line 757, in _convert_strings
    newdata[name][:] = n.array([s.decode() for s in data[name]], dtype='O')
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py", line 757, in <listcomp>
    newdata[name][:] = n.array([s.decode() for s in data[name]], dtype='O')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe9 in position 86: invalid continuation byte

Hi @yasharsadian, it looks like one of particle dataset files has invalid data in it. Did you do any processing of these particles outside of cryoSPARC? Can you direct-message me the particle dataset files that were used as an input for the 2D Classification job? You can download them from the “Outputs” group of the parent job (e.g., the Extract from Micrographs job):


Please send me both the download results of the particle.blob and particle.location outputs.

1 Like