UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe9 in position 86: invalid continuation byte

Troubleshooting
1

Hi,

2d jobs fail with this error message below. Does anyone know how to fix it?

[CPU: 9.41 GB]   Traceback (most recent call last):
  File "cryosparc_worker/cryosparc_compute/run.py", line 88, in cryosparc_compute.run.main
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py", line 877, in passthrough_outputs
    output_dset = load_output_group_direct(_project_uid, _job_uid, output_group_name, outputted_result_names, outputted_result_names)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py", line 492, in load_output_group_direct
    d = load_output_result_dset(project_uid, output_result, version, slot_name)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/jobs/runcommon.py", line 466, in load_output_result_dset
    d.from_file(abspath)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py", line 696, in from_file
    self.data = Dataset._convert_strings(indata, to_fixed=False)
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py", line 757, in _convert_strings
    newdata[name][:] = n.array([s.decode() for s in data[name]], dtype='O')
  File "/home/cryosparc_user/cryosparc/cryosparc_worker/cryosparc_compute/dataset.py", line 757, in <listcomp>
    newdata[name][:] = n.array([s.decode() for s in data[name]], dtype='O')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe9 in position 86: invalid continuation byte
2

Hi @yasharsadian, it looks like one of particle dataset files has invalid data in it. Did you do any processing of these particles outside of cryoSPARC? Can you direct-message me the particle dataset files that were used as an input for the 2D Classification job? You can download them from the “Outputs” group of the parent job (e.g., the Extract from Micrographs job):

Example parent job
Example parent job956Ă—1190 137 KB

Particle outputs
Particle outputs2292Ă—488 133 KB

Please send me both the download results of the particle.blob and particle.location outputs.

1 Like