Jobs exported on 5.0.4 do not import correctly on 4.7.1

Import and Export
1

Hi,

I have an archive of an exposure sets job which was exported from a 5.0.4 instance, then tarred:

Using “import job” to import this on another v5 instance works fine; however attempting to import on a v4.7.1 instance fails. Is this a bug in v5 export, or v4 import? Other exposure sets jobs import fine.

Cheers

Oli

image
image1922×1468 510 KB

image
image634×470 35.2 KB

2

@olibclarke Is this the same tar file as in Micrograph thumbnails disappearing for imported job ?
Please can you post to the bottom of the imported job’s Event Log?

3

Hi @wtempel, thanks! Yes, same archive - I don’t have access to the system I was using anymore unfortunately (was at a course), or a 4.7 system to reproduce, but perhaps you can test?

4

@olibclarke Is it possible that ancestor job J5598 was modified/re-run after job J5610 was originally run? This would explain

  • some
    Unable to find /[...]/J5610_split_0/J5598/motioncorrected/017640452691024487166_21jun24a_Fra4_00016gr_00010sq_v03_00011hln_00027enn.frames_bin2_patch_aligned.mrc for import of Job PX-PY
    events that you might encounter near the event log when you try to import the exported Exposure Sets Tool in CryoSPARC v5.
  • unexpected behavior of the imported jobs outputs in CryoSPARC v4 or v5
5

No, it wasn’t modified or rerun after 5610 was originally run, so that isn’t it..

image
image1960×630 118 KB

image
image2260×620 201 KB

image
image1662×806 158 KB

6

Thanks @olibclarke . Please can you share with us

  1. the outputs of these commands
    cd $(mktemp -d)
find /home/exx/processing/cryosparc_projects/francesca/P2/exports/jobs/J5610_exposure_sets -ls > J5610_export.out 2> J5610_export.err
find /home/exx/processing/cryosparc_projects/francesca/P2/J5598 -ls > J5598_files.out 2> J5598_files.err
tar cvzf outputs.tgz *.out *.err
realpath outputs.tgz # note path for retrieval
  2. A screenshot of the job tree section that shows connections between jobs J5598 and J5610?
    [edited on 2026-07-07 to correct J5598-related find command]
7

Here is 2:

image
image1104×1260 167 KB

Re 1, I guess you just want the output archive? If so here it is: Dropbox

1 Like
8

Thanks @olibclarke for the additional context (screenshot). Sincere apologies for posting an incorrect find command for the J5598 file listing. The correct command should have been

find /home/exx/processing/cryosparc_projects/francesca/P2/J5598 -ls > J5598_files.out 2> J5598_files.err

Please can you run the corrected command and upload file J5598_files.out.

9

Here you go:

10

Thanks @olibclarke . The folder

/home/exx/processing/cryosparc_projects/francesca/P2/exports/jobs/J5610_exposure_sets/J5610_split_0/J5598/motioncorrected/

seems to be missing expected non-dose-weighted *_patch_aligned.mrc files, which could be causing job import to fail in CryoSPARC v4.

11

Thanks @wtempel - I deliberately removed those before making the archive because they weren’t needed and I wanted to minimize the size for students to download. But if that is the issue shouldn’t that have triggered an error on export? And why would import then work in v5 but not on v4?

12

Understood. “Manual” changes at the file level inside a project or job directory may lead to unexpected behavior. That said,

  1. We noted the interest by several CryoSPARC users in not retaining non-doseweighted micrographs and will consider a corresponding feature enhancement in a future software release.
  2. Import in CryoSPARC v5 succeeds due to enhanced (relative to v4) handling of certain outputs missing from the exported job directory.
1 Like