Failed attach project

Dear all, we have transferred by rsync a copy of the project to a new storage place; then detach and attach the new copy path as a project.

When I visually inspect the detached project all is as before, but the newly attached project have some missing jobs in different workspaces; and when I build a new job the counting job is misaligned J617 instead of J907. I wonder if have missed the info but the copy have transferred all the jobs including those missed jobs.
Ibeleie there is an error in the tree and some corrupt file may cause the situation but I a bit lost. Could you help to recover that data in the workspace without t¡need to calculate again the missing job.
Thanks in advance, Hugo

below the output of: cryosparcm filterlog command_core -l ERROR

2024-06-13 10:56:50,983 run ERROR | KeyError: ‘J92’
2024-06-13 10:56:51,008 run ERROR | Encountered exception while running background task
2024-06-13 10:56:51,008 run ERROR | Traceback (most recent call last):
2024-06-13 10:56:51,008 run ERROR | File “cryosparc_master/cryosparc_command/core.py”, line 1146, in cryosparc_master.cryosparc_command.core.background_tasks_worker
2024-06-13 10:56:51,008 run ERROR | File “/home/cryosparc/cryosparc_master/cryosparc_command/commandcommon.py”, line 187, in wrapper
2024-06-13 10:56:51,008 run ERROR | return func(*args, **kwargs)
2024-06-13 10:56:51,008 run ERROR | File “/home/cryosparc/cryosparc_master/cryosparc_command/command_core/init.py”, line 8244, in layout_tree
2024-06-13 10:56:51,008 run ERROR | alljobs, alltreegroups = core.layout_tree(alljobs,
2024-06-13 10:56:51,008 run ERROR | File “cryosparc_master/cryosparc_command/core.py”, line 745, in cryosparc_master.cryosparc_command.core.layout_tree
2024-06-13 10:56:51,008 run ERROR | KeyError: ‘J92’
2024-06-13 10:57:12,461 run ERROR | Encountered exception while running background task
2024-06-13 10:57:12,461 run ERROR | Traceback (most recent call last):
2024-06-13 10:57:12,461 run ERROR | File “cryosparc_master/cryosparc_command/core.py”, line 1146, in cryosparc_master.cryosparc_command.core.background_tasks_worker
2024-06-13 10:57:12,461 run ERROR | File “/home/cryosparc/cryosparc_master/cryosparc_command/commandcommon.py”, line 187, in wrapper
2024-06-13 10:57:12,461 run ERROR | return func(*args, **kwargs)
2024-06-13 10:57:12,461 run ERROR | File “/home/cryosparc/cryosparc_master/cryosparc_command/command_core/init.py”, line 8244, in layout_tree
2024-06-13 10:57:12,461 run ERROR | alljobs, alltreegroups = core.layout_tree(alljobs,
2024-06-13 10:57:12,461 run ERROR | File “cryosparc_master/cryosparc_command/core.py”, line 745, in cryosparc_master.cryosparc_command.core.layout_tree
2024-06-13 10:57:12,461 run ERROR | KeyError: ‘J92’
2024-06-13 10:57:12,491 run ERROR | Encountered exception while running background task
2024-06-13 10:57:12,491 run ERROR | Traceback (most recent call last):
2024-06-13 10:57:12,491 run ERROR | File “cryosparc_master/cryosparc_command/core.py”, line 1146, in cryosparc_master.cryosparc_command.core.background_tasks_worker
2024-06-13 10:57:12,491 run ERROR | File “/home/cryosparc/cryosparc_master/cryosparc_command/commandcommon.py”, line 187, in wrapper
2024-06-13 10:57:12,491 run ERROR | return func(*args, **kwargs)
2024-06-13 10:57:12,491 run ERROR | File “/home/cryosparc/cryosparc_master/cryosparc_command/command_core/init.py”, line 8244, in layout_tree
2024-06-13 10:57:12,491 run ERROR | alljobs, alltreegroups = core.layout_tree(alljobs,
2024-06-13 10:57:12,491 run ERROR | File “cryosparc_master/cryosparc_command/core.py”, line 745, in cryosparc_master.cryosparc_command.core.layout_tree
2024-06-13 10:57:12,491 run ERROR | KeyError: ‘J92’

and here cryosparcm log command_core:

024-06-13 11:25:59,491 import_jobs INFO | Inserted job document in 0.76s…
2024-06-13 11:25:59,491 import_jobs INFO | Inserting streamlogs into jobs…
2024-06-13 11:25:59,491 import_jobs INFO | Done. Inserted 0 streamlogs in 0.00s…
2024-06-13 11:25:59,491 import_jobs INFO | Imported J622 into P33 in 0.76s…
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J100 parents include non-existent job J96
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J100 parents include non-existent job J99
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J119 parents include non-existent job J92
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J111 parents include non-existent job J92
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J107 parents include non-existent job J92
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J102 parents include non-existent job J96
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J101 parents include non-existent job J92
2024-06-13 11:25:59,528 layout_tree WARNING | Job P33 J11 parents include non-existent job J9
2024-06-13 11:25:59,544 import_project_run WARNING | Failed laying out tree in P33: ‘J92’
2024-06-13 11:25:59,545 import_project_run WARNING | Imported project from /mnt/wieczorek_nas2/backup_active/cryoSPARC_projects/working_directory/CS-recombinant-gamma-turc as P33 in 1502.43s with errors.
2024-06-13 11:25:59,546 dump_project INFO | Exporting project P33
2024-06-13 11:25:59,549 dump_project INFO | Exported project P33 to /mnt/wieczorek_nas2/backup_active/cryoSPARC_projects/working_directory/CS-recombinant-gamma-turc/project.json in 0.00s
2024-06-13 11:25:59,549 update_project_size_run INFO | Beginning update project size for P33
2024-06-13 11:29:31,146 dump_project INFO | Exporting project P33
2024-06-13 11:29:31,149 dump_project INFO | Exported project P33 to /mnt/wieczorek_nas2/backup_active/cryoSPARC_projects/working_directory/CS-recombinant-gamma-turc/project.json in 0.00s
2024-06-13 11:29:31,149 update_project_size_run INFO | Finished updating project size for P33 in 211.60s

Hi @hugomh What is your CryoSPARC version?

To confirm: When you created J617 (just now), the project already contained a job J906?
Please can you post the output of these commands:

cryosparcm cli "get_job('P33', 'J92', 'status', 'deleted', 'created_at')"
cryosparcm cli "get_job('P33', 'J617', 'status', 'deleted', 'created_at')"
cryosparcm cli "get_job('P33', 'J906', 'status', 'deleted', 'created_at')"