3D Variability Display Fail

Hello, I am trying to run a 3D Variability Display after a completed 3D Variability job, but it keeps failing.
The error message reads:

Traceback (most recent call last):
  File "cryosparc_worker/cryosparc_compute/run.py", line 85, in cryosparc_compute.run.main
  File "cryosparc_worker/cryosparc_compute/jobs/var3D/run_disp.py", line 46, in cryosparc_compute.jobs.var3D.run_disp.run
  File "/scratch/cryosoft/cryosparc/cryosparc2_worker/cryosparc_compute/jobs/runcommon.py", line 560, in load_input_group
    dsets = [load_input_connection_slots(input_group_name, keep_slot_names, idx, allow_passthrough=allow_passthrough) for idx in range(num_connections)]
  File "/scratch/cryosoft/cryosparc/cryosparc2_worker/cryosparc_compute/jobs/runcommon.py", line 560, in <listcomp>
    dsets = [load_input_connection_slots(input_group_name, keep_slot_names, idx, allow_passthrough=allow_passthrough) for idx in range(num_connections)]
  File "/scratch/cryosoft/cryosparc/cryosparc2_worker/cryosparc_compute/jobs/runcommon.py", line 531, in load_input_connection_slots
    dsets = [load_input_connection_single_slot(input_group_name, slot_name, connection_idx, allow_passthrough=allow_passthrough) for slot_name in slot_names]
  File "/scratch/cryosoft/cryosparc/cryosparc2_worker/cryosparc_compute/jobs/runcommon.py", line 531, in <listcomp>
    dsets = [load_input_connection_single_slot(input_group_name, slot_name, connection_idx, allow_passthrough=allow_passthrough) for slot_name in slot_names]
  File "/scratch/cryosoft/cryosparc/cryosparc2_worker/cryosparc_compute/jobs/runcommon.py", line 521, in load_input_connection_single_slot
    output_result = com.query(otherjob['output_results'], lambda r : r['group_name'] == slotconnection['group_name'] and r['name'] == slotconnection['result_name'], error='No match for %s.%s in job %s' % (slotconnection['group_name'], slotconnection['result_name'], job['uid']))
  File "/scratch/cryosoft/cryosparc/cryosparc2_worker/cryosparc_compute/jobs/common.py", line 619, in query
    assert res != default, error
AssertionError: No match for particles.components_mode_6 in job J246

Can you help me understand what is the problem and how I can fix it?
Thank you!

Welcome to the forum @Michal.
Please can you post the job.json contents corresponding to this display job and the upstream 3D Variability job, respectively.

Can you please explain what exactly you mean? The overview? The metadata?

Yes. The Data (next to Log) link under Metadata is one way to access that information. Alternatively, the information is available in the job.json file inside the job directory.

I still don’t understand how do exactly what you said.
In “Metadata” tab there’s a “copy to clipboard” option, I did that, but text is too long to copy here, so here’s a link to the file:

Also, I copied the whole text in the “Metadata” tab, also text is too long to put here.
Link to file:

Is that what you meant?
If not, please be more clear about how I get the job.json file, cause so far it is very unclear.

That is exactly the information I was looking for. I was not sure which version of CryoSPARC you are running. My instructions assumed a different version of the user interface, not version 3.3.1, which you appear to be running.

OK, great. So can you see the file of the “copy to clipboard”? Can you help me understand the error and how can I make it work?

I can. I wonder whether the upstream job J245 has in some way been changed or re-run after J246 was first created.
Please can you post metadata for J245 also, using the clipboard method.

J245 copy to clipboard:

{"_id":{"_str":"6369033dacf4224491f7c7d5"},"children":["J259","J258","J246"],"created_at":"2022-11-07T13:08:13.426Z","parents":["J247","J249"],"project_uid":"P12","queue_message":null,"status":"completed","title":"New Job J245","uid":"J245","workspace_uids":["W1"],"cloned_from":"J237","deleted":false,"type":"var_3D","ui_tile_height":1,"ui_tile_images":[{"name":"mode0","fileid":"636cca107e28690f9688c8c9","num_rows":1,"num_cols":1},{"name":"mode1","fileid":"636cca117e28690f9688c8d0","num_rows":1,"num_cols":1},{"name":"mode2","fileid":"636cca127e28690f9688c8d7","num_rows":1,"num_cols":1},{"name":"mode3","fileid":"636cca137e28690f9688c8de","num_rows":1,"num_cols":1},{"name":"mode4","fileid":"636cca157e28690f9688c8e5","num_rows":1,"num_cols":1},{"name":"mode5","fileid":"636cca167e28690f9688c8ec","num_rows":1,"num_cols":1}],"ui_tile_width":6,"job_type":"var_3D","completed_at":"2022-11-10T09:55:21.848Z","created_by_job_uid":null,"created_by_user_id":"61dd834b99dcfca4d3ba01f3","description":"Enter a description.","failed_at":"2022-11-09T18:01:44.327Z","interactive":false,"job_dir_size":4223381916,"killed_at":null,"last_accessed":{"name":"Michal","accessed_at":"2022-11-23T16:41:57.512Z"},"launched_at":"2022-11-09T12:01:32.990Z","priority":0,"queued_at":"2022-11-09T12:01:31.575Z","started_at":"2022-11-09T12:01:35.126Z","waiting_at":null,"version":"v3.3.1","run_as_user":null,"params_secs":{"prepare":{"title":"Particle preprocessing","desc":"","order":0},"var3D":{"title":"3D Variability","desc":"","order":1},"compute_settings":{"title":"Compute settings","desc":"","order":2},"random":{"title":"Random Seeds","desc":"","order":3}},"params_base":{"prepare_window_dataset":{"type":"boolean","value":true,"title":"Window dataset (real-space)","desc":"","order":0,"section":"prepare","advanced":false,"hidden":false},"prepare_window_inner_radius":{"type":"number","value":0.85,"title":"Window inner radius","desc":"","order":1,"section":"prepare","advanced":true,"hidden":false},"prepare_window_outer_radius":{"type":"number","value":0.99,"title":"Window outer radius","desc":"","order":2,"section":"prepare","advanced":true,"hidden":false},"var_K":{"type":"number","value":3,"title":"Number of modes to solve","desc":"The number of orthogonal principle modes (i.e. eigenvectors of the 3D covariance) to solve.","order":3,"section":"var3D","advanced":false,"hidden":false},"var_N":{"type":"number","value":null,"title":"Refinement box size (Voxels)","desc":"The volume size to use for refinement. If this is null, use the full image size. Otherwise images are automatically downsampled","order":4,"section":"var3D","advanced":false,"hidden":true},"var_symmetry":{"type":"string","value":"C1","title":"Symmetry","desc":"This symmetry is not actually used in the job. Particles must be symmetry-expanded (use the Symmetry Expansion job) prior to connecting to 3D Variability.","order":5,"section":"var3D","advanced":false,"hidden":false},"var_num_particles":{"type":"number","value":null,"title":"Only use this many particles","desc":"","order":6,"section":"var3D","advanced":false,"hidden":false},"var_filter_res":{"type":"number","value":null,"title":"Filter resolution (A)","desc":"Resolution at which results are filtered","order":7,"section":"var3D","advanced":false,"hidden":false},"var_filter_order":{"type":"number","value":1.5,"title":"Filter order","desc":"Order of filter","order":8,"section":"var3D","advanced":false,"hidden":false},"var_highpass_res":{"type":"number","value":null,"title":"Highpass resolution (A)","desc":"Resolution below which variability is ignored","order":9,"section":"var3D","advanced":true,"hidden":false},"var_highpass_order":{"type":"number","value":8,"title":"Highpass order","desc":"Order of filter","order":10,"section":"var3D","advanced":true,"hidden":false},"var_use_gramschmidt":{"type":"boolean","value":true,"title":"Use Gram-Schmidt","desc":"","order":11,"section":"var3D","advanced":true,"hidden":true},"var_use_white_noise":{"type":"boolean","value":false,"title":"Use white noise model","desc":"Use a white noise model (default) instead of a colored noise model. One or the other may work better depending on the dataset.","order":12,"section":"var3D","advanced":true,"hidden":false},"var_use_scales":{"type":"enum","value":"optimal","title":"Per-particle scale","desc":"How to treat per-particle scale factors. No scales means all particles have scale 1.0 (useful for very small particles or strange cases). Input scales means to use the input scale factors (which may have come from another refinement). Optimal means to compute per-particle optimal scales on the fly during 3D variability.","order":13,"section":"var3D","advanced":true,"hidden":false,"enum_keys":["none","input","optimal"],"enum_dict":{"none":"none","input":"input","optimal":"optimal"}},"var_num_iterations":{"type":"number","value":20,"title":"Number of iterations","desc":"Number of optimization iterations when solving 3D variability","order":14,"section":"var3D","advanced":true,"hidden":false},"var_lambda":{"type":"number","value":0.01,"title":"Lambda","desc":"Stabilizing coefficient - try larger values if optimization diverges and creates artefacts. In v2.12 this was changed to a normalized fractional value, where 0.01 should work for almost all datasets.","order":15,"section":"var3D","advanced":true,"hidden":false},"compute_use_ssd":{"type":"boolean","value":true,"title":"Cache particle images on SSD","desc":"Use the SSD to cache particles. Speeds up processing significantly.","order":16,"section":"compute_settings","advanced":false,"hidden":false},"random_seed":{"type":"number","value":null,"title":"Random seed","desc":"Set to null to auto generate.","order":17,"section":"random","advanced":true,"hidden":false}},"params_spec":{"var_filter_res":{"value":10},"var_K":{"value":6}},"input_slot_groups":[{"type":"particle","name":"particles","title":"Particle stacks","description":"Particle stacks to use. Multiple stacks will be concatenated.","count_min":1,"count_max":null,"repeat_allowed":false,"slots":[{"type":"particle.blob","name":"blob","title":"Particle data blobs","description":"","optional":false},{"type":"particle.ctf","name":"ctf","title":"Particle ctf parameters","description":"","optional":false},{"type":"particle.alignments3D","name":"alignments3D","title":"Particle alignments3D parameters","description":"","optional":false}],"connections":[{"job_uid":"J247","group_name":"particles","slots":[{"slot_name":"blob","job_uid":"J247","group_name":"particles","result_name":"blob","result_type":"particle.blob","version":"F"},{"slot_name":"ctf","job_uid":"J247","group_name":"particles","result_name":"ctf","result_type":"particle.ctf","version":"F"},{"slot_name":"alignments3D","job_uid":"J247","group_name":"particles","result_name":"alignments3D","result_type":"particle.alignments3D","version":"F"},{"slot_name":null,"job_uid":"J247","group_name":"particles","result_name":"alignments2D","result_type":"particle.alignments2D","version":"F"},{"slot_name":null,"job_uid":"J247","group_name":"particles","result_name":"location","result_type":"particle.location","version":"F"},{"slot_name":null,"job_uid":"J247","group_name":"particles","result_name":"pick_stats","result_type":"particle.pick_stats","version":"F"}]}]},{"type":"mask","name":"mask","title":"Mask","description":"","count_min":1,"count_max":1,"repeat_allowed":false,"slots":[{"type":"volume.blob","name":"mask","title":"Mask raw data","description":"","optional":false}],"connections":[{"job_uid":"J249","group_name":"mask","slots":[{"slot_name":"mask","job_uid":"J249","group_name":"mask","result_name":"mask","result_type":"volume.blob","version":"F"}]}]}],"output_result_groups":[{"uid":"J245-G0","type":"particle","name":"particles","title":"All particles","description":"All particles that were processed, including alignments","contains":[{"uid":"J245-R1","type":"particle.components","group_name":"particles","name":"components_mode_0","passthrough":false},{"uid":"J245-R3","type":"particle.components","group_name":"particles","name":"components_mode_1","passthrough":false},{"uid":"J245-R5","type":"particle.components","group_name":"particles","name":"components_mode_2","passthrough":false},{"uid":"J245-R7","type":"particle.components","group_name":"particles","name":"components_mode_3","passthrough":false},{"uid":"J245-R9","type":"particle.components","group_name":"particles","name":"components_mode_4","passthrough":false},{"uid":"J245-R11","type":"particle.components","group_name":"particles","name":"components_mode_5","passthrough":false},{"uid":"J245-R13","type":"particle.blob","group_name":"particles","name":"blob","passthrough":true},{"uid":"J245-R14","type":"particle.ctf","group_name":"particles","name":"ctf","passthrough":true},{"uid":"J245-R15","type":"particle.alignments3D","group_name":"particles","name":"alignments3D","passthrough":true},{"uid":"J245-R16","type":"particle.alignments2D","group_name":"particles","name":"alignments2D","passthrough":true},{"uid":"J245-R17","type":"particle.location","group_name":"particles","name":"location","passthrough":true},{"uid":"J245-R18","type":"particle.pick_stats","group_name":"particles","name":"pick_stats","passthrough":true}],"passthrough":"particles","num_items":441608,"summary":{"components_mode_0/component":0,"components_mode_1/component":1,"components_mode_2/component":2,"components_mode_3/component":3,"components_mode_4/component":4,"components_mode_5/component":5,"blob/shape":[512,512],"blob/psize_A":0.7929999828338623,"blob/sign":-1,"ctf/type":"spline","ctf/accel_kv":300,"ctf/cs_mm":2.700000047683716,"ctf/amp_contrast":0.10000000149011612,"ctf/phase_shift_rad":0,"ctf/scale":1,"ctf/shift_A":[0,0],"ctf/tilt_A":[0,0],"ctf/trefoil_A":[0,0],"ctf/tetra_A":[0,0,0,0],"ctf/anisomag":[0,0,0,0],"ctf/bfactor":0,"alignments3D/psize_A":0.7929999828338623,"alignments2D/psize_A":1.5859999656677246,"location/micrograph_shape":[4092,5760]}},{"uid":"J245-G1","type":"volume","name":"volume","title":"3D Variability volumes","description":"","contains":[{"uid":"J245-R0","type":"volume.blob","group_name":"volume","name":"map","passthrough":false},{"uid":"J245-R2","type":"volume.blob","group_name":"volume","name":"component_0","passthrough":false},{"uid":"J245-R4","type":"volume.blob","group_name":"volume","name":"component_1","passthrough":false},{"uid":"J245-R6","type":"volume.blob","group_name":"volume","name":"component_2","passthrough":false},{"uid":"J245-R8","type":"volume.blob","group_name":"volume","name":"component_3","passthrough":false},{"uid":"J245-R10","type":"volume.blob","group_name":"volume","name":"component_4","passthrough":false},{"uid":"J245-R12","type":"volume.blob","group_name":"volume","name":"component_5","passthrough":false}],"passthrough":false,"num_items":1,"summary":{}}],"output_results":[{"uid":"J245-R0","type":"volume.blob","group_name":"volume","name":"map","title":"Filtered consensus map","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_map.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R1","type":"particle.components","group_name":"particles","name":"components_mode_0","title":"Components class 0","description":"","min_fields":[["component","u4"],["value","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_particles.cs"],"num_items":[441608],"passthrough":false},{"uid":"J245-R2","type":"volume.blob","group_name":"volume","name":"component_0","title":"Component data","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_component_0.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R3","type":"particle.components","group_name":"particles","name":"components_mode_1","title":"Components class 1","description":"","min_fields":[["component","u4"],["value","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_particles.cs"],"num_items":[441608],"passthrough":false},{"uid":"J245-R4","type":"volume.blob","group_name":"volume","name":"component_1","title":"Component data","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_component_1.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R5","type":"particle.components","group_name":"particles","name":"components_mode_2","title":"Components class 2","description":"","min_fields":[["component","u4"],["value","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_particles.cs"],"num_items":[441608],"passthrough":false},{"uid":"J245-R6","type":"volume.blob","group_name":"volume","name":"component_2","title":"Component data","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_component_2.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R7","type":"particle.components","group_name":"particles","name":"components_mode_3","title":"Components class 3","description":"","min_fields":[["component","u4"],["value","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_particles.cs"],"num_items":[441608],"passthrough":false},{"uid":"J245-R8","type":"volume.blob","group_name":"volume","name":"component_3","title":"Component data","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_component_3.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R9","type":"particle.components","group_name":"particles","name":"components_mode_4","title":"Components class 4","description":"","min_fields":[["component","u4"],["value","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_particles.cs"],"num_items":[441608],"passthrough":false},{"uid":"J245-R10","type":"volume.blob","group_name":"volume","name":"component_4","title":"Component data","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_component_4.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R11","type":"particle.components","group_name":"particles","name":"components_mode_5","title":"Components class 5","description":"","min_fields":[["component","u4"],["value","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_particles.cs"],"num_items":[441608],"passthrough":false},{"uid":"J245-R12","type":"volume.blob","group_name":"volume","name":"component_5","title":"Component data","description":"","min_fields":[["path","O"],["shape","3u4"],["psize_A","f4"]],"versions":[0],"metafiles":["J245/cryosparc_P12_J245_component_5.cs"],"num_items":[1],"passthrough":false},{"uid":"J245-R13","type":"particle.blob","group_name":"particles","name":"blob","title":"Passthrough blob","description":"Passthrough from input particles.blob (slot_name)","min_fields":[["path","O"],["idx","u4"],["shape","2u4"],["psize_A","f4"],["sign","f4"],["import_sig","u8"]],"versions":[0],"metafiles":["J245/P12_J245_passthrough_particles.cs"],"num_items":[441608],"passthrough":true},{"uid":"J245-R14","type":"particle.ctf","group_name":"particles","name":"ctf","title":"Passthrough ctf","description":"Passthrough from input particles.ctf (slot_name)","min_fields":[["type","O"],["exp_group_id","u4"],["accel_kv","f4"],["cs_mm","f4"],["amp_contrast","f4"],["df1_A","f4"],["df2_A","f4"],["df_angle_rad","f4"],["phase_shift_rad","f4"],["scale","f4"],["scale_const","f4"],["shift_A","2f4"],["tilt_A","2f4"],["trefoil_A","2f4"],["tetra_A","4f4"],["anisomag","4f4"],["bfactor","f4"]],"versions":[0],"metafiles":["J245/P12_J245_passthrough_particles.cs"],"num_items":[441608],"passthrough":true},{"uid":"J245-R15","type":"particle.alignments3D","group_name":"particles","name":"alignments3D","title":"Passthrough alignments3D","description":"Passthrough from input particles.alignments3D (slot_name)","min_fields":[["split","u4"],["shift","2f4"],["pose","3f4"],["psize_A","f4"],["error","f4"],["error_min","f4"],["resid_pow","f4"],["slice_pow","f4"],["image_pow","f4"],["cross_cor","f4"],["alpha","f4"],["alpha_min","f4"],["weight","f4"],["pose_ess","f4"],["shift_ess","f4"],["class_posterior","f4"],["class","u4"],["class_ess","f4"]],"versions":[0],"metafiles":["J245/P12_J245_passthrough_particles.cs"],"num_items":[441608],"passthrough":true},{"uid":"J245-R16","type":"particle.alignments2D","group_name":"particles","name":"alignments2D","title":"Passthrough alignments2D","description":"Passthrough from input particles.alignments2D (result_name)","min_fields":[["split","u4"],["shift","2f4"],["pose","f4"],["psize_A","f4"],["error","f4"],["error_min","f4"],["resid_pow","f4"],["slice_pow","f4"],["image_pow","f4"],["cross_cor","f4"],["alpha","f4"],["alpha_min","f4"],["weight","f4"],["pose_ess","f4"],["shift_ess","f4"],["class_posterior","f4"],["class","u4"],["class_ess","f4"]],"versions":[0],"metafiles":["J245/P12_J245_passthrough_particles.cs"],"num_items":[441608],"passthrough":true},{"uid":"J245-R17","type":"particle.location","group_name":"particles","name":"location","title":"Passthrough location","description":"Passthrough from input particles.location (result_name)","min_fields":[["micrograph_uid","u8"],["exp_group_id","u4"],["micrograph_path","O"],["micrograph_shape","2u4"],["center_x_frac","f4"],["center_y_frac","f4"]],"versions":[0],"metafiles":["J245/P12_J245_passthrough_particles.cs"],"num_items":[441608],"passthrough":true},{"uid":"J245-R18","type":"particle.pick_stats","group_name":"particles","name":"pick_stats","title":"Passthrough pick_stats","description":"Passthrough from input particles.pick_stats (result_name)","min_fields":[["ncc_score","f4"],["power","f4"],["template_idx","u4"],["angle_rad","f4"]],"versions":[0],"metafiles":["J245/P12_J245_passthrough_particles.cs"],"num_items":[441608],"passthrough":true}],"output_group_images":{},"errors_build_params":{},"errors_build_inputs":{},"errors_run":[{"message":"Job is unresponsive - no heartbeat received in 30 seconds.","warning":false}],"running_at":"2022-11-09T12:01:41.841Z","token_acquired_at":null,"tokens_requested_at":null,"last_scheduled_at":null,"resources_needed":{"slots":{"CPU":4,"GPU":1,"RAM":3},"fixed":{"SSD":true}},"resources_allocated":{"lane":"default","lane_type":"default","hostname":"emu1.wexac.weizmann.ac.il","target":{"monitor_port":null,"lane":"default","name":"emu1.wexac.weizmann.ac.il","title":"Worker node emu1.wexac.weizmann.ac.il","resource_slots":{"GPU":[0,1,2,3],"RAM":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47],"CPU":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47]},"hostname":"emu1.wexac.weizmann.ac.il","cache_path":"/fastdisk/","cache_quota_mb":null,"gpus":[{"id":0,"name":"Tesla P40","mem":24032378880},{"id":1,"name":"Tesla P40","mem":24032378880},{"id":2,"name":"Tesla P40","mem":24032378880},{"id":3,"name":"Tesla P40","mem":24032378880}],"resource_fixed":{"SSD":true},"desc":null,"cache_reserve_mb":10000,"type":"node","ssh_str":"emnadav@emu1.wexac.weizmann.ac.il","worker_bin_path":"/scratch/cryosoft/cryosparc/cryosparc2_worker/bin/cryosparcw"},"slots":{"CPU":[0,1,2,3],"GPU":[0],"RAM":[0,1,2]},"fixed":{"SSD":true},"license":true,"licenses_acquired":1},"run_on_master_direct":false,"queued_to_lane":"default","queue_index":null,"queue_status":null,"queued_job_hash":null,"interactive_hostname":"emu1.wexac.weizmann.ac.il","interactive_port":null,"PID_monitor":249727,"PID_main":249728,"PID_workers":[],"cluster_job_id":null,"is_experiment":false,"job_dir":"J245","experiment_worker_path":null,"enable_bench":false,"bench":{},"completed_count":1,"instance_information":{"platform_node":"emu1.wexac.weizmann.ac.il","platform_release":"3.10.0-1160.59.1.el7.x86_64","platform_version":"#1 SMP Wed Feb 23 16:47:03 UTC 2022","platform_architecture":"x86_64","physical_cores":24,"max_cpu_freq":4200,"total_memory":"376.18GB","available_memory":"355.82GB","used_memory":"13.40GB","gpu_info":[{"id":0,"name":"Tesla P40","mem":24032378880}],"CUDA_version":"10.1.0"},"project_uid_num":12,"uid_num":245,"last_exported":"2022-11-10T09:55:21.708Z","ui_layouts":{"P12":{"show":true,"floater":false,"top":9628,"left":6145,"width":882,"height":192,"groups":[{"start":"J245","endrow":35,"conns":[{"start":"J245","end":"J259","startrow":34,"startcol":10071,"endrow":35,"endcol":10094,"subtree":0,"coloridx":85,"origin":[6586,9820],"extent":[23,240],"coords":[[0,0],[0,160],[23,160],[23,240]]},{"start":"J245","end":"J258","startrow":34,"startcol":10071,"endrow":35,"endcol":9902,"subtree":0,"coloridx":85,"origin":[6417,9820],"extent":[169,240],"coords":[[169,0],[169,160],[0,160],[0,240]]},{"start":"J245","end":"J246","startrow":34,"startcol":10071,"endrow":35,"endcol":9710,"subtree":0,"coloridx":85,"origin":[6225,9820],"extent":[361,240],"coords":[[361,0],[361,160],[0,160],[0,240]]}],"startcol":10071,"startrow":34,"leftendcol":9710,"rightendcol":10094,"single":true,"len":1,"subtree":0,"lane":7}]},"P12W1":{"show":true,"floater":false,"top":9628,"left":6125,"width":882,"height":192,"groups":[{"start":"J245","endrow":35,"conns":[{"start":"J245","end":"J259","startrow":34,"startcol":9996,"endrow":35,"endcol":10019,"subtree":0,"coloridx":85,"origin":[6566,9820],"extent":[23,240],"coords":[[0,0],[0,160],[23,160],[23,240]]},{"start":"J245","end":"J258","startrow":34,"startcol":9996,"endrow":35,"endcol":9827,"subtree":0,"coloridx":85,"origin":[6397,9820],"extent":[169,240],"coords":[[169,0],[169,160],[0,160],[0,240]]},{"start":"J245","end":"J246","startrow":34,"startcol":9996,"endrow":35,"endcol":9635,"subtree":0,"coloridx":85,"origin":[6205,9820],"extent":[361,240],"coords":[[361,0],[361,160],[0,160],[0,240]]}],"startcol":9996,"startrow":34,"leftendcol":9635,"rightendcol":10019,"single":true,"len":1,"subtree":0,"lane":7}]}},"queued_to_hostname":false,"queued_to_gpu":false,"no_check_inputs_ready":false,"num_tokens":1,"job_sig":"752262058310987788502059603707473817409307413706040956953258838280877844364237881416401690099519780411789122384011908692368399062282566233236823522404295242001025936675775579211784676659198420484301861407130355481457052365556293356281552096270594584388826096019598964959667710629232390276597318782954248976261979328462071666353182349122633576935949436448808867750175871055055793094726248291220132684774986893373659799284669842821774456123426499358235797677348485802051882209678367039733002329172430145884772776750299802102899814093738907371483512786242226218235719652711469309020052747455829371373219933139478075753665771061953580879063807484961385174858707561866637652619687940526582296683772634920962062017437113922862731737825934207454011001482536595255048653727854839716095256509225801940095367335553429389221434021623290577547194365184576373266879573848260177347969587756226410712684277421341918876266866545382889205140315488904323470133545303044284244653784171507909680179262300222695858739212700519777721622857224720893633718791194434743510955514621817006024430823417110107262375043846349262626469239570456409864906898135601272863809613600729762066262944627650202479689221966459200214200196250754878050721043376272220954143797","tokens_acquired_at":1667995292.9868493,"status_num":35,"progress":[]}

Was

  1. J246 created based on an earlier version of J245 (with a Number of modes to solve larger than 6)
  2. J245 re-run with a reduced Number of modes to solve
  3. J246 run assuming the (no longer valid) original Number of modes to solve?

Some time stamps in the J245 and J246 metadata suggest that possibility.

Yes, at first I tried running J245 with more number of modes to solve, but it failed, so I cleared the job and edited it with less number of modes to solve and re-ran it. I then re-edited J246 to fit the new number of modes to solve and queued it.
Is this the issue? If I will clone the job with the current conditions, will it work?

I suspect cloning J246 will not work unless additionally the input connections are cleared, then replaced with outputs of the most recent version of J245.

@Michal Were you able to resolve this issue?

Yes, thank you for following up :smile: