Project deletion doesn't respond for large projects (v2.2)

Hi,

2.2 is a great new update, can’t wait to try the local refinement etc! Just testing out project deletion now, and it seems to work for small or empty projects, but it just sits there not responding for large projects. I am unsure if it is actually doing anything, and will eventually complete if I leave it long enough, or not.

Perhaps adding a progress bar would be helpful? Or at least bring up another pop up indicating that it is actually deleting, rather than keeping the same one?

Cheers
Oli

1 Like

Hi @olibclarke,

Thanks for letting us know! You should be able to see the progress of the deletion via the log files
(cryosparcm log command_core)

For example:

---- Deleting project UID P11 job UID J1 
     Now clearing job..
---- Deleting project UID P11 job UID J10 
     Now clearing job..
---- Deleting project UID P11 job UID J11 
     Now clearing job..
...

Did the deletion finish? If you have thousands of jobs, you can expect it to take some time as it loops through every single job within the project and clears:

  1. the entire job directory
  2. all supporting files from the database
  3. streamlog
  4. summaries
  5. outputs

Either way, we’ve taken note to bring the status of the deletion to the UI.

Best,
Stephan

Thanks @stephan! I actually got frustrated and canceled the deletion because nothing was happening, but now that I know where to track it I will endeavor to be more patient :slight_smile:

Cheers
Oli

Hi @stephan,

I tried this and it seems it is not actually deleting the project at all - there is a JSON error in the log, see attached.

Cheers
Oli

Hey @olibclarke,

It seems like you may have encountered a different issue :sweat_smile:

Essentially, your job (P1 J100) was created before some changes to the non-uniform refinement job happened, which is why you’re getting a KeyError on a parameter (the parameter didn’t exist when you created the job, but is required by the new version of nu-refinement, and this snippet of code doesn’t handle failed lookups properly). Unfortunately, until we release a bug fix you might not be able to delete this job. Perhaps you can try deleting other workspaces within the project?

Sorry about this, we’ll make sure to get out a fix as soon as possible.

Best,
Stephan

Hey @olibclarke,

With the release of cryoSPARC v2.3, this issue should now be resolved. Can you try deleting those projects again and see if it works?

Thanks,

Stephan

I tried - it seems to delete all the jobs according to the log but the dialog doesn’t disappear and there is an error in the log:

It leaves a project with jobs gone but with empty workspaces - deleting the project a second time works though.