Make the ResLog job optionally multi-GPU?

Hello,

I am running a ResLog job with a massive dataset of ~2.4 M particles, and it is probably going to time out (our slurm cluster has a max time of 72 hours for the partition that CryoSPARC submits its jobs to).

If I understand this job correctly, it could benefit from being multi-GPU since the reconstructions with different numbers of particles are done separately, right? If not, never mind.

And for now I will try to run it with less steps or with a random subset of the particles (if this first attempt times out).

Thanks!

1 Like

@Guillaume May we ask:

  1. What are the box and pixel sizes of the particles?
  2. How long does a Homogeneous Reconstruction Only job take for the same ≈2.4 M particles?

Yes I forgot to specify this, sorry. This is a huge box: 648 pixels (pixel size ~0.5 A/px).

I did not try to run ResLog with a smaller reconstruction box size because I wasn’t sure how it would affect the resolution estimation.

“Homogeneous reconstruction only” of this entire set took a bit more than 20 hours. Homogeneous refinement took a bit more than 25 hours (I expected a bigger difference in run time between these two jobs).
I can’t verify whether these two jobs and the ResLog job ran on the same node, but they got to run on either a 3080 Ti or an A5000.

I realized that I ran my first attempt at the ResLog job with settings that caused many reconstructions: 1000 particles in the initial sample size, multiplier 1.5, error bars on.
I ran it again with multiplier 4 and no error bars, and it completed in a bit more than 55 hours. So in this job I have 7 points (only 6 being useful for the fit, since the 7th is very close to the 6th), and this is probably still more than enough to constrain the linear fit.

So, new suggestion: it could be simpler to have a parameter asking how many data points we want (with a reasonable default value, maybe 4 or 5 points?), and subsequently automatically calculate the multiplier and initial sample size that result in this many points equally spaced on the log scale and starting from the total number of particles for the highest point.

Another thing, it would be nice if the ResLog job reported the slope and intercept of the fit line. As it is now, one needs to download the text file with the resolution and sample size values and fit the line to get the slope and intercept. It’s not very difficult to do, but an additional step when getting these numbers is the primary reason to run a ResLog job.

2 Likes

Hi @Guillaume,

Thank you for the suggestions, these feature requests have been recorded!

Katherine

1 Like