Not enough memory for benchmark

The benchmark that comes with CryoSPARC always fails at job 17 (homogeneous refinement) due to lack of memory. I run the job with a slurm wrapper like so:

#SBATCH --mem={{ (ram_gb)|int }}GB

The value of ram_gb that is predicted is not enough (24 GB).

I’m not sure how predicted memory is calculated, but that step needs a little goosing.

We occasionally find jobs crashing on our SLURM cluster due to underestimated memory requirements. Until either memory estimates are reworked (I heard this is work-in-progress?) or a bespoke estimation method based on input is introduced, we’ve included additional buffer to our submission script:

#SBATCH --mem={{ (ram_gb*2)|int }}G

That seems to do the job for us.

1 Like