Slurm polling frequency

The guide at https://guide.cryosparc.com/setup-configuration-and-management/software-system-guides/guide-cluster-integration-validation says “For jobs submitted to cluster lanes, the cluster scheduler is polled in an interval until the job enters running status” For a Slurm cluster, what is the frequency of this status polling? Is it done by squeue? Is there any way to control the frequency?

Hi,

I assume the environment variable, CRYOSPARC_CLUSTER_JOB_MONITOR_INTERVAL, is what you’re after. It has a default value of 10 seconds.

The exact command used to poll the scheduler is defined in your cluster_info.json at time of lane setup (the qstat_cmd_tpl-field?), but is likely some variation of squeue -j <cluster_job_id>. You should also be able to find this in your web GUI under Instance Information.

Cheers,
Yang

2 Likes

Thank you! That’s what I was looking for. I’ve adjusted it and it seems to be working for us.