Multiple GPU Types and Queueing

Hardware and Performance
1

Hello,

I have a basic question.

If I have a machine that has multiple GPU types installed with differing memory amounts, would the scheduler take into account expected GPU memory requirements and prioritize jobs that require more memory to the higher capacity cards?

Thanks,

Charles

2

Hi @bowman, The scheduler doesn’t currently take into account GPU types or memory. Right now you can just enable or disable GPUs entirely from being used by the scheduler.

Ali

3