Number of threads


How beneficial is it when the number of threads are increased to more than 2?

Detrimental actually - each thread takes up more GPU memory but there’s no advantage to having more than 2. With 2, they alternate on the GPU so when one is waiting for I/O the other is processing. With 3 or more the effect is the same and no time is saved, but each thread has less GPU memory to work with.

Thank you for the clarification.