Hi,
How beneficial is it when the number of threads are increased to more than 2?
Hi,
How beneficial is it when the number of threads are increased to more than 2?
Detrimental actually - each thread takes up more GPU memory but there’s no advantage to having more than 2. With 2, they alternate on the GPU so when one is waiting for I/O the other is processing. With 3 or more the effect is the same and no time is saved, but each thread has less GPU memory to work with.
Thank you for the clarification.