Hi @emil,
I was able to reproduce your error by deleting CUDA Toolkit 10.* folders from my workstation.
I then created a hard link, as suggested in the issue I linked above:
cd /usr/local/cuda-11.2/lib64
sudo ln libcusolver.so.11 libcusolver.so.10
And the job worked. Looks like an issue with Tensorflow 2.4, sorry for the inconvenience!