I don't know much as far as the WSL on Windows is concerned but I bet you'll lose on performance even with short tasks on CPU.
I don't know how they have implemented this system on Windows but for other projects I took a step back on reinstalled Win10 dure to lesser performance
Now, be "as close as possible" to the hardware, I'm running Linux waiting for WU to crunch from GPUGRID.
My thought is that WSL is like a kind of a virtualization and therefore you cannot access all functionnalies of your hardware as easily (if only possible) as if it was running as your host (Win11 in this case, your main system).
Why do you think I'm running Ubuntu directly? ;)
I've always wondered if it was at least possible to crunch using CPU with a WSL Linux. Now I don't have to try it anymore, thanks for sharing your experience!
I know it doesn't help you crunching as you'd like.
I just hope someone will confirm (or better, deny, I'd be surprise) what I've said.
EDIT : my answer come second. Didn't know there was even drivers which could be installed.