I am one of the people that never uses them, and I think I finally realized why: ADHD.
I usually turn them off, and if there's a part of the GUI dedicated to them, I disable that too. I thought it was to save screen space, but honestly I think it's more so that I won't lose windows to virtual desktops I forgot existed.
I think the tendency to forget things and to occasionally space out and forget what I'm doing has led me to value persistent visual artifacts of whatever I'm doing. That means a visible taskbar with the clock, system tray icons, and application icons, plus terminal windows even if they are idle. Somehow, scanning back and forth across 4 monitors -- even if virtual desktop people reading this can do it much faster their way -- just works better for me.
This touches on something that's actually much deeper that I have been doing for myself:
Sometimes if you do things in a way that plays nicely with your personal neurospice cocktail rather than the more efficient way you "know" that you "should" be doing them, it just makes your life better and that is the whole damn point for why we are working on the computer in the first place.
I can absolutely see myself buzzing around virtual desktops with keyboard commands. I have experimented with desktop setups in the past. I remember for a while in college I was running some kind of 3D desktop program where I had a virtual space where I could move windows and icons around. You could hang images floating in the air like paintings. And this is on 25 year old hardware! I think my GPU was a Geforce 2 GTS. Giga-texel shader baby!