Honestly it doesn’t matter what sim it is switching from one to another always takes an adjustment period for me.
I can hop in most any sim and be competitive but it takes a bit of time to dial in the last 10% or so to be at whatever my peak is for the respective sim.
It’s a fair concern imo, when I sim raced competitively I never played on a different sim because of what you described.
Looking at it these days though I find the ability to be able to adapt much more important. Plus you get to try new sims while improving your adaptability.
If you’re doing track days IRL then the adaptability is one of the biggest positives you can have as well.