This seems to be a black and white issue for many, always Yes or always No.
As with most thigns I feel the truth is somewhere in the middle.
It’s a spectrum
IMO
A biological man who never underwent puberty and never got the benefits of higher testosterone etc. should be allowed in women’s sports.
But, someone like Usain Bolt, who because of undergoing male puberty has bigger bones than he would have had if he didn’t, should never be allowed to compete in women’s sports.
Where we draw the line, I don’t know, but I don’t think it’s black or white.
I’d think swimming, but a better example might be basketball.
Going through male puberty would make you taller than you would have otherwise been, and in basketball beign taller gives you an advantage.
With swimming, one would have to push through more body with the same muscle mass (or even less due to suppressed testosterone instead of natural cis woman levels)
Basketball will have some of the same issues to a lesser extent, although the natural different variations will still make up for it. My sister (Cisgender) is taller than I am (Trans girl)