No, I'm saying that some women have skeletal structures bigger than some men which if this is a deciding factor in something like you indicated it was than those women have genetic advantages over other women, obviously this is not the only genetic trait that could give someone an advantage in a given sport but there are genetic advantages inside the subset of women and those women aren't prevented from competition but those women are dominant in their sport because of genetic advantages they possess. Nobody is equal, everyone is an individual with differences.
Notice there are no females that have transitioned to men, and are now dominating in elite men's sports. This should make plain the inherent discrepancy that is occuring.
In analogy, what I hear you saying sounds similar to allowing a 15yo hockey player to compete against 12yo hockey players because "some" 12 yo kids are bigger than some 15yo kids.