Well, to be fair, "significantly" is a qualitative descriptor. What is significant to you might not be to others. That's kind of my point. I don't think that they are significantly different in anatomy given the huge range of options that life offers. To that end, I would agree that chimps aren't significantly different based on anatomy. A jelly fish is, though. Note, I'm not talking in reference to romance. Just in reference to biology.
Regarding their (arguably) "significantly" different anatomy. I don't see it as anywhere as jarring as the anatomical difference between Shepard and Garrus and Tali and that didn't stop romance from happening. Just saying.
It doesnt have to be to that extreme to be significant, i'm using it in a general sense, most people would agree if they were to see a giant 7ft tall creature with grey skin, claws, pointed ears, white eyes, and large horns, they would agree that this creature is significantly different from our species.
And back to the point i made earlier, if a creature that averages that height has so many differences from human physiology, you cant just assume that they're no different than a seven foot human. If a human were to grow to that height they wouldnt grow into the same frame, and the fact that they naturally acquire that amount of muscle mass with little work tells me their strength is superhuman. Chimps arent even close to our height yet have three times the strength of humans, imagine the physical capabilities of something this naturally large. Thats why i say it isnt comparable to a human being