Sasha, I 95% agree.
The reason I think society believes it is ok for a woman to dress herself in a man's clothing is because, there isn't much of a 'difference.'
Unless you've decided to grow a beard, hide your boobs and dress and act like a total boy then, it's not really considered cross dressing.
From a fashion point of view, 'men's' clothing is really in for women. If you think about the baseball and basketball jerseys that are in. Baseball caps are in. The whole checkered shirts tied around your waist or worn. Plus the oversized clothing, it's all based of men's fashion.
Usual male garments don't include dresses, skirts or tube tops. Whereas, all men's fashion such as shirts, pants, trackies (sports clothing) are all a part of a usual woman's closet.
I live in Sydney, we have a lot of cross dressers and transsexual's. So, I think in my society cross dressers are all accepted. They walk freely around the streets and usually no one will bat an eye. I think people judge your friends more, because of the society you're living in.It's probably not something that they're used to. Which, it doesn't make it acceptable but, if more people take a stand then hopefully society will become more open minded.