I have been dating guys for quite some time, so my judgment is anything but "quick" - harsh, probably. Quick or without reason not even close.
I don't want to come across as particularly angry or sulky, so I won't go into details. The thing is, I have found that when things get tough, guys turn tail and run away. Guys lie about us to coworkers, deny knowing us, pretend not to know us if we get clocked. They seem to be more interested in protecting their image or standing, even among strangers than supporting or respecting their TG companion.
I can't count the number of guys who honestly used "dirty secret" or something close when talking about me or my friends. Secrets and shame make men cowards. If you visit some of the LadyBoy forums, the guys who go to Thailand call the walk from the bar to the hotel "the Walk of Shame" and give each other advice on hotels with side doors so their LB can sneak into the room and they won't be embarrassed at the from desk.
Read this:
http://www.xbiz.com/articles/99429/transsexual
The guy who started Grooby, and is probably more familiar with guy who are into TGs, talks about "admirers". It's not a very flattering picture he paints, but in my observations he isn't far off, and his description probably won't bother the majority of guys here.