No... Doesn't bother me at all. I generally like them to be between 5" to 8". No more no less. And that means sometimes I'm bigger than the guy.
I was 7" but may have shrunk to about 6". Not sure cause I can only get fully hard when I'm with someone. And I'm not thinking about measuring at that time.