No. I feel no guilt. How could I? Guilt implies that you are doing something ?wrong? or something you are ?ashamed? of. I am not ashamed of being attracted to beautiful women or being seen with a beautiful woman.
Are you afraid of what your friends might say? Then perhaps you need to look inside yourself. Also you might want to find some new friends?