Only Text Quote

If I go out with my girlfriends, no one has an issue, but if I put up a post with a male friend or I'm seen chatting with a co-star, there is unnecessary speculation. What wrong am I doing that I'm being treated this way?