For me, it has to do with some shoes that women wear. I had been a fan of keds which was for both men an women in the 80s. More popular among women. I do wear them in four colors. They did come back for men in 2008 but cost nearly double the price. Men who purchased them stuck with the womens version which did not much much difference. I did research on Mary Janes which were for both boys and girls in the 40s. Men do wear these. I have a few pair. Nobody really pays any attention though and I got to the point in life where I dont car what others think. I actually had complements. I wear black ones with black socks. Reebok Princes i have those also reebok exo-fit which is the same shoe but thicker sole. There is a sneaker wedge boot I am a fan of that seems to have fallen as a popular show among women. I will post a photo. I get lots of complements on the boots. Men even asked where can they get them. All of my shoes have to match in color to my shirts and pants. 
Certain shoes it doesn’t matter heck I have worn men shoes before nobody can tell by looking at them weather, they are men or women shoes. Now if they are colorful, high heels or women boots then yeah that would stick out for a man, but other than that nobody would know thanks for sharing Darryl.