lo yilbash

How is the prohibition of "lo yilbash" affected by gener neutral clothing

http://www.wsj.com/articles/trendy-brands-market-gender-neutral-styles-1469040311

I am assuming there is no direct tzniut problems.

A story I am told is that R Chaim Kanvesky objects to a man wearing a watch
on the grounds of "lo yilbash". This in spite of the fact that he received
a watch from his father-in-law (Rav Elyashiv) upon his engagement.

: How is the prohibition of "lo yilbash" affected by gener neutral clothing

I am unclear as to what the question is. If it's not exclusively women's
clothing, what's the hava amina to say there is a problem?

-Micha