In this Letter, the authors present a 'landmark-free' clothes recognition approach. Recent studies have shown that the use of landmark information has achieved great success in the task of clothes recognition. However, the landmark annotation is very labour intensive and time consuming. It also suffers from inter- and intra-individual variability. To overcome these problems, the authors propose a two-branch feature selective network for category classification and attribute prediction. Note that, in this Letter, they prove that the proposed network has an excellent ability to effectively learn a discriminative feature representation of a 'clothing image'. Experimental results on the benchmark data set show that the proposed network yields comparable performance to the state-of-the-art methods, which strongly depend on the fashion landmark.