Aiming at the issue of how to reflect the emotional needs of the consumers in the design of clothing materials, this paper studies the methods of texture design based on Kansei Engineering. Through filtering and counting the description vocabulary of the clothing material features, a group of typical sensorial words can be confirmed. Through semantic quantitative survey of clothing material samples, and using BP neural network, the images and feelings characteristics of clothing material can be modeled. Genetic algorithm can be used to achieve the evolution of the design scheme to meet the emotional design objects. The experimental results show that the methods can effectively achieve the requirements of the specific design objects of clothing material texture.