We previously revealed that the appearance of the color of glossy fabric and the effect of saturation and colorfulness on the texture impression are significant. In this study, we examined the color appearance of fabrics with various surface characteristics and the effect of illumination and spectral distribution on texture impression. We first evaluated the color appearance and texture impression of the fabric with various surface characteristics under different illuminance levels. We then evaluated the color appearance and texture impression of fabric under illumination by changing color rendering by spectral distribution. The evaluation of the color appearance of the fabric was more likely determined only by color saturation and colorfulness than the difference in the surface characteristics of the fabric. The texture impression of the fabric was also affected by the difference in the surface characteristics of the fabric (especially with or without specular reflection) in addition to the differences in saturation and colorfulness. Under lower illuminance, the fabric tended to be evaluated as smooth because the visual-acuity reduction due to the low illuminance under dim light reduced the ability of the observer to recognize the fabric surface structure. It is thought that this affected the evaluation of texture impression.