Skin color is a crucial feature for portraits. It has been widely used to enhance portrait quality, but the standard or reference for skin color are quite vague. In this paper, we explore the affective effect of target skin color for image quality. Target skin color are obtained from literature review of three aspacts of skin researches, measured real skin color, memory skin color and preferred digital skin color. According to the evaluation results, we could conclude that different target skin color setting could lead to different emotional image qualities.