Due to the rapid deployment of IT technology, health care service has entered a new era. Some services such as cardiac monitoring are critical for life and have contributed to saving lives. On the other hand, monitoring hair loss is another interesting health care service. Even though it is not critical for life, people tend to pay much attention to their hair condition. Hair loss is one of the major issues related to the hair condition since excessive and uncared hair loss might lead to bald head. Hair care can be done professionally at the hair care shop but it requires much time and cost. Recently, due to inexpensive smart devices, self-diagnosis on the hair condition has become possible. Still, few applications have been developed to evaluate hair condition. In this paper, we propose a new scheme to evaluate the condition of hair and scalp by extracting diverse features from their microscopy image. The features include hair thickness, hair density and scalp blotch. We show the effectiveness of our scheme by extensive experiments on the prototype system.