In order to use a robot in the construction automation filed, we proposed the concept of Bolting Robot and a visual servo control scheme to track a bolting tool to a bolt hole in the structural steel frame. For estimating a location of a bolt hole, Circular Hough Transform (CHT) was used to extract circles. Generally, CHT is computationally complex due to a power of the dimensionality of a circle. A distance from a camera to a steel frame can be measured by using laser range-finder installed. The radius of a bolt hole can be calculated with the distance to a steel frame. Since the radius is known, the processing of CHT can be reduced to 2D. In addition, it contains image pre-processing to make an image of bolt holes to be clear. Pre-processing has 4 steps which consist of compensating lens distortion, noise filtering, histogram equalization, and edge detection.