This study develops immersive user interface system for construction robotic system by using augmented reality system. Unlike the traditional interface using a monitor view only, the AR interface system in this paper allows the operator to see the invisible eyesight out of camera view by using a virtual 3D model. The operator can control the camera view, and the images of 3D models are changed as the camera view changes in the AR system. With the augmented reality system developed in this paper, the operator can have a wide view of inside of the structure so that one can observe the situation of construction site without having to move the camera around. This AR system alarms the operator of a danger area and gives the operator a guide for completion of task by using the AR system. And this AR interface system contains a tele-operated construction robot system. Therefore, the operator can easily and safely complete construction operation.