External aids are required to increase safety and performance during the manual control of an aircraft. Automated systems allow to surpass the performance usually achieved by pilots. However, they suffer from several issues caused by pilot unawareness of the control command from the automation. Haptic aids can overcome these issues by showing their control command through forces on the control device. To investigate how the transparency of the haptic control action in flences performance and pilot behavior, a quantitative comparison between haptic aids and automation is needed. An experiment was conducted in which pilots performed a compensatory tracking task with haptic aids and with automation. The haptic aid and the automation were designed to be equivalent when the pilot was out-of-the-loop, i.e., to provide the same control command. Pilot performance and control effort were then evaluated with pilots in-the-loop and contrasted to a baseline condition without external aids. The haptic system allowed pilots to improve performance compared with the baseline condition. However, automation outperformed the other two conditions. Pilots control effort was reduced by the haptic aid and the automation in a similar way. In addition, the pilot open-loop response was estimated with a non-parametric estimation method. Changes in the pilot response were observed in terms of increased crossover frequency with automation, and decreased neuromuscular peak with haptics.