Reliability and Validity of a Nationwide Survey (the Korean Radiation Workers Study)

Background: This study aimed to evaluate the reliability and validity of the self-administered questionnaire for Korean radiation workers. Methods: From May 24, 2016, to June 30, 2017, 20,608 participants completed the questionnaire, providing information on sociodemographics, lifestyle, work history and practices, medical radiation exposure, and medical history, which was linked to the National Dose Registry and the National Cancer Registry. The validity of the questionnaire was evaluated using the responses of 20,608 workers, and reliability was evaluated using the responses of 3043 workers who responded to the survey twice. Results: Responses concerning demographic characteristics and lifestyle showed reliability with a moderate-to-high agreement (kappa: 0.43–0.99), whereas responses concerning occupation and medical radiation exposure had a wide range of agreement (kappa: 0.05–0.95), possibly owing to temporal variability during employment. Regarding validity, responses to the question about the first year of employment had an excellent agreement with the national registry (intraclass correlation coefficient = 0.9); however, responses on cancer history had a wide range of agreement (kappa: 0.22–0.85). Conclusion: Although the reliability and validity of the questionnaire were not distinguished by demographic characteristics, they tended to be low among participants whose occupational radiation exposure was minimal. Overall, the information collected can be reliable for epidemiological studies; however, caution must be exercised when using information such as medical exposure and work practices, which are prone to temporal variability.