This study examined physicians’ participation and performance in the examinations administered by the Asian Intensive Reader of Pneumoconiosis (AIR Pneumo) program from 2008 to 2020 and compared radiograph readings of physicians who passed with those who failed the examinations. Demography of the participants, participation trends, pass/fail rates, and proficiency scores were summarized; differences in reading the radiographs for pneumoconiosis of physicians who passed the examinations and those who failed were evaluated. By December 2020, 555 physicians from 20 countries had taken certification examinations; the number of participants increased in recent years. Reported background specialty training and work experience varied widely. Passing rate and mean proficiency score for participants who passed were 83.4% and 77.6 ± 9.4 in certification, and 76.8% and 88.1 ± 4.5 in recertification examinations. Compared with physicians who passed the examinations, physicians who failed tended to classify test radiographs as positive for pneumoconiosis and read a higher profusion; they likely missed large opacities and pleural plaques and had a lower accuracy in recognizing the shape of small opacities. Findings suggest that physicians who failed the examination tend to over-diagnose radiographs as positive for pneumoconiosis with higher profusion and have difficulty in correctly identifying small opacity shape. © 2024 National Institute of Occupational Safety and Health.