Journal Articles

Read relevant research from across the medical community in this library on several topics related to physician knowledge, assessment in training, board certification, ongoing certification, and physician professionalism.

ABIM updates this robust resource of evidence from several top-tier medical journals regularly, but it is not a comprehensive list. The American Board of Medical Specialties (of which ABIM is a member board) has additional resources in their Continuing Certification Reference Center, a dynamic database of literature relevant to board certification and Maintenance of Certification (MOC).

Please note: Some articles might require a subscription to the publication in order to view.

Physician Knowledge and Competency

Fraundorf, S. H., Caddick, Z. A., Nokes-Malach, T. J., & Rottman; B. M. (2023). Cognitive perspectives on maintaining physicians’ medical expertise: III. Strengths and weaknesses of self-assessment. Cognitive Research: Principles & Implications, 8, 58.

Fraundorf, S. H., Caddick, Z., Rottman, B., Nokes-Malach, T., Swanson, D. B., Bazemore, A., O’Neill, T., & Lipner, R. S. (2021). Conceptual foundations for designing continuing certification assessments for physicians.

Vandergrift JL, Gray BM. Physician clinical knowledge, practice infrastructure, and quality of care. American Journal of Managed Care. 2019; 25(10):497-503.

Brusca SB, Barnett C, Barnhart BJ, Weng W, Morrow DA, Soble JS, Katz JN, Wiley BM, van Diepen S, Gomez AD, Solomon MA. Role of critical care medicine training in the cardiovascular intensive care Unit: Survey responses from dual certified critical care cardiologists. J Am Heart Assoc. 2019; 8(6):e011721.

Duhigg LM, Baranowski RA, Arnold GK. Does having open access to care improve patient experience? A case-control study. Am J Med Qual. 2018 Jul;33(4):365-371.

Vandergrift JL, Gray BM, Weng W. Do state continuing medical education requirements for physicians improve clinical knowledge? Health Serv Res. 2018 Jun;53(3):1682-1701.

Norcini JJ, Boulet JR, Opalek A, Dauphinee WD. Patients of doctors further from medical school graduation have poorer outcomes. Med Educ. 2017; 51(5): 480-9.

Makary MA, Daniel M. Medical error—the third leading cause of death in the US. BMJ. 2016; 353: i2139.

National Academies of Sciences, Engineering, and Medicine. Improving diagnosis in health care. Washington, DC: The National Academies Press, 2015.

Durning SJ, Costanzo ME, Beckman TJ, Artino AR Jr, Roy MJ, Van Der Vleuten C, Holmboe ES, Lipner RS, Schuwirth L. Functional neuroimaging correlates of thinking flexibility and knowledge structure in memory: exploring the relationships between clinical reasoning and diagnostic thinking. Med Teach. 2016; 38(6): 570-7.

Hess BJ, Lipner RS, Thompson V, Holmboe ES, Graber ML. Blink or think: can further reflection improve initial diagnostic impressions? Acad Med. 2015; 90(1): 112-8.

Norman G, Sherbino J, Dore K, Wood T, Young M, Gaissmaier W, Kreuger S, Monteiro S. The etiology of diagnostic errors: a controlled trial of system 1 versus system 2 reasoning. Acad Med. 2014; 89(2): 277-84.

Graber ML, Wachter RM, Cassel CK. Bringing diagnosis into the quality and safety equations. JAMA. 2012; 308(12): 1211-2.

Eva KW, Regehr G, Gruppen LD. Blinded by “insight”: self-assessment and its role in performance improvement. In: Hodges BD, Lingard L, editors. The question of competence: Reconsidering medical education in the twenty-first century. New York: Cornell University Press; 2012. p. 131-54.

Berner ES, Graber ML. Overconfidence as a cause of diagnostic error in medicine. Am J Med. 2008; 121(5 Suppl): S2-23.

Eva KW, Regehr G. “I'll never play professional football” and other fallacies of self-assessment. J Contin Educ Health Prof. 2008; 28(1): 14-9.

Bowen JL. Educational strategies to promote clinical diagnostic reasoning. N Engl J Med. 2006; 355(21): 2217-25.

Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006; 296(9): 1094-102.

Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005; 165(13): 1493-9.

Audet AM, Doty MM, Shamasdin J, Schoenbaum SC. Measure, learn, and improve: physicians' involvement in quality improvement. Health Aff (Millwood). 2005; 24(3): 843-53.

Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med. 2005; 142(4): 260-73.

Fisher ES. Medical care--is more always better? N Engl J Med. 2003; 349(17): 1665-7.

Gruppen LD, Frohna AZ. Clinical reasoning. In: Norman GR, van der Vleuten C, Newble D, editors. International handbook of research in medical education. Norwell, MA: Kluwer Academic Publishers; 2002; 205-30.

Bordage G. Why did I miss the diagnosis? Some cognitive explanations and educational implications. Acad Med. 1999; 74(10 Suppl): S138-43.

Assessment in Training

Klein R, Koch J, Snyder ED, Volerman A, Simon W, Jassal SK, et al. Association of Gender and Race/Ethnicity with Internal Medicine In-Training Examination Performance in Graduate Medical Education. J Gen Intern Med. 2022 Jun; online ahead of print.

Panda N, Bahdila D, Abdullah A, Ghosh AJ, Lee SY, Feldman WB. Association Between USMLE Step 1 Scores and In-Training Examination Performance: A Meta-Analysis. Academic Medicine. 2021 Dec; 96(12):1742-1754.

Heath JK, Wang T, Santhosh L, et al. Longitudinal Milestone Assessment Extending Through Subspecialty Training: The Relationship Between ACGME Internal Medicine Residency Milestones and Subsequent Pulmonary and Critical Care Fellowship Milestones. Acad Med. 2021 May. Online ahead of print.

Hauer KE, Jurich D, Vandergrift JL, et al. Gender Differences in Milestone Ratings and Medical Knowledge Examination Scores Among Internal Medicine Residents. Acad Med. 2021 March. Online ahead of print.

Fowler JG, VanEenenaam DP, Johnson KN, Traunero JR, Reynolds JE. Sticks or Carrots? How an Easy-to-Implement Incentive Plan Improved Our Performance on the In-training Exam. J Educ Perioper Med. 2020. 22(3): E647.

McDonald FS, Jurich D, Duhigg LM, Paniagua M, Chick D, Wells M, Williams A, Alguire P. Correlations Between the USMLE Step Examinations, American College of Physicians In-Training Examination, and ABIM Internal Medicine Certification Examination. Acad Med. 2020 Apr 7. Online ahead of print.

Peterson PE, Boulet JR, Clauser B. Associations Between Medical Education Assessments and American Board of Family Medicine Certification Examination Score and Failure to Obtain Certification. Acad Med. 2020 Mar 31. Online ahead of print.

Asad ZUA, Tunnell C. ABIM/ACC competency-based education pilot in Internal Medicine-Cardiology: a fellow's perspective. J Am Coll Cardiol. 2018; 72(12): 1422-1426.

Holmboe ES, Call S, Ficalora RD. Milestones and competency-based medical education in internal medicine. JAMA Intern Med. 2016; 176(11): 1601-1602.

Hauer KE, Vandergrift J, Hess B, Lipner RS, Holmboe ES, Hood S, Iobst W, Hamstra SJ, McDonald FS. Correlations between ratings on the resident annual evaluation summary and the internal medicine milestones and association with ABIM certification examination scores among US internal medicine residents, 2013-2014. JAMA. 2016; 316(21): 2253-2262

Hauer KE, Clauser J, Lipner RS, Holmboe ES, Caverzagie K, Hamstra SJ, Hood S, Iobst W, Warm E, McDonald FS. The internal medicine reporting milestones: cross-sectional description of initial implementation in U.S. residency programs. Ann Intern Med. 2016; 165(5): 356-62.

Callahan KE, Rogers MT, Lovato JF, Fernandez HM. A longitudinal, experiential quality improvement curriculum meeting ACGME competencies for geriatrics fellows: lessons learned. Gerontol Geriatr Educ. 2013; 34(4): 372-92.

Bernabeo EC, Hood S, Iobst WF, Holmboe ES, Caverzagie K. Optimizing the implementation of practice improvement modules in training: lessons from educators. J Grad Med Educ. 2013; 5(1): 74-80.

Holmboe ES, Hess BJ, Conforti LN, Lynn LA. Comparative trial of a web-based tool to improve the quality of care provided to older adults in residency clinics: modest success and a tough road ahead. Acad Med. 2012; 87(5): 627-34.

Lynn LA, Hess BJ, Weng W, Lipner RS, Holmboe ES. Gaps in quality of diabetes care in internal medicine residency clinics suggest the need for better ambulatory care training. Health Aff (Millwood). 2012; 31(1): 150-158.

Reddy SG, Kogan JR, Iobst WF, Holmboe ES. The ABIM's clinical supervision practice improvement module and its effect on faculty's supervisory skills. Acad Med. 2012; 87(11): 1632-38.

Shaffer SL, Day HD. Systematic outpatient screening for the elderly: care of the vulnerable elderly practice improvement module to assess resident care of older adults. J Am Geriatr Soc. 2010; 58(11): 2173-7.

Shunk Rl, Dulay M, Julian K, Cornett P, Kohwles J, Tarter L, Hollander H, O'Brien B, O'Sullivan P. Using the American Board of Internal Medicine practice improvement modules to teach internal medicine residents practice improvement. J Grad Med Educ. 2010; 2(1): 90-5.

Vinci LM, Oyler J, Johnson JK, Arora VM. Effect of a quality improvement curriculum on resident knowledge and skills in improvement. Qual Saf Health Care. 2010; 19(4): 351-4.

Lynn LA, Hess BJ, Conforti LN, Lipner RS, Holmboe ES. Clinic systems and the quality of care for older adults in residency clinics and in physician practices. Acad Med. 2009; 84(12): 1732-40.

Bernabeo EC, Conforti LN, Holmboe ES. The impact of a preventive cardiology quality improvement intervention on residents and clinics: a qualitative exploration. Am J Med Qual. 2009; 24(2): 99-107.

Mladenovic J, Shea JA, Duffy FD, Holmboe ES, Lipner RS. Variation in internal medicine residency clinic practices: assessing practice environments and quality of care. J Gen Intern Med. 2008; 23(7): 914-20.

Oyler J, Vinci L, Arora V, Johnson J. Teaching internal medicine residents quality improvement techniques using the ABIM's practice improvement modules. J Gen Intern Med. 2008; 23(7): 927-30.

Certification

Durning SJ, Dong T, Ratcliffe T, Schuwirth L, Artino A, Boulet J, Eva K. Comparing open-book and closed-book examinations: a systematic review. Acad Med. 2016; 91(4): 583-99.

Durning SJ, Ratcliffe T, Artino AR Jr, van der Vleuten C, Beckman TJ, Holmboe E, Lipner RS, Schuwirth L. How is clinical reasoning developed, maintained, and objectively assessed? Views from expert internists and internal medicine interns. J Contin Educ Health Prof. 2013; 33(4): 215-23.

Lipner RS, Lucey CR. Putting the secure examination to the test. JAMA. 2010; 304(12): 1379-80.

Holmboe ES, Lipner RS, Greiner A. Assessing quality of care: knowledge matters. JAMA. 2008;299(3): 338-40.

Downing S, Haladyna T, editors. Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates; 2006.

Vandergrift JL, Weng W, Gray BM. The association between physician knowledge and inappropriate medications for older populations. J Am Geriatr Soc. 2021 Aug 30. doi: 10.1111/jgs.17413. Online ahead of print.

Kinney CL, Raddatz MM, Sliwa JA, Clark GS, Robinson LR. Does performance on the American Board of Physical Medicine and Rehabilitation initial certification examinations predict future physician disciplinary actions? Am J Phys Med Rehabil. 2019; Available Online Ahead of Print.

Gabriel RA, Kaye AD, Jones MR, Dutton RP, Urman RD. Practice variations in anesthetic care and its effect on clinical outcomes for primary total hip arthroplasties. J Arthroplasty. 2016 Apr;31(4): 918-22.

Jeganathan AN, Shanmugan S, Bleier JI, Hall GM, Paulson EC. Colorectal specialization increases lymph node yield: evidence from a national database. Ann Surg Oncol. 2016 Jul;23(7): 2258-65.

Turner JA, Fitzsimons MG, Pardo MC Jr, Hawkins JL, Huang YM, Rudolph MD, Keyes MA, Howard-Quijano KJ, Naim NZ, Buckley JC, Grogan TR, Steadman RH. Effect of performance deficiencies on graduation and board certification rates: a 10-yr multicenter Study of anesthesiology residents. Anesthesiology. 2016; 125(1): 221-9.

Gabriel RA, Kaye AD, Jones MR, Dutton RP, Urman RD. Practice variations in anesthetic care and its effect on clinical outcomes for primary total hip arthroplasties. J Arthroplasty. 2016; 31(4): 918-22.

Gabriel RA, Lemay A, Beutler SS, Dutton RP, Urman RD. Practice variations in anesthesia for carotid endarterectomies and associated outcomes. J Cardiothorac Vasc Anesth. 2016; 30(1): 23-9.

Lipner RS, Young A, Chaudhry HJ, Duhigg LM, Papadakis MA. Specialty certification status, performance ratings, and disciplinary actions of internal medicine residents. Acad Med. 2016;91(3): 376-81.

Fleischut PM, Eskreis-Winkler JM, Gaber-Baylis LK, Giambrone GP, Wu X, Sun X, Lien CA, Faggiani SL, Dutton RP, Memtsoudis SG. Provider board certification status and practice patterns in total knee arthroplasty. Acad Med. 2016; 91(1): 79-86.

Fiorilli PN, Minges KE, Herrin J, Messenger JC, Ting HH, Nallamothu BK, Lipner RS, Hess BJ, Holmboe ES, Brennan JJ, Curtis JP. Association of physician certification in interventional cardiology with in-hospital outcomes of percutaneous coronary intervention. Circulation. 2015; 132(19): 1816-1824.

Lipner RS, Hess BJ, Phillips RL Jr. Specialty board certification in the United States: issues and evidence. J Contin Educ Health Prof. 2013;33 Suppl 1: S20-35.

Gray BM, Reschovsky J, Holmboe ES, Lipner RS. Do early career indicators of clinical skill predict subsequent career outcomes and practice characteristics for general internists? Health Serv Res. 2013; 48(3): 1096-115.

Reid RO, Friedberg MW, Adams JL, McGlynn EA, Mehrotra A. Associations between physician characteristics and quality of care. Arch Intern Med. 2010; 170(16): 1442-9.

Curtis JP, Luebbert JJ, Wang Y, Rathore SS, Chen J, Heidenreich PA, Hammill SC, Lampert RI, Krumholz HM. Association of physician certification and outcomes among patients receiving an implantable cardioverter-defibrillator. JAMA. 2009; 301(16): 1661-70.

Papadakis MA, Arnold GK, Blank LL, Holmboe ES, Lipner RS. Performance during internal medicine residency training and subsequent disciplinary action by state licensing boards. Ann of Intern Med. 2008; 148(11): 869-76.

Turchin A, Shubina M, Chodos AH, Einbinder JS, Pendergrass ML. Effect of board certification on antihypertensive treatment intensification in patients with diabetes mellitus. Circulation. 2008; 117(5): 623-8.

Chen J, Rathore S, Wang Y, Radford MJ, Krumholz HM. Physician board certification and the care and outcomes of elderly patients with acute myocardial infarction. J Gen Intern Med. 2006; 21(3): 238-44.

Pham HH, Schrag D, Hargraves JL, Bach PB. Delivery of preventive services to older adults by primary care physicians. JAMA. 2005; 294(4): 473-81.

Prystowsky JB, Bordage G, Feinglass JM. Patient outcomes for segmental colon resection according to surgeon's training, certification, and experience. Surgery. 2002; 132(4): 663-70.

Norcini JJ, Kimball HR, Lipner RS. Certification and specialization: do they matter in the outcome of acute myocardial infarction? Acad Med. 2000; 75(12): 1193-8.

Manning BT, Ahn J, Bohl DD, Mayo BC, Louie PK, Singh K. Spine surgeon selection criteria: factors influencing patient choice. Spine (Phila Pa 1976). 2016; 41(13): E814-9.

American Board of Medical Specialties.Facts about the ABMS consumer survey: lifelong learning and other qualities in choosing a doctor (pdf). ABMS;2011.

Freed GL, Dunham KM, Clark SJ, Davis MM, Research Advisory Committee of the American Board of Pediatrics. Perspectives and preferences among the general public regarding physician selection and board certification. J Pediatr. 2010; 156(5): 841-5.

Brennan TA, Horwitz RI, Duffy FD, Cassel CK, Goode LD, Lipner RS. The role of physician specialty board certification status in the quality movement. JAMA. 2004; 292(9): 1038-43.

Maintenance of Certification

Gray BM, Vandergrift JL, McCoy RG, Lipner RS, Landon BE. Association between primary care physician diagnostic knowledge and death, hospitalisation and emergency department visits following an outpatient visit at risk for diagnostic error: a retrospective cohort study using medicare claims. BMJ Open. 2021 Apr 1; 11(4):e041817.

Kopp JP, Ibáñez B, Jones AT, Pei X, Young A, Arnhart K, Rizzo AG, Buyske J. Association Between American Board of Surgery Initial Certification and Risk of Receiving Severe Disciplinary Actions Against Medical Licenses. Jama Surgery. 2020; Available Online Ahead of Print.

Kinney CL, Raddatz MM, Sliwa JA, Driscoll SW, Robinson LR. Association of Participation in the American Board of Physical Medicine and Rehabilitation Maintenance of Certification Program and Physician Disciplinary Actions. Am J Phys Med Rehabil. 2020 Apr; 99 (4), 325-329.

Nelson LS, Duhigg LM, Arnold GK, Lipner RS, Harvey AL, Reisdorff EJ. The association between maintaining American Board of Emergency Medicine Certification and State Medical Board disciplinary actions. The Journal of Emergency Medicine. 2019; Available Online Ahead of Print.

Zhou Y, Sun H, Macario A, Keegan MT, Patterson AJ, Minhaj MM, Wang T, Harman AE, Warner DO. Association between participation and performance in MOCA Minute and actions against the medical licenses of anesthesiologists. Anesth Analg. 2019; Available Online Ahead of Print.

Jones AT, Kopp JP, Malangoni MA. Recertification exam performance in general surgery is associated with Subsequent Loss of License Actions. Ann Surg. 2019; Available Online Ahead of Print.

Price DW, Biernacki H, Nora LM. Can Maintenance of Certification work? associations of MOC and improvements in physicians' knowledge and practice. Acad Med. 2018; 93(12): 1872-1881.

McMahon GT. Inspiring curiosity and restoring humility: the evolution of competency-based continuing medical education. Acad Med. 2018; 93(12): 1757-1759.

Zhou Y, Sun H, Macario A, Keegan MT, Patterson AJ, Minhaj MM, Wang T, Harman AE, Warner DO. Association between performance in a Maintenance of Certification program and disciplinary actions against the medical licenses of anesthesiologists. Anesthesiology. 2018; 129(4): 812-820.

Jones AT, Kopp JP, Malangoni MA. Association between maintaining certification in general surgery and loss-of-license actions. JAMA. 2018; 320(11): 1195-1196.

Heitlinger LA. Do maintenance of certification activities promote positive changes in clinical practice? J Pediatr Gastroenterol Nutr. 2016; 64(5): 655.

Hayward K, Haaland WL, Hrachovec J, et al. Reliable pregnancy testing before intravenous cyclophosphamide: a quality improvement study. Pediatrics. 2016; 138(6).

Sun H, Zhou Y, Culley DJ, Lien CA, Harman AE, Warner DO. Association between participation in an intensive longitudinal assessment program and performance on a cognitive examination in the Maintenance of Certification in Anesthesiology Program®. Anesthesiology. 2016; 125(5): 1046-1055.

Riley M, Ahmed S, Lane JC, Reed BD, Locke A. J Pediatr Adolesc Gynecol. Using maintenance of certification as a tool to improve the delivery of confidential care for adolescent patients. 2016; 30(1): 76-81.

Wiggins RE Jr, Etz R. Assessment of the American Board of Ophthalmology's maintenance of certification part 4 (Improvement in medical practice). JAMA Ophthalmol. 2016; 134(9): 967-74.

Morrell J, Stratman EJ. Relationship between physicians’ active participation in maintenance of certification and patients' perspective of care surveys. J Patient Exp. 2016; 3(2):43-7.

Fiks AG, Luan X, Mayne SL. Improving HPV vaccination rates using maintenance of certification requirements. Pediatrics. 2016; 137(3).

Peterson LE, Eden A, Cochrane A, Hagen M. Physician satisfaction with and practice changes resulting from American Board of Family Medicine maintenance of certification performance in practice modules. J Contin Educ Health Prof. 2016; 36(1): 55-60.

Peterson LE, Blackburn B, Puffer JC, Phillips RL Jr. Family physicians' quality interventions and performance improvement for hypertension through maintenance of certification. J Healthc Qual. 2015; 38(3): 175-86.

Steadman RH, Burden AR, Huang YM, Gaba DM, Cooper JB. Practice improvements based on participation in simulation for the maintenance of certification in anesthesiology program. 2015; 122(5): 1154-69.

Phillips RL, Blackburn B, Peterson LE, Puffer JC. Maintenance of certification, medicare quality reporting, and quality of diabetes care. Am J Med Qual. 2015; 31(3): 217-23.

Peterson LE, Blackburn B, Phillips RL, Puffer JC. Improving quality of care for diabetes through a maintenance of certification activity: family physicians' use of the chronic care model. J Contin Educ Health Prof. 2014; 34(1): 47-55.

Gray BM, Vandergrift JL, Johnston MM, Reschovsky JD, Lynn LA, Holmboe ES, McCullough JS, Lipner RS. Association between imposition of a maintenance of certification requirement and ambulatory care-sensitive hospitalizations and health care costs. JAMA. 2014; 312(22): 2348-57.

Vernacchio L, Francis ME, Epstein DM, Santangelo J, Trudell EK, Reynolds ME, Risko W. Effectiveness of an asthma quality improvement program designed for maintenance of certification. Pediatrics. 2014; 134(1): e242-8.

Wittich CM, Reed DA, Ting HH, Berger RA, Nowicki KM, Blachman MJ, Mandrekar JN, Beckman TJ. Measuring reflection on participation in quality improvement activities for maintenance of certification. Acad Med. 2014; 89(10): 1392-7.

Elward K, Blackburn B, Peterson LE, Greenawald M, Hagen MD. Improving quality of care and guideline adherence for asthma through a group self-assessment module. J Am Board Fam Med. 2014; 27(3): 391-8.

Peterson LE, Blackburn BE, Puffer JC, Phillips RL Jr. Family physicians' quality interventions and performance improvement through the ABFM diabetes performance in practice module. Ann Fam Med. 2014; 12(1): 17-20.

Galliher JM, Manning BK, Petterson SM, Dickinson LM, Brandt EC, Staton EW, Phillips RL, Pace WD. Do professional development programs for maintenance of certification (MOC) affect quality of patient care? J Am Board Fam Med. 2014; 27(1): 19-25.

Huang JS, Chun S, Sandhu A, Terrones L. Quality improvement in childhood obesity management through the maintenance of certification process. J Pediatr. 2013; 163(5): 1313-6.e1.

Iglehart JK, Baron RB. Ensuring physicians' competence — is maintenance of certification the answer? N Engl J Med. 2012; 367(26): 2543-2549.

Hess BJ, Weng W, Holmboe ES, Lipner RS. The association between physicians’ cognitive skills and quality of diabetes care. Acad Med. 2012; 87(2): 157-63.

Reed DA, West CP, Holmboe ES, Halvorsen AJ, Lipner RS, Jacobs C, McDonald FS. Relationship of electronic medical knowledge resource use and practice characteristics with internal medicine maintenance of certification examination scores. J Gen Int Med. 2012; 27(8): 917-923.

Holmboe ES, Wang Y, Meehan TP, Tate JP, Ho SY, Starkey KS, Lipner RS. Association between maintenance of certification examination scores and quality of care for medicare beneficiaries. Arch Intern Med. 2008; 168(13): 1396-1403.

Weng W, Hess BJ, Lynn LA, Lipner RS. Assessing the quality of osteoporosis care in practice. J Gen Intern Med. 2015; 30(11): 1681-7.

Chesluk BJ, Reddy S, Hess B, Bernabeo E, Lynn L, Holmboe ES. Assessing interprofessional teamwork: pilot test of a new assessment module for practicing physicians. J Contin Educ Health Prof. 2015; 35(1): 3-10.

Gray BM, Vandergrift JL, Gao G, McCullough JS, Lipner RS. Website ratings of physicians and their quality of care. JAMA Intern Medicine. 2015; 175(2): 291-293.

Kolasinski VA, Price DW. Maintenance of certification part IV quality-improvement project for hypertension control: a preliminary retrospective analysis. Perm J. 2015; 19(2): 36-40.

Bernabeo EC, Reddy SG, Ginsburg S, Holmboe ES. Professionalism and maintenance of certification: using vignettes describing interpersonal dilemmas to stimulate reflection and learning. J Contin Educ Health Prof. 2014; 34(2): 112-122.

Lipner RS, Weng W, Caverzagie KJ, Hess BJ. Physician performance assessment: prevention of cardiovascular disease. Adv Health Scie Educ. 2013; 18(5): 1029-45.

Hess BJ, Johnston MM, Iobst WF, Lipner RS. Practice-based learning can improve osteoporosis care. J Am Geriatr Soc. 2013; 61(10): 1651-60.

Reddy SG, Kogan JR, Iobst WF, Holmboe ES. The ABIM's clinical supervision practice improvement module and its effect on faculty's supervisory skills. Acad Med. 2012; 87(11): 1632-8.

Hess BJ, Weng W, Lynn LA, Holmboe ES, Lipner RS. Setting a fair performance standard for physicians' quality of patient care. J Gen Intern Med. 2011; 26(5): 467-473.

Holmboe ES, Weng W, Arnold GK, Kaplan SH, Normand SL, Greenfield S, Hood S, Lipner RS. The comprehensive care project: measuring physician performance in ambulatory practice. Health Serv Res. 2010; 45(6): 1912-33.

Weng W, Hess BJ, Lynn LA, Holmboe ES, Lipner RS. Measuring physicians' performance in clinical practice: reliability, classification accuracy, and validity. Eval Health Prof. 2010; 33(3): 302-20.

Hess BJ, Lynn LA, Holmboe ES, Lipner RS. Toward better care coordination through improved communication with referring physicians. Acad Med. 2009; 84(10 Suppl): S109-12.

Duffy FD, Lynn LA, Didura H, Hess BJ, Caverzagie K, Grosso L, Lipner RS, Holmboe ES. Self-assessment of practice performance: development of the ABIM practice improvement module (PIM). J Contin Educ Health Prof. 2008; 28(1): 38-46.

Holmboe ES, Lynn LA, Duffy FD. Improving the quality of care via maintenance of certification and the web: an early status report. Perspect Biol Med. 2008; 51(1): 71-83.

Lipner RS, Weng W, Arnold GK, Duffy FD, Lynn LA, Holmboe ES. A three-part model for measuring diabetes care in physician practice. Acad Med. 2007; 82(10 suppl): S48-52.

Simpkins J, Divine G, Wang M, Holmboe ES, Pladevall M, Williams LK. Improving asthma care through recertification: a cluster randomized trial. Arch Intern Med. 2007; 167(20): 2240-8.

Holmboe ES, Meehan TP, Lynn LA, Doyle P, Sherwin T, Duffy FD. Promoting physicians' self-assessment and quality improvement: the ABIM diabetes practice improvement module. J Contin Educ Health Prof. 2006; 26(2): 109-19.

Freed GL, Dunham KM, Clark SJ, Davis MM, Research Advisory Committee of the American Board of Pediatrics. Perspectives and preferences among the general public regarding physician selection and board certification. J Pediatr. 2010; 156(5): 841-5.

Brennan TA, Horwitz RI, Duffy FD, Cassel CK, Goode LD, Lipner RS. The role of physician specialty board certification status in the quality movement. JAMA. 2004; 292(9): 1038-43.

Cordovani L, Wong A, Monteiro S. Maintenance of certification for practicing physicians: a review of current challenges and considerations. Can Med Educ J. 2020 Mar 16; 11(1):e70-e80.

Chesluk B, Gray B, Eden A, Hansen E, Lynn L, Peterson L. "That was pretty powerful": A qualitative study of what physicians learn when preparing for their Maintenance of Certification Exams. J Gen Intern Med. 2019; Available Online Ahead of Print.

Valentine CM, Cox DA, Deering TF, Starling RC. What Should I Do? Maintenance of Certification for All Cardiologists in 2019 and Beyond. J Am Coll Cardiol. 2019; 73(4): 517-520.

Weinberger SE. Can Maintenance of Certification Pass the Test? JAMA. 2019; 321(7): 641-642.

Stephenson CR, Wittich CM, Pacyna JE, Wynia MK, Hasan O, Tilburt JC. Primary care physicians' perceptions of practice improvement as a professional responsibility: a cross-sectional study. Med Educ Online. 2018; 23(1): 1474700.

Nangia S. Transforming the American Board of Internal Medicine (ABIM) and Maintenance of Certification (MOC). Am J Kidney Dis. 2018; 72(5): 714-716.

Ibrahim T. Maintenance of Certification, self-regulation, and the decline of physician autonomy. Am J Kidney Dis. 2018; 72(5): 711-713.

Valentine CM, Chazal RA, Oetgen WJ. ABIM Maintenance of Certification: options for ACC members. J Am Coll Cardiol. 2018; 72(1): 119-121.

Cook DA, Blachman MJ, West CP, Wittich CM. Physician attitudes about maintenance of certification: a cross-specialty national survey. Mayo Clin Proc. 2016; 91(10): 1336-1345.

Babu MA, Liau LM, Spinner RJ, Meyer FB. Maintenance of certification and the aging neurosurgeon. Neurosurgery. 2016; 63 Suppl 1:194-5.

Marco CA, Wahl RP, Counselman FL, Heller BN, Harvey AL, Joldersma KB, Kowalenko T, Coombs AB, Reisdorff EJ. The American Board of Emergency Medicine ConCert™ examination: emergency physicians' perceptions of learning and career benefits. Acad Emerg Med. 2016; 23(9):1082-5.

Peterson LE, Blackburn B, Phillips RL Jr, Mainous AG 3rd. Family medicine residency program directors' plans to incorporate maintenance of certification into residency training: a CERA survey. Fam Med. 2014; 46(4): 299-303.

Gallagher TH, Prouty CD, Brock DM, Liao JM, Weissman A, Holmboe ES. Internists' attitudes about assessing and maintaining clinical competence. J Gen Intern Med. 2014; 29(4): 608-614.

Kilo CM. Commentary: maintenance of certification: moving forward. Arch Intern Med. 2011 ;171(2): 176-177.

Levinson W, Holmboe ES. Commentary: maintenance of certification in internal medicine: facts and misconceptions. Arch Intern Med. 2011; 171(2): 174-176.

Lipner RS, Bylsma WH, Arnold GK, Fortna GS, Tooker J, Cassel CK. Who is maintaining certification in internal medicine--and why? A national survey 10 years after initial certification. Ann Intern Med. 2006; 144(1): 29-37.