{"id":2669,"date":"2019-08-20T14:58:09","date_gmt":"2019-08-20T18:58:09","guid":{"rendered":"https:\/\/blogs.nejm.org\/general-medicine\/?p=2669"},"modified":"2019-08-22T14:58:08","modified_gmt":"2019-08-22T18:58:08","slug":"bias-in-the-residency-ranking-process","status":"publish","type":"post","link":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/","title":{"rendered":"Bias in the Residency Ranking Process"},"content":{"rendered":"<div id=\"attachment_2455\" style=\"width: 135px\" class=\"wp-caption alignright\"><a href=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2018\/07\/AU000_shippe.jpg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2455\" class=\"size-thumbnail wp-image-2455\" src=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2018\/07\/AU000_shippe-125x150.jpg\" alt=\"Scott Hippe, MD\" width=\"125\" height=\"150\" \/><\/a><p id=\"caption-attachment-2455\" class=\"wp-caption-text\">Scott Hippe, MD, is a Chief Resident at Family Residency of Idaho in Boise.<\/p><\/div>\n<p><em>\u201cCan we please try to be objective about this!\u201d <\/em>I said these words to myself over and over during this year\u2019s interview season as we formulated our residency rank list. At my institution, the residents and faculty have equal sway in forming the rank list. The chief resident facilitates the resident half of the process. As the hours wore on during our last meeting, the discussion gradually deviated from assessing the applicants\u2019 clinical potential. The focus shifted to peripheral elements of character: \u201c[Applicant] is just really cool and I want them to be my friend,\u201d and similar arguments. I was concerned.<\/p>\n<p>One\u2019s ability to get along with other residents is important. However, it isn\u2019t the only factor to consider when ranking residency applicants. You want a clinically solid incoming class who know their stuff and can keep up with the rigors of residency. Trying to move away from haphazard character judgments, I focused on applicants\u2019 board scores and clerkship grades. Consider a situation where applicants \u201cA\u201d and \u201cB\u201d were equally liked by resident interviewers and were similarly involved in extracurriculars. The fair thing to do would be to use their \u201cstats\u201d to sort out who deserved to be ranked higher. Right? And then I started thinking about those criteria.<\/p>\n<p>I realize that the <em>Insights<\/em> blog is read by individuals of many different backgrounds and at varying stages of medical training. Depending on who you are, the ensuing comments might be controversial or maybe they are old news. The first, potentially obvious observation: Objective measures aren\u2019t perfect at predicting real-life clinical ability.<\/p>\n<h2>\u201cObjective\u201d measures aren&#8217;t the be-all, end-all to ranking<\/h2>\n<ul>\n<li>In my experience, USMLE and COMLEX scores (especially Step 1) correlate only\u00a0loosely with clinical ability. Step 1 isn\u2019t written to be a primary discriminating factor in the residency selection process. Beyond pass\/fail, we should stop caring as much about the three-digit score. Seriously, how many practicing physicians need to remember the Krebs cycle? I am not the first one to suggest Step 1 be de-emphasized (<a href=\"http:\/\/doi.org\/10.1097\/ACM.0000000000000855\" target=\"_blank\" rel=\"noopener noreferrer\">Acad Med 2016; 91:12<\/a>).<\/li>\n<li>Although of questionable clinical significance, board scores certainly do correlate with demographic characteristics. Namely, higher board scores are associated with having a non-minority background and speaking English as a first language. Incorrect use of board scores in the ranking process solidifies bias against nontraditional and diverse applicants.<\/li>\n<li>I argue that clerkship grades are not much better. Often they are heavily weighted by standardized testing and thus subject to similar biases as is the USMLE. Clerkship standards also vary from institution to institution. Clerkship performance has some validity internal to the specific medical school, but I would argue that it has less external validity when comparing across schools.<\/li>\n<\/ul>\n<h2>Toward eliminating bias<\/h2>\n<p>I cannot say whether there is one completely perfect way to conduct applicant ranking. The Match process provides a decent place to start. I especially appreciate the standardization it brings to the process. But the Match doesn\u2019t eliminate all sources of bias, especially when it comes to test scores and clerkship grades. Despite many efforts to increase diversity in medical education, the proportions of under-represented minorities in medical schools haven&#8217;t changed much <a href=\"https:\/\/www.aamc.org\/download\/484966\/data\/november2017trendsinracialandethnicminorityapplicantsandmatricu.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">since 1980<\/a>.<\/p>\n<div id=\"attachment_2686\" style=\"width: 310px\" class=\"wp-caption alignleft\"><a href=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2019\/08\/Match-Specialty-numbers.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2686\" class=\"wp-image-2686 size-medium\" src=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2019\/08\/Match-Specialty-numbers-300x214.png\" alt=\"Graph of match specialty positions\" width=\"300\" height=\"214\" srcset=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2019\/08\/Match-Specialty-numbers-300x214.png 300w, https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2019\/08\/Match-Specialty-numbers-768x548.png 768w, https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2019\/08\/Match-Specialty-numbers-1024x731.png 1024w, https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2019\/08\/Match-Specialty-numbers.png 1289w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-2686\" class=\"wp-caption-text\">Specialties by offered positions in the 2015 U.S. Residency Match<\/p><\/div>\n<p>Consider the imperfections inherent in the metrics we use to evaluate medical students. This should beget humility in the resident selection process. Humility that discovers and celebrates applicants\u2019 life experiences. Humility that de-emphasizes the \u201cobjective\u201d measures we use to evaluate our applicants. Humility that breeds a culture of curiosity rather than exclusivity.<\/p>\n<p>The Match this year happened months ago, but soon enough, fall will return and with it, another interview season. If you are involved in a residency, I hope these thoughts challenge next year\u2019s interview process. Lower your USMLE thresholds for interviews. See past the test scores. Look for character. Above all, I propose emphasizing a central evaluation criterion: An applicant\u2019s potential to serve their community and the common good with their medical training.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/resident360.nejm.org\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-926\" src=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2017\/03\/genMedRes360Ad540x250.jpg\" alt=\"NEJM Resident 360\" width=\"540\" height=\"250\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u201cCan we please try to be objective about this!\u201d I said these words to myself over and over during this year\u2019s interview season as we formulated our residency rank list. At my institution, the residents and faculty have equal sway in forming the rank list. The chief resident facilitates the resident half of the process. [&hellip;]<\/p>\n","protected":false},"author":1294,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[49,538,72,33,34,37],"class_list":["post-2669","post","type-post","status-publish","format-standard","hentry","category-about-residency","tag-art-of-medicine","tag-family-medicine","tag-medical-education","tag-reflections","tag-residency","tag-resident-experience"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v17.1.2 (Yoast SEO v20.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Bias in the Residency Ranking Process - Insights on Residency Training<\/title>\n<meta name=\"description\" content=\"Dr. Hippe discusses criteria for ranking potential residents during the Match process.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Bias in the Residency Ranking Process\" \/>\n<meta property=\"og:description\" content=\"Dr. Hippe discusses criteria for ranking potential residents during the Match process.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/\" \/>\n<meta property=\"og:site_name\" content=\"Insights on Residency Training\" \/>\n<meta property=\"article:published_time\" content=\"2019-08-20T18:58:09+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-08-22T18:58:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2018\/07\/AU000_shippe-125x150.jpg\" \/>\n<meta name=\"author\" content=\"Scott Hippe, MD\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Scott Hippe, MD\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/\",\"url\":\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/\",\"name\":\"Bias in the Residency Ranking Process - Insights on Residency Training\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/#website\"},\"datePublished\":\"2019-08-20T18:58:09+00:00\",\"dateModified\":\"2019-08-22T18:58:08+00:00\",\"author\":{\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/#\/schema\/person\/ee4340cb1857fa1b3e172e9572bf210a\"},\"description\":\"Dr. Hippe discusses criteria for ranking potential residents during the Match process.\",\"breadcrumb\":{\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blogs.nejm.org\/general-medicine\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Bias in the Residency Ranking&nbsp;Process\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/#website\",\"url\":\"https:\/\/blogs.nejm.org\/general-medicine\/\",\"name\":\"Insights on Residency Training\",\"description\":\"Observation of residents across diverse medical specialties\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blogs.nejm.org\/general-medicine\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blogs.nejm.org\/general-medicine\/#\/schema\/person\/ee4340cb1857fa1b3e172e9572bf210a\",\"name\":\"Scott Hippe, MD\",\"description\":\"Scott is from a small town in western Washington called Snohomish. He has since been making his way \u201cout east.\u201d First to Spokane, Washington, for college at Gonzaga University and medical school at a satellite of the University of Washington. Then, the eastward march continued to the Family Medicine Residency of Idaho in Boise, where he is one of three chief residents this year. He is hooked on family medicine because of the captivating challenge of caring for individuals of all ages. He will discontinue his eastward migration and stay in the Pacific Northwest to practice broad-spectrum family medicine in a small town close to the mountains, rivers, and lakes that have been his home for 3 decades. Although he considers himself ever an amateur, he nonetheless enjoys a good run, bicycle trip, or climb in the outdoors. Before medical school, he vagabonded in many forms, including overseas travel and a bicycle tour across the continental U.S. He learned to play bass last year because the residency band \u2014 the \u201cPost Void Residuals\u201d \u2014 needed a bassist. His quirkiness is tolerated by his pharmacist-wife and adored by his dog, Chicha.\",\"url\":\"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/author\/shippe\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Bias in the Residency Ranking Process - Insights on Residency Training","description":"Dr. Hippe discusses criteria for ranking potential residents during the Match process.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/","og_locale":"en_US","og_type":"article","og_title":"Bias in the Residency Ranking Process","og_description":"Dr. Hippe discusses criteria for ranking potential residents during the Match process.","og_url":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/","og_site_name":"Insights on Residency Training","article_published_time":"2019-08-20T18:58:09+00:00","article_modified_time":"2019-08-22T18:58:08+00:00","og_image":[{"url":"https:\/\/blogs.nejm.org\/general-medicine\/wp-content\/uploads\/sites\/4\/2018\/07\/AU000_shippe-125x150.jpg"}],"author":"Scott Hippe, MD","twitter_misc":{"Written by":"Scott Hippe, MD","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/","url":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/","name":"Bias in the Residency Ranking Process - Insights on Residency Training","isPartOf":{"@id":"https:\/\/blogs.nejm.org\/general-medicine\/#website"},"datePublished":"2019-08-20T18:58:09+00:00","dateModified":"2019-08-22T18:58:08+00:00","author":{"@id":"https:\/\/blogs.nejm.org\/general-medicine\/#\/schema\/person\/ee4340cb1857fa1b3e172e9572bf210a"},"description":"Dr. Hippe discusses criteria for ranking potential residents during the Match process.","breadcrumb":{"@id":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/2019\/08\/bias-in-the-residency-ranking-process\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.nejm.org\/general-medicine\/"},{"@type":"ListItem","position":2,"name":"Bias in the Residency Ranking&nbsp;Process"}]},{"@type":"WebSite","@id":"https:\/\/blogs.nejm.org\/general-medicine\/#website","url":"https:\/\/blogs.nejm.org\/general-medicine\/","name":"Insights on Residency Training","description":"Observation of residents across diverse medical specialties","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.nejm.org\/general-medicine\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blogs.nejm.org\/general-medicine\/#\/schema\/person\/ee4340cb1857fa1b3e172e9572bf210a","name":"Scott Hippe, MD","description":"Scott is from a small town in western Washington called Snohomish. He has since been making his way \u201cout east.\u201d First to Spokane, Washington, for college at Gonzaga University and medical school at a satellite of the University of Washington. Then, the eastward march continued to the Family Medicine Residency of Idaho in Boise, where he is one of three chief residents this year. He is hooked on family medicine because of the captivating challenge of caring for individuals of all ages. He will discontinue his eastward migration and stay in the Pacific Northwest to practice broad-spectrum family medicine in a small town close to the mountains, rivers, and lakes that have been his home for 3 decades. Although he considers himself ever an amateur, he nonetheless enjoys a good run, bicycle trip, or climb in the outdoors. Before medical school, he vagabonded in many forms, including overseas travel and a bicycle tour across the continental U.S. He learned to play bass last year because the residency band \u2014 the \u201cPost Void Residuals\u201d \u2014 needed a bassist. His quirkiness is tolerated by his pharmacist-wife and adored by his dog, Chicha.","url":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/author\/shippe\/"}]}},"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/posts\/2669","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/users\/1294"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/comments?post=2669"}],"version-history":[{"count":0,"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/posts\/2669\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/media?parent=2669"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/categories?post=2669"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.nejm.org\/general-medicine\/index.php\/wp-json\/wp\/v2\/tags?post=2669"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}