{"id":536,"date":"2021-04-07T18:33:01","date_gmt":"2021-04-07T18:33:01","guid":{"rendered":"https:\/\/www.allendowney.com\/blog\/?p=536"},"modified":"2023-02-25T03:32:25","modified_gmt":"2023-02-25T03:32:25","slug":"berkson-goes-to-college","status":"publish","type":"post","link":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/","title":{"rendered":"Berkson Goes to College"},"content":{"rendered":"\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>This article is like a pre-excerpt from my forthcoming book, Probably Overthinking It: a revised version of this article make up part of the chapter about Berkson&#8217;s paradox. If you would like to get an occasional update about the book, please <a href=\"http:\/\/eepurl.com\/h0nfbX\">join my mailing list<\/a>.<\/p>\n<\/blockquote>\n\n\n\n<p>Suppose one day you visit Representative College, where the student body is a representative sample of the college population. You meet a randomly chosen student and you learn (because it comes up in conversation) that they got a 600 on the SAT Verbal test, which is about one standard deviation above the mean. What do you think they got on the SAT Math test?<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A: 600 or more<\/li>\n\n\n\n<li>B: Between 500 and 600 (above the mean)<\/li>\n\n\n\n<li>C: Between 400 and 500 (below the mean)<\/li>\n\n\n\n<li>D: 400 or less<\/li>\n<\/ul>\n\n\n\n<p>If you chose B, you are right! Scores on the SAT Math and Verbal tests are correlated, so if someone is above average on one, they are probably above average on the other. The correlation coefficient is about 0.7, so people who get 600 on the verbal test get about 570 on the math test, on average.<\/p>\n\n\n\n<p>Now suppose you visit Elite University, where the average score on both tests is 700. You meet a randomly chosen student and you learn (because they bring it up) that they got a 750 on the verbal test, which is about one standard deviation above the mean at E.U. What do you think they got on the math test?<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A: 750 or more<\/li>\n\n\n\n<li>B: Between 700 and 750 (above the mean)<\/li>\n\n\n\n<li>C: Between 650 and 700 (below the mean)<\/li>\n\n\n\n<li>D: 650 or less<\/li>\n<\/ul>\n\n\n\n<p>If you chose B again, you are wrong! Among students at E.U., the correlation between test scores is negative. If someone is above average on one, they are probably below average on the other.<\/p>\n\n\n\n<p>This is an example of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Berkson's_paradox\">Berkson&#8217;s paradox<\/a>, which is a form of selection bias. In this case, the selection is the college admission process, which is partly based on exam scores. And the effect, at elite colleges and universities, is a negative correlation between test scores, even though the correlation in the general population is positive.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Data<\/h2>\n\n\n\n<p>To see how it works in this example, let&#8217;s look at some numbers. I got data from the <a href=\"https:\/\/www.nlsinfo.org\/content\/cohorts\/nlsy97\">National Longitudinal Survey of Youth 1997<\/a> (NLSY97), which &#8220;follows the lives of a sample of [8,984] American youth born between 1980-84&#8221;. The public data set includes the participants&#8217; scores on several standardized tests, including the SAT and ACT.<\/p>\n\n\n\n<p>About 1400 respondents took the SAT. Their average and standard deviation are close to the national average (500) and standard deviation (100). And the correlation is about 0.73.  To get a sense of how strong that is, here&#8217;s what the scatter plot looks like.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png\" alt=\"\" class=\"wp-image-537\" width=\"450\" height=\"300\" srcset=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png 900w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1-300x200.png 300w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1-768x512.png 768w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1-405x270.png 405w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/figure>\n\n\n\n<p>Since the correlation is about 0.7, someone who is one standard deviation above the mean on the verbal test is about 0.7 standard deviations above the mean on the math test, on average. So at Representative College, if we select people with verbal scores near 600, their average math score is about 570.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Elite University<\/h2>\n\n\n\n<p>Now let&#8217;s see what happens when we select students for Elite University. Suppose that in order to get into E.U., your total SAT score has to be 1320 or higher. If we select students who meet or exceed that threshold, their average on both tests is about 700, and the standard deviation is about 50. <\/p>\n\n\n\n<p>Among these students, the correlation between test scores is about -0.33, which means that if you are one standard deviation above the E.U. mean on one test, you are about 0.33 standard deviations below the E.U. mean on the other, on average.<\/p>\n\n\n\n<p>The following figure shows why this happens:<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson2.png\" alt=\"\" class=\"wp-image-539\" width=\"450\" height=\"300\" srcset=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson2.png 900w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson2-300x200.png 300w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson2-768x512.png 768w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson2-405x270.png 405w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/figure>\n\n\n\n<p>The students who meet the admission requirements at Elite University form a triangle in the upper right, with a moderate negative correlation between test scores.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Specialized University<\/h2>\n\n\n\n<p>Of course, most admissions decisions are based on more than the sum of two SAT scores. But we get the same effect even if the details of the admission criteria are different. For example, suppose another school, Specialized University, admits students if either test score is 720 or better, regardless of the other score.<\/p>\n\n\n\n<p>With this threshold, the mean for both tests is close to 700, the same as Elite University, and the standard deviations are a little higher. But again, the correlation is negative, and a little stronger than at E.U., about -0.38, compared to -0.33.<\/p>\n\n\n\n<p>The following figure shows the distribution of scores for admitted students.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson3.png\" alt=\"\" class=\"wp-image-541\" width=\"450\" height=\"300\" srcset=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson3.png 900w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson3-300x200.png 300w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson3-768x512.png 768w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson3-405x270.png 405w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/figure>\n\n\n\n<p>There are three kinds of students Specialized University: good at math, good at language, and good at both. But the first two groups are bigger than the third, so the overall correlation is negative.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Sweep the Threshold<\/h2>\n\n\n\n<p>Now let&#8217;s see what happens as we vary the admissions requirements. I&#8217;ll go back to the previous version, where admission depends on the total of the two tests, and vary the threshold.<\/p>\n\n\n\n<p>As we increase the threshold, the average total score increases and the correlation decreases. The following figure shows the results.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson4.png\" alt=\"\" class=\"wp-image-543\" width=\"450\" height=\"300\" srcset=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson4.png 900w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson4-300x200.png 300w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson4-768x512.png 768w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson4-405x270.png 405w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/figure>\n\n\n\n<p>At Representative College, where the average total SAT is near 1000, test scores are strongly correlated. At Elite University, where the average is over 1400, the correlation is moderately negative.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Secondtier College<\/h2>\n\n\n\n<p>But at a college that is selective but not elite, the effect might be even stronger than that. Suppose at Secondtier College (it&#8217;s pronounced &#8220;seh con&#8217; tee ay'&#8221;), a student with a total score of 1220 or more is admitted, but a student with 1320 or more is likely to go somewhere else. <\/p>\n\n\n\n<p>In that case, the average total score would be about 1260. So, based on the parameter sweep in the previous section, we would expect a weak positive correlation, but the correlation is actually strongly negative, about -0.8! The following picture shows why.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson5.png\" alt=\"\" class=\"wp-image-544\" width=\"450\" height=\"300\" srcset=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson5.png 900w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson5-300x200.png 300w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson5-768x512.png 768w, https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson5-405x270.png 405w\" sizes=\"auto, (max-width: 450px) 100vw, 450px\" \/><\/figure>\n\n\n\n<p>At Secondtier, if you meet a student who got a 690 on the math test, about one standard deviation above the mean, you should expect them to get a 580 on the verbal test, on average. That&#8217;s a remarkable effect.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Summary<\/h2>\n\n\n\n<p>Among the students at a given college or university, verbal skills and math skills might be strongly correlated, anti-correlated, or uncorrelated, depending on how the students are selected. This is an example of Berkson&#8217;s paradox.<\/p>\n\n\n\n<p>If you enjoy this kind of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Paradox#Quine's_classification\">veridical paradox<\/a>, you might like my previous article &#8220;<a href=\"https:\/\/towardsdatascience.com\/the-inspection-paradox-is-everywhere-2ef1c2e9d709\">The Inspection Paradox Is Everywhere<\/a>&#8220;. And if you like thinking about probability, you might like the second edition of <em><a href=\"https:\/\/amzn.to\/39We6x4\">Think Bayes<\/a><\/em> (affiliate link), which will be published by O&#8217;Reilly Media later this month.<\/p>\n\n\n\n<p>If you want to see the details of my analysis and run the code, <a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt2\/blob\/master\/berkson_college.ipynb\">click here to run the notebook on Colab<\/a>.<\/p>\n\n\n\n<p>Finally, if you have access to standardized test scores at a college or university, and you are willing to compute a few statistics, I would love to compare my results with some real-world data. For students who enrolled, I would need<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Mean and standard deviation for each section of the SAT or ACT.<\/li>\n\n\n\n<li>Correlations between the sections.<\/li>\n<\/ul>\n\n\n\n<p>The results, if you share them, would appear as a dot on a graph, either labeled or unlabeled at your discretion. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>This article is like a pre-excerpt from my forthcoming book, Probably Overthinking It: a revised version of this article make up part of the chapter about Berkson&#8217;s paradox. If you would like to get an occasional update about the book, please join my mailing list. Suppose one day you visit Representative College, where the student body is a representative sample of the college population. You meet a randomly chosen student and you learn (because it comes up in conversation) that&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1],"tags":[],"class_list":["post-536","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Berkson Goes to College - Probably Overthinking It<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Berkson Goes to College - Probably Overthinking It\" \/>\n<meta property=\"og:description\" content=\"This article is like a pre-excerpt from my forthcoming book, Probably Overthinking It: a revised version of this article make up part of the chapter about Berkson&#8217;s paradox. If you would like to get an occasional update about the book, please join my mailing list. Suppose one day you visit Representative College, where the student body is a representative sample of the college population. You meet a randomly chosen student and you learn (because it comes up in conversation) that... Read More Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\" \/>\n<meta property=\"og:site_name\" content=\"Probably Overthinking It\" \/>\n<meta property=\"article:published_time\" content=\"2021-04-07T18:33:01+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-25T03:32:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png\" \/>\n<meta name=\"author\" content=\"AllenDowney\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AllenDowney\" \/>\n<meta name=\"twitter:site\" content=\"@AllenDowney\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"AllenDowney\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\"},\"author\":{\"name\":\"AllenDowney\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/4e5bfb2e9af6c3446cb0031a7bf83207\"},\"headline\":\"Berkson Goes to College\",\"datePublished\":\"2021-04-07T18:33:01+00:00\",\"dateModified\":\"2023-02-25T03:32:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\"},\"wordCount\":1177,\"publisher\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\",\"url\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\",\"name\":\"Berkson Goes to College - Probably Overthinking It\",\"isPartOf\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png\",\"datePublished\":\"2021-04-07T18:33:01+00:00\",\"dateModified\":\"2023-02-25T03:32:25+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage\",\"url\":\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png\",\"contentUrl\":\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png\",\"width\":900,\"height\":600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.allendowney.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Berkson Goes to College\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/#website\",\"url\":\"https:\/\/www.allendowney.com\/blog\/\",\"name\":\"Probably Overthinking It\",\"description\":\"Data science, Bayesian Statistics, and other ideas\",\"publisher\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.allendowney.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/#organization\",\"name\":\"Probably Overthinking It\",\"url\":\"https:\/\/www.allendowney.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2025\/03\/probably_logo.png\",\"contentUrl\":\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2025\/03\/probably_logo.png\",\"width\":714,\"height\":784,\"caption\":\"Probably Overthinking It\"},\"image\":{\"@id\":\"https:\/\/www.allendowney.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/AllenDowney\",\"https:\/\/www.linkedin.com\/in\/allendowney\/\",\"https:\/\/bsky.app\/profile\/allendowney.bsky.social\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/4e5bfb2e9af6c3446cb0031a7bf83207\",\"name\":\"AllenDowney\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g\",\"caption\":\"AllenDowney\"},\"url\":\"https:\/\/www.allendowney.com\/blog\/author\/allendowney_6dbrc4\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Berkson Goes to College - Probably Overthinking It","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/","og_locale":"en_US","og_type":"article","og_title":"Berkson Goes to College - Probably Overthinking It","og_description":"This article is like a pre-excerpt from my forthcoming book, Probably Overthinking It: a revised version of this article make up part of the chapter about Berkson&#8217;s paradox. If you would like to get an occasional update about the book, please join my mailing list. Suppose one day you visit Representative College, where the student body is a representative sample of the college population. You meet a randomly chosen student and you learn (because it comes up in conversation) that... Read More Read More","og_url":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/","og_site_name":"Probably Overthinking It","article_published_time":"2021-04-07T18:33:01+00:00","article_modified_time":"2023-02-25T03:32:25+00:00","og_image":[{"url":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png","type":"","width":"","height":""}],"author":"AllenDowney","twitter_card":"summary_large_image","twitter_creator":"@AllenDowney","twitter_site":"@AllenDowney","twitter_misc":{"Written by":"AllenDowney","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#article","isPartOf":{"@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/"},"author":{"name":"AllenDowney","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/4e5bfb2e9af6c3446cb0031a7bf83207"},"headline":"Berkson Goes to College","datePublished":"2021-04-07T18:33:01+00:00","dateModified":"2023-02-25T03:32:25+00:00","mainEntityOfPage":{"@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/"},"wordCount":1177,"publisher":{"@id":"https:\/\/www.allendowney.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage"},"thumbnailUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/","url":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/","name":"Berkson Goes to College - Probably Overthinking It","isPartOf":{"@id":"https:\/\/www.allendowney.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage"},"image":{"@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage"},"thumbnailUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png","datePublished":"2021-04-07T18:33:01+00:00","dateModified":"2023-02-25T03:32:25+00:00","breadcrumb":{"@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#primaryimage","url":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png","contentUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/04\/berkson1.png","width":900,"height":600},{"@type":"BreadcrumbList","@id":"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.allendowney.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Berkson Goes to College"}]},{"@type":"WebSite","@id":"https:\/\/www.allendowney.com\/blog\/#website","url":"https:\/\/www.allendowney.com\/blog\/","name":"Probably Overthinking It","description":"Data science, Bayesian Statistics, and other ideas","publisher":{"@id":"https:\/\/www.allendowney.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.allendowney.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.allendowney.com\/blog\/#organization","name":"Probably Overthinking It","url":"https:\/\/www.allendowney.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2025\/03\/probably_logo.png","contentUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2025\/03\/probably_logo.png","width":714,"height":784,"caption":"Probably Overthinking It"},"image":{"@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/AllenDowney","https:\/\/www.linkedin.com\/in\/allendowney\/","https:\/\/bsky.app\/profile\/allendowney.bsky.social"]},{"@type":"Person","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/4e5bfb2e9af6c3446cb0031a7bf83207","name":"AllenDowney","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g","caption":"AllenDowney"},"url":"https:\/\/www.allendowney.com\/blog\/author\/allendowney_6dbrc4\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":434,"url":"https:\/\/www.allendowney.com\/blog\/2020\/02\/20\/correlation-determination-and-prediction-error\/","url_meta":{"origin":536,"position":0},"title":"Correlation, determination, and prediction error","author":"AllenDowney","date":"February 20, 2020","format":false,"excerpt":"This tweet appeared in my feed recently: I wrote about this topic in Elements of Data Science\u00a0Notebook 9, where I suggest that using Pearson's coefficient of correlation, usually denoted r, to summarize the relationship between two variables is problematic because: Correlation only quantifies the linear relationship between variables; if the\u2026","rel":"","context":"In \"correlation\"","block_context":{"text":"correlation","link":"https:\/\/www.allendowney.com\/blog\/tag\/correlation\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/02\/Screenshot-at-2020-02-20-12-51-56.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/02\/Screenshot-at-2020-02-20-12-51-56.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/02\/Screenshot-at-2020-02-20-12-51-56.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/02\/Screenshot-at-2020-02-20-12-51-56.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":668,"url":"https:\/\/www.allendowney.com\/blog\/2021\/08\/25\/factors-of-underrepresentation\/","url_meta":{"origin":536,"position":1},"title":"Factors of Underrepresentation","author":"AllenDowney","date":"August 25, 2021","format":false,"excerpt":"I recently encountered a 2009 paper by Ceci, Williams, and Barnett, \u201cWomen\u2019s underrepresentation in science: sociocultural and biological considerations\u201d, which lists in the abstract these \u201cfactors unique to underrepresentation [of women] in math-intensive fields\u201d: (a) Math-proficient women disproportionately prefer careers in non\u2013math-intensive fields and are more likely to leave math-intensive\u2026","rel":"","context":"In \"NLSY\"","block_context":{"text":"NLSY","link":"https:\/\/www.allendowney.com\/blog\/tag\/nlsy\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":521,"url":"https:\/\/www.allendowney.com\/blog\/2021\/01\/18\/college-freshmen-are-more-godless-than-ever\/","url_meta":{"origin":536,"position":2},"title":"College Freshmen are More Godless Than Ever","author":"AllenDowney","date":"January 18, 2021","format":false,"excerpt":"In the last 30 years, college students have become much less religious. The fraction who say they have no religious affiliation has more than tripled, from about 10% to 34%. And the fraction who say they have attended a religious service in the last year fell from more than 85%\u2026","rel":"","context":"In \"atheism\"","block_context":{"text":"atheism","link":"https:\/\/www.allendowney.com\/blog\/tag\/atheism\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/01\/heri.2.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":418,"url":"https:\/\/www.allendowney.com\/blog\/2020\/01\/24\/among-u-s-college-students-religious-attendance-is-at-an-all-time-low\/","url_meta":{"origin":536,"position":3},"title":"Among U.S. college students, religious attendance is at an all-time low","author":"AllenDowney","date":"January 24, 2020","format":false,"excerpt":"[UPDATE: The most recent version of this article is here.] In the last 30 years, college students have become much less religious. The fraction who say they have no religious affiliation tripled, from about 10% to 30%. And the fraction who say they have attended a religious service in the\u2026","rel":"","context":"In \"college\"","block_context":{"text":"college","link":"https:\/\/www.allendowney.com\/blog\/tag\/college\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/01\/heri18.3-1.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/01\/heri18.3-1.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/01\/heri18.3-1.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/01\/heri18.3-1.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/01\/heri18.3-1.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2020\/01\/heri18.3-1.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":1320,"url":"https:\/\/www.allendowney.com\/blog\/2024\/06\/29\/have-the-nones-leveled-off\/","url_meta":{"origin":536,"position":4},"title":"Have the Nones Leveled Off?","author":"AllenDowney","date":"June 29, 2024","format":false,"excerpt":"Last month Ryan Burge published \"The Nones Have Hit a Ceiling\", using data from the 2023 Cooperative Election Study to show that the increase in the number of Americans with no religious affiliation has hit a plateau. Comparing the number of Atheists, Agnostics, and \"Nothing in Particular\" between 2020 and\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/06\/heri.5.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/06\/heri.5.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/06\/heri.5.png?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":590,"url":"https:\/\/www.allendowney.com\/blog\/2021\/05\/01\/simpsons-paradox-and-education\/","url_meta":{"origin":536,"position":5},"title":"Simpson&#8217;s Paradox and Education","author":"AllenDowney","date":"May 1, 2021","format":false,"excerpt":"Is Simpson's paradox a mathematical curiosity or something that matters in practice? To answer this question, I'm searching the General Social Survey (GSS) for examples. Last week I published the first batch, examples where we group people by decade of birth and plot their opinions over time. In this article\u2026","rel":"","context":"In \"general social survey\"","block_context":{"text":"general social survey","link":"https:\/\/www.allendowney.com\/blog\/tag\/general-social-survey\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/05\/libath_vs_year_by_degree.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/05\/libath_vs_year_by_degree.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.allendowney.com\/blog\/wp-content\/uploads\/2021\/05\/libath_vs_year_by_degree.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts\/536","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/comments?post=536"}],"version-history":[{"count":10,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts\/536\/revisions"}],"predecessor-version":[{"id":881,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts\/536\/revisions\/881"}],"wp:attachment":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/media?parent=536"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/categories?post=536"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/tags?post=536"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}