{"id":1357,"date":"2024-08-23T14:36:33","date_gmt":"2024-08-23T14:36:33","guid":{"rendered":"https:\/\/www.allendowney.com\/blog\/?p=1357"},"modified":"2024-11-02T00:57:00","modified_gmt":"2024-11-02T00:57:00","slug":"probably-the-book","status":"publish","type":"post","link":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/","title":{"rendered":"Probably the Book"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Last week I had the pleasure of presenting a keynote at posit::conf(2024). When the video is available, I will post it here [UPDATE here it is].<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"> <\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/YKMZIzYBgTk?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">In the meantime, <a href=\"https:\/\/docs.google.com\/presentation\/d\/e\/2PACX-1vSdoq58S1DbhSKikfu3m52B4oMB5DFgyvxr0qy4Rhilojq6G2oRqTLmWMKuKtEBQVoDEr-XXv0--10H\/pub#slide=id.p\">you can read the slides<\/a>, if you don&#8217;t mind spoilers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For people at the conference who don&#8217;t know me, this might be a good time to introduce you to this blog, where I write about data science and Bayesian statistics, and to <em><a href=\"https:\/\/probablyoverthinking.it\" data-type=\"link\" data-id=\"https:\/\/probablyoverthinking.it\">Probably Overthinking It<\/a><\/em>, the book based on the blog, which was published by University of Chicago Press last December. Here&#8217;s an outline of the book with links to excerpts I&#8217;ve published in the blog and talks I&#8217;ve presented based on some of the chapters.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For your very own copy, you can order from <a href=\"https:\/\/bookshop.org\/a\/98697\/9780226822587\">Bookshop.org<\/a> if you want to support independent bookstores, or <a href=\"https:\/\/amzn.to\/3Kp629E\">Amazon<\/a> if you don&#8217;t.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Twelve Excellent Chapters<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">In Chapter 1, we learn that no one is normal, everyone is weird, and everyone is about the same amount of weird. I published an <a href=\"https:\/\/www.allendowney.com\/blog\/2022\/05\/02\/how-gaussian-is-it\/\">excerpt from this chapter<\/a>, and talked about it during <a href=\"https:\/\/youtu.be\/XahCbxan434?t=2072\">this section of the SuperDataScience podcast<\/a>. And it is featured in <a href=\"https:\/\/brilliant.org\/courses\/exploration-hub\/articles\/are-you-normal\/1\/\">an interactive article at Brilliant.org<\/a>, which includes this animation showing how measurements are distributed in multiple dimensions.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"776\" height=\"828\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif\" alt=\"\" class=\"wp-image-1358\" style=\"width:335px;height:auto\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 2 is about the inspection paradox, which affects our perception of many real-world scenarios, including fun examples like class sizes and relay races, and more serious examples like our understanding of criminal justice and <a href=\"https:\/\/www.allendowney.com\/blog\/2021\/08\/19\/covid-19-and-the-inspection-paradox\/\">ability to track infectious disease<\/a>. I published a prototype of this chapter as an article called &#8220;<a href=\"https:\/\/towardsdatascience.com\/the-inspection-paradox-is-everywhere-2ef1c2e9d709\">The Inspection Paradox is Everywhere<\/a>&#8220;, and gave a talk about it at PyData NYC:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/cXWTHfvycyM?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;start=16&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 3 presents three consequences of the inspection paradox in demography, especially changes in fertility in the United States over the last 50 years. It explains Preston&#8217;s paradox, named after the demographer who discovered it: if each woman has the same number of children as her mother, family sizes &#8212; and population &#8212; grow quickly; in order to maintain constant family sizes, women must have fewer children than their mothers, on average. I published an <a href=\"https:\/\/www.allendowney.com\/blog\/2022\/05\/16\/prestons-paradox\/\">excerpt from this chapter<\/a>, and it was <a href=\"https:\/\/news.ycombinator.com\/item?id=31401006\">discussed on Hacker News<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 4 is about extremes, outliers, and GOATs (greatest of all time), and two reasons the distribution of many abilities tends toward a lognormal distribution: proportional gain and weakest link effects. I gave a talk about this chapter for PyData Global 2023:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/MhA5XWIWWys?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">And here&#8217;s <a href=\"https:\/\/www.allendowney.com\/blog\/2023\/11\/21\/life-in-a-lognormal-world\/\">a related exploration I cut from the book<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 5 is about the surprising conditions where something used is better than something new. Most things wear out over time, but sometimes longevity implies information, which implies even greater longevity. This property has implications for life expectancy and the possibility of much longer life spans. I gave a talk about this chapter at ODSC East 2024 &#8212; there&#8217;s no recording, but <a href=\"https:\/\/docs.google.com\/presentation\/d\/1FE-cYZKAfQCedOVaVSk_xK4Sre1F0wzr1MLLNsekgqI\/pub\">the slides are here<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 6 introduces Berkson&#8217;s paradox &#8212; a form of collision bias &#8212; with some simple examples like <a href=\"https:\/\/www.allendowney.com\/blog\/2021\/04\/07\/berkson-goes-to-college\/\">the correlation of test scores<\/a> and some more important examples like COVID and depression. Chapter 7 uses collision bias to explain the low birthweight paradox and other confusing results from epidemiology. I gave a &#8220;Talk at Google&#8221; about these chapters:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/8rUm46mk0Yo?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 8 shows that the magnitudes of natural and human-caused disasters follow long-tailed distributions that violate our intuition, defy prediction, and leave us unprepared. Examples include earthquakes, solar flares, asteroid impacts, and stock market crashes. I gave a talk about this chapter at SciPy 2023:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/-rE3DfeZ_jE?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The talk includes this animation showing how plotting a tail distribution on a log-y scale provides a clearer picture of the extreme tail behavior.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"339\" height=\"364\" src=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/longtail_stretch.gif\" alt=\"\" class=\"wp-image-1364\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 9 is about the base rate fallacy, which is the cause of many statistical errors, including misinterpretations of medical tests, field sobriety tests, and COVID statistics. It includes a discussion of the COMPAS system for predicting criminal behavior.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 10 is about Simpson&#8217;s paradox, with examples from ecology, sociology, and economics. It is the key to understanding one of the most notorious examples of misinterpretation of COVID data. This is the first of three chapters that use data from the General Social Survey (GSS).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 11 is about the expansion of the Moral Circle &#8212; specifically about changes in attitudes about race, gender, and homosexuality in the U.S. over the last 50 years. I published an excerpt about <a href=\"https:\/\/www.allendowney.com\/blog\/2023\/07\/02\/the-remarkable-decline-of-homophobia\/\">the remarkable decline of homophobia since 1990<\/a>, featuring lyrics from &#8220;<a href=\"https:\/\/www.youtube.com\/watch?v=ArOQF4kadHA\">A Message From the Gay Community<\/a>&#8220;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Chapter 12 is about the Overton Paradox, a name I&#8217;ve given to a pattern observed in GSS data: as people get older, their beliefs become more liberal, on average, but they are more likely to <em>say<\/em> they are conservative. This chapter is the basis of <a href=\"https:\/\/brilliant.org\/courses\/exploration-hub\/articles\/the-overton-paradox\/1\/\">this interactive lesson at Brilliant.org<\/a>. And I gave a talk about it at PyData NYC 2022:<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/VpuWECpTxmM?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">There are still a few chapters I haven&#8217;t given a talk about, so watch this space!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Again, you can order the book from <a href=\"https:\/\/bookshop.org\/a\/98697\/9780226822587\">Bookshop.org<\/a> if you want to support independent bookstores, or <a href=\"https:\/\/amzn.to\/3Kp629E\">Amazon<\/a> if you don&#8217;t.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Supporting code for the book is in <a href=\"https:\/\/allendowney.github.io\/ProbablyOverthinkingIt\/intro.html\">this GitHub repository<\/a>. All of the chapters are available as Jupyter notebooks that run in Colab, so you can replicate my analysis. If you are teaching a data science or statistic class, they make good teaching examples.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 1: Are You Normal? Hint: No.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/gaussian.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_brfss.ipynb\">Run the code that prepares the BRFSS data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_big_five.ipynb\">Run the code that prepares the Big Five data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 2: Relay Races and Revolving Doors<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/inspection.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 3: Defy Tradition, Save the World<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/preston.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 4: Extremes, Outliers, and GOATs<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/lognormal.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_brfss.ipynb\">Run the code that prepares the BRFSS data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/nsfg_clean.ipynb\">Run the code that prepares the NSFG data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 5: Bettter Than New<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/nbue.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 6: Jumping to Conclusions<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/berkson.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 7: Causation, Collision, and Confusion<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/birthweight.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_nchs.ipynb\">Run the code that prepares the NCHS data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 8: The Long Tail of Disaster<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/longtail.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_quake.ipynb\">Run the code that prepares the earthquake data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_flare.ipynb\">Run the code that prepares the solar flare data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 9: Fairness and Fallacy<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/base_rate.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 10: Penguins, Pessimists, and Paradoxes<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/simpson.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/clean_simpson.ipynb\">Run the code that prepares the GSS data<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 11: Changing Hearts and Minds<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/progress.ipynb\">Run the code on Colab<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Chapter 12: Chasing the Overton Window<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/colab.research.google.com\/github\/AllenDowney\/ProbablyOverthinkingIt\/blob\/book\/notebooks\/overton.ipynb\">Run the code on Colab<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Last week I had the pleasure of presenting a keynote at posit::conf(2024). When the video is available, I will post it here [UPDATE here it is]. In the meantime, you can read the slides, if you don&#8217;t mind spoilers. For people at the conference who don&#8217;t know me, this might be a good time to introduce you to this blog, where I write about data science and Bayesian statistics, and to Probably Overthinking It, the book based on the blog,&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[1],"tags":[],"class_list":["post-1357","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Probably the Book - Probably Overthinking It<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Probably the Book - Probably Overthinking It\" \/>\n<meta property=\"og:description\" content=\"Last week I had the pleasure of presenting a keynote at posit::conf(2024). When the video is available, I will post it here [UPDATE here it is]. In the meantime, you can read the slides, if you don&#8217;t mind spoilers. For people at the conference who don&#8217;t know me, this might be a good time to introduce you to this blog, where I write about data science and Bayesian statistics, and to Probably Overthinking It, the book based on the blog,... Read More Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/\" \/>\n<meta property=\"og:site_name\" content=\"Probably Overthinking It\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-23T14:36:33+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-02T00:57:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif\" \/>\n<meta name=\"author\" content=\"AllenDowney\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AllenDowney\" \/>\n<meta name=\"twitter:site\" content=\"@AllenDowney\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"AllenDowney\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/\"},\"author\":{\"name\":\"AllenDowney\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#\\\/schema\\\/person\\\/4e5bfb2e9af6c3446cb0031a7bf83207\"},\"headline\":\"Probably the Book\",\"datePublished\":\"2024-08-23T14:36:33+00:00\",\"dateModified\":\"2024-11-02T00:57:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/\"},\"wordCount\":1109,\"publisher\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/are_you_normal_windshield_wiper.gif\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/\",\"url\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/\",\"name\":\"Probably the Book - Probably Overthinking It\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/are_you_normal_windshield_wiper.gif\",\"datePublished\":\"2024-08-23T14:36:33+00:00\",\"dateModified\":\"2024-11-02T00:57:00+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/are_you_normal_windshield_wiper.gif\",\"contentUrl\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/08\\\/are_you_normal_windshield_wiper.gif\",\"width\":776,\"height\":828},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/2024\\\/08\\\/23\\\/probably-the-book\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Probably the Book\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/\",\"name\":\"Probably Overthinking It\",\"description\":\"Data science, Bayesian Statistics, and other ideas\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#organization\",\"name\":\"Probably Overthinking It\",\"url\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/probably_logo.png\",\"contentUrl\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/wp-content\\\/uploads\\\/2025\\\/03\\\/probably_logo.png\",\"width\":714,\"height\":784,\"caption\":\"Probably Overthinking It\"},\"image\":{\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/AllenDowney\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/allendowney\\\/\",\"https:\\\/\\\/bsky.app\\\/profile\\\/allendowney.bsky.social\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/#\\\/schema\\\/person\\\/4e5bfb2e9af6c3446cb0031a7bf83207\",\"name\":\"AllenDowney\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g\",\"caption\":\"AllenDowney\"},\"url\":\"https:\\\/\\\/www.allendowney.com\\\/blog\\\/author\\\/allendowney_6dbrc4\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Probably the Book - Probably Overthinking It","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/","og_locale":"en_US","og_type":"article","og_title":"Probably the Book - Probably Overthinking It","og_description":"Last week I had the pleasure of presenting a keynote at posit::conf(2024). When the video is available, I will post it here [UPDATE here it is]. In the meantime, you can read the slides, if you don&#8217;t mind spoilers. For people at the conference who don&#8217;t know me, this might be a good time to introduce you to this blog, where I write about data science and Bayesian statistics, and to Probably Overthinking It, the book based on the blog,... Read More Read More","og_url":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/","og_site_name":"Probably Overthinking It","article_published_time":"2024-08-23T14:36:33+00:00","article_modified_time":"2024-11-02T00:57:00+00:00","og_image":[{"url":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif","type":"","width":"","height":""}],"author":"AllenDowney","twitter_card":"summary_large_image","twitter_creator":"@AllenDowney","twitter_site":"@AllenDowney","twitter_misc":{"Written by":"AllenDowney","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#article","isPartOf":{"@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/"},"author":{"name":"AllenDowney","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/4e5bfb2e9af6c3446cb0031a7bf83207"},"headline":"Probably the Book","datePublished":"2024-08-23T14:36:33+00:00","dateModified":"2024-11-02T00:57:00+00:00","mainEntityOfPage":{"@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/"},"wordCount":1109,"publisher":{"@id":"https:\/\/www.allendowney.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#primaryimage"},"thumbnailUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/","url":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/","name":"Probably the Book - Probably Overthinking It","isPartOf":{"@id":"https:\/\/www.allendowney.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#primaryimage"},"image":{"@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#primaryimage"},"thumbnailUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif","datePublished":"2024-08-23T14:36:33+00:00","dateModified":"2024-11-02T00:57:00+00:00","breadcrumb":{"@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#primaryimage","url":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif","contentUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2024\/08\/are_you_normal_windshield_wiper.gif","width":776,"height":828},{"@type":"BreadcrumbList","@id":"https:\/\/www.allendowney.com\/blog\/2024\/08\/23\/probably-the-book\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.allendowney.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Probably the Book"}]},{"@type":"WebSite","@id":"https:\/\/www.allendowney.com\/blog\/#website","url":"https:\/\/www.allendowney.com\/blog\/","name":"Probably Overthinking It","description":"Data science, Bayesian Statistics, and other ideas","publisher":{"@id":"https:\/\/www.allendowney.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.allendowney.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.allendowney.com\/blog\/#organization","name":"Probably Overthinking It","url":"https:\/\/www.allendowney.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2025\/03\/probably_logo.png","contentUrl":"https:\/\/www.allendowney.com\/blog\/wp-content\/uploads\/2025\/03\/probably_logo.png","width":714,"height":784,"caption":"Probably Overthinking It"},"image":{"@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/AllenDowney","https:\/\/www.linkedin.com\/in\/allendowney\/","https:\/\/bsky.app\/profile\/allendowney.bsky.social"]},{"@type":"Person","@id":"https:\/\/www.allendowney.com\/blog\/#\/schema\/person\/4e5bfb2e9af6c3446cb0031a7bf83207","name":"AllenDowney","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/fb01b3a7f7190bea1bbf7f0852e686c2f8c03b099222df2ce4bc7926f15bcb43?s=96&d=mm&r=g","caption":"AllenDowney"},"url":"https:\/\/www.allendowney.com\/blog\/author\/allendowney_6dbrc4\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":883,"url":"https:\/\/www.allendowney.com\/blog\/2023\/03\/20\/the-bayesian-killer-app\/","url_meta":{"origin":1357,"position":0},"title":"The Bayesian Killer App","author":"AllenDowney","date":"March 20, 2023","format":false,"excerpt":"It's been a while since anyone said \"killer app\" without irony, so let me remind you that a killer app is software \"so necessary or desirable that it proves the core value of some larger technology,\" quoth Wikipedia. For example, most people didn't have much use for the internet until\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/fsdbneHgi58\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":941,"url":"https:\/\/www.allendowney.com\/blog\/2023\/05\/10\/causation-collision-and-confusion\/","url_meta":{"origin":1357,"position":1},"title":"Causation, Collision, and Confusion","author":"AllenDowney","date":"May 10, 2023","format":false,"excerpt":"Today I presented a talk about Berkson's paradox at ODSC East 2023. If you missed it, the slides are here. When the video is available, I'll post it here. Abstract: Collision bias is the most treacherous error in statistics: it can be subtle, it is easy to induce it by\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":368,"url":"https:\/\/www.allendowney.com\/blog\/2019\/12\/18\/please-stop-teaching-people-to-write-about-science-in-the-passive-voice\/","url_meta":{"origin":1357,"position":2},"title":"Please stop teaching people to write about science in the passive voice","author":"AllenDowney","date":"December 18, 2019","format":false,"excerpt":"You might think you have to, but you don't and you shouldn't. Why you might think you have to Science is objective and it doesn't matter who does the experiment, so we should write in the passive voice, which emphasizes the methods and materials, not the scientists.You are teaching at\u2026","rel":"","context":"In \"passive voice\"","block_context":{"text":"passive voice","link":"https:\/\/www.allendowney.com\/blog\/tag\/passive-voice\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":656,"url":"https:\/\/www.allendowney.com\/blog\/2021\/07\/23\/the-left-handed-sister-problem\/","url_meta":{"origin":1357,"position":3},"title":"The Left-Handed Sister Problem","author":"AllenDowney","date":"July 23, 2021","format":false,"excerpt":"Suppose you meet someone who looks like the brother of your friend Mary. You ask if he has a sister named Mary, and he says \"Yes I do, but I don't think I know you.\" You remember that Mary has a sister who is left-handed, but you don't remember her\u2026","rel":"","context":"In \"Bayes&#039;s Theorem\"","block_context":{"text":"Bayes&#039;s Theorem","link":"https:\/\/www.allendowney.com\/blog\/tag\/bayess-theorem\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":94,"url":"https:\/\/www.allendowney.com\/blog\/2018\/12\/03\/lions-and-tigers-and-bears\/","url_meta":{"origin":1357,"position":4},"title":"Lions and tigers and bears","author":"AllenDowney","date":"December 3, 2018","format":false,"excerpt":"Here's another Bayes puzzle: Suppose we visit a wild animal preserve where we know that the only animals are lions and tigers and bears, but we don't know how many of each there are. During the tour, we see 3 lions, 2 tigers,\u00a0and one bear. Assuming that every animal had\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mfsaweb.org\/wp-content\/uploads\/WizardOfOz.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":843,"url":"https:\/\/www.allendowney.com\/blog\/2023\/01\/20\/resampling-for-logistic-regression\/","url_meta":{"origin":1357,"position":5},"title":"Resampling for Logistic Regression","author":"AllenDowney","date":"January 20, 2023","format":false,"excerpt":"A recent question on Reddit asked about using resampling with logistic regression. The responses suggest two ways to do it, one parametric and one non-parametric. I implemented both of them and then invented a third, which is hybrid of the two. You can read the details of the implementation in\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts\/1357","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/comments?post=1357"}],"version-history":[{"count":9,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts\/1357\/revisions"}],"predecessor-version":[{"id":1407,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/posts\/1357\/revisions\/1407"}],"wp:attachment":[{"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/media?parent=1357"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/categories?post=1357"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.allendowney.com\/blog\/wp-json\/wp\/v2\/tags?post=1357"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}