{"id":220,"date":"2019-05-16T15:09:27","date_gmt":"2019-05-16T15:09:27","guid":{"rendered":"https:\/\/www.allendowney.com\/blog\/?p=220"},"modified":"2019-05-16T15:09:35","modified_gmt":"2019-05-16T15:09:35","slug":"foundations-of-data-science","status":"publish","type":"post","link":"https:\/\/www.allendowney.com\/blog\/2019\/05\/16\/foundations-of-data-science\/","title":{"rendered":"Foundations of data science?"},"content":{"rendered":"\n

“Foundation” is one of several words I would like to ban from all discussion of higher education. \u00a0Others include “liberal arts”, “rigor”, and “service class”, but I’ll write about them another time. \u00a0Right now, “foundation” is on my mind because of a new book from Microsoft Research, Foundations of Data Science<\/a><\/em>, by Avrim Blum, John Hopcroft, and Ravindran Kannan.
<\/p>\n\n\n\n

The goal of their book is to “cover the theory we expect to be useful in the next 40 years, just as an understanding of automata theory, algorithms, and related topics gave students an advantage in the last 40 years.”
<\/p>\n\n\n\n

As an aside, I am puzzled by their use of “advantage” here: who did those hypothetical students have an advantage over? \u00a0I don’t think competitive advantage is the primary goal of learning. If a theory is useful, it helps you solve problems and make the world a better place, not just crush your enemies<\/a>.
<\/p>\n\n\n\n

I am also puzzled by their use of “foundation”, because it can mean two contradictory things:
<\/p>\n\n\n\n

  1. The most useful ideas in a field; the things you should learn first. <\/li>
  2. The most theoretical ideas in a field; the things you should use to write mathematical proofs.<\/li><\/ol>\n\n\n\n

    Both kinds of foundation are valuable.  If you identify the right things to learn first, you can give students powerful tools quickly, they can work on real problems and have impact, and they are more likely to be excited about learning more.  And if you find the right abstractions, you can build intuition, develop insight, make connections, and create new tools and ideas.
    <\/p>\n\n\n\n

    The problems come when we confuse these meanings, assume that the most abstract ideas are the most useful, and require students to learn them first. \u00a0In higher education, confusion about “foundations” is the root of a lot of bad curriculum design.
    <\/p>\n\n\n\n

    For example, in the traditional undergraduate engineering curriculum, students take 1-2 years of math and science classes before they learn anything about engineering. \u00a0These prerequisites are called the “Math and Science Death March<\/a>” because so many students don’t get through them; in the U.S., about 40% of students who start an engineering program don’t finish it<\/a>, largely because of the incorrect assumption that they need two years of theory before they can start engineering.
    <\/p>\n\n\n\n

    The introduction to Foundations of Data Science<\/em> hints at the first meaning of “foundation”.  The authors note that “increasingly researchers of the future will be involved with using computers to understand and extract usable information from massive data arising in applications,” which suggests that this book will help them do those things.
    <\/p>\n\n\n\n

    But the rest of the introduction makes it clear that the second meaning is what they have in mind.  
    <\/p>\n\n\n\n