{"id":2377,"date":"2026-01-12T15:02:21","date_gmt":"2026-01-12T22:02:21","guid":{"rendered":"https:\/\/miriamposner.com\/blog\/?p=2377"},"modified":"2026-01-12T16:42:42","modified_gmt":"2026-01-12T23:42:42","slug":"introducing-beginners-to-the-mechanics-of-machine-learning","status":"publish","type":"post","link":"https:\/\/miriamposner.com\/blog\/introducing-beginners-to-the-mechanics-of-machine-learning\/","title":{"rendered":"Introducing beginners to the mechanics of machine learning"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2026\/01\/image.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"597\" src=\"https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2026\/01\/image-1024x597.png\" alt=\"In a frame from an animated movie, a robot hunches against a forest landscape as deer graze. Small bubbles surround the robot, containing indecipherable text.\" class=\"wp-image-2378\" srcset=\"https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2026\/01\/image-1024x597.png 1024w, https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2026\/01\/image-300x175.png 300w, https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2026\/01\/image-768x448.png 768w, https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2026\/01\/image.png 1090w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><figcaption class=\"wp-element-caption\">Roz learns to speak animal language. Screengrab from <em><a href=\"https:\/\/www.youtube.com\/watch?v=EJHR3fDhHJ8&amp;t=169s\">The Wild Robot<\/a>.<\/em><\/figcaption><\/figure>\n\n\n\n<p>Every year, I spend some time introducing students to the mechanics of machine learning with neural nets. I definitely don&#8217;t go into great depth; I usually only have one class for this. But I try to unpack at least some of the major concepts, so that ML isn&#8217;t quite such a black box.<\/p>\n\n\n\n<p>Whether you&#8217;re an AI critic or enthusiast, I find that conversations can be much more specific and productive if the participants have a basic understanding of how the tools work. That way, if students hear some kind of outlandish claim\u2014like, that ChatGPT loves them\u2014they can compare the claim to a mental image of how the tool actually works.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>For some time, I&#8217;ve been gathering tools and activities to help me do this. (Things come and go so fast on the web that I have to do it every year!) It&#8217;s always a challenge to find high-quality tools, especially since they&#8217;re buried in layers and layers of slop. So I thought people might find it useful to see the tools gathered in one place.<\/p>\n\n\n\n<p>These are activities and illustrations, not really readings. To read in preparation for class, I like to assign <a href=\"https:\/\/writings.stephenwolfram.com\/2023\/02\/what-is-chatgpt-doing-and-why-does-it-work\/\">Stephen Wolfram&#8217;s &#8220;What is ChatGPT Doing&#8230;And Why Does it Work?&#8221;<\/a> (Remember, I&#8217;m just laying out the mechanics with this class, not making any particular argument about AI!)<\/p>\n\n\n\n<p>You can see how I put the tools together in a lecture <a href=\"https:\/\/docs.google.com\/presentation\/d\/1A7p4tQA6z4eovUfksWH1mvAGcyXSFFZcwAWZsfvukJw\/edit?usp=sharing\">here<\/a>. (It&#8217;s designed for use with Pear Deck, but you can easily convert it to a regular Google Slides lecture.)<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=uMN3hVe2rm8&amp;t=181s\">A 1986 AT&amp;T Bell Labs video on expert systems<\/a> because I think it&#8217;s useful for students to compare ML with other AI approaches. (In this list, videos are linked to the timestamp indicating when I begin the video in lecture)<\/li>\n\n\n\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=EJHR3fDhHJ8&amp;t=140s\">A moment in <em>The Wild Robot<\/em><\/a> when Roz uses ML to learn to speak to animals<\/li>\n\n\n\n<li><a href=\"http:\/\/youtube.com\/watch?time_continue=1&amp;v=f_uwKZIAeM0&amp;embeds_referring_euri=https%3A%2F%2Fdocs.google.com%2F&amp;embeds_referring_origin=https%3A%2F%2Fdocs.google.com&amp;source_ve_path=Mjg2NjY\">A simple but helpful video<\/a> on ML from Oxford<\/li>\n\n\n\n<li><a href=\"https:\/\/www.reddit.com\/r\/ChatGPT\/comments\/13l2pii\/animation_of_how_llms_generate_text\/\">A very simple animation <\/a>of how LLMs predict the next word in a sequence (sorry, I know there&#8217;s a way to get the video out of Reddit, but I can&#8217;t figure it out)<\/li>\n\n\n\n<li><a href=\"https:\/\/www.washingtonpost.com\/technology\/interactive\/2023\/ai-chatbot-learning\/?pwapi_token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJyZWFzb24iOiJnaWZ0IiwibmJmIjoxNzQwNjMyNDAwLCJpc3MiOiJzdWJzY3JpcHRpb25zIiwiZXhwIjoxNzQyMDExMTk5LCJpYXQiOjE3NDA2MzI0MDAsImp0aSI6ImQ2NWVmOTFiLTQ4N2MtNDA2NC04NTRiLWVmMzNmOGM2MDg0ZiIsInVybCI6Imh0dHBzOi8vd3d3Lndhc2hpbmd0b25wb3N0LmNvbS90ZWNobm9sb2d5L2ludGVyYWN0aXZlLzIwMjMvYWktY2hhdGJvdC1sZWFybmluZy8ifQ.PvbN1LF1AxmGZ-4fwXgY8hNylYHUKWIuJBNGepgeZjo&amp;itid=gfta\">An interactive <em>Washington Post<\/em> article<\/a> that helps students understand the composition of one LLM corpus<\/li>\n\n\n\n<li><a href=\"https:\/\/wimbd.apps.allenai.org\/\">What&#8217;s In My Big Data?<\/a>, a more detailed analysis and comparison of several corpora<\/li>\n\n\n\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=aircAruvnKk&amp;t=100s\">&#8220;But What Is a Neural Network,&#8221; f<\/a>rom the great 3Blue1Brown&#8211;I start at the linked timestamp and go for a few minutes, until he threatens to get into the math<\/li>\n\n\n\n<li><a href=\"https:\/\/mycomputerbrain.net\/php\/courses\/ai-gen-overview.php\">A series of animations<\/a> (see this <a href=\"https:\/\/mycomputerbrain.net\/php\/courses\/ai-overview.php\">series, too<\/a>) exploring different parts of LLMs. In class, I use <a href=\"https:\/\/mycomputerbrain.net\/php\/courses\/ai-gen\/artificial-neuron.php\">5 (&#8220;Generative AI: Artificial Neuron&#8221;)<\/a>, <a href=\"https:\/\/mycomputerbrain.net\/php\/courses\/ai-gen\/neuron-sequence.php\">10 (&#8220;Generative AI: Neuron Sequence&#8221;)<\/a>, and <a href=\"https:\/\/mycomputerbrain.net\/php\/experiments\/ai.experiment26a.php\">24 (&#8220;Identifying Animals with AI&#8221;)<\/a>. The last one is a particular favorite. You do have to create an account to access some of these animations, and students won&#8217;t be able to access them easily, so they&#8217;re more of a demo than a really interactive activity.<\/li>\n\n\n\n<li><a href=\"https:\/\/teachablemachine.withgoogle.com\/train\/image\">Google&#8217;s Teachable Machine<\/a>, which allows you to train your own model. We train it in class to distinguish between students&#8217; pens and water bottles. Sounds unwieldy, but it only takes about 10 minutes!<\/li>\n\n\n\n<li>My favorite <a href=\"https:\/\/medium.com\/data-science-365\/overview-of-a-neural-networks-learning-process-61690a502fa\">simple, clear illustration<\/a> of back-propagation. (You can refer them to <a href=\"https:\/\/www.3blue1brown.com\/lessons\/backpropagation\">this video<\/a> if they want more detail.)<\/li>\n\n\n\n<li><a href=\"https:\/\/distill.pub\/2019\/activation-atlas\/index.html\">&#8220;Exploring Neural Networks with Activation Atlases,&#8221;<\/a> which attempts to help people understand what happens in networks&#8217; hidden layers (still really confusing, TBH)<\/li>\n\n\n\n<li><a href=\"https:\/\/gradientflow.com\/wp-content\/uploads\/2023\/03\/newsletter71-customizing-LLM.png\">Quick illustration<\/a> of some methods of fine-tuning LLMs<\/li>\n\n\n\n<li><a href=\"https:\/\/blog.gopenai.com\/retrieval-augmented-generation-rag-585aa903d6bd\">Quick illustration<\/a> of RAG<\/li>\n\n\n\n<li><a href=\"https:\/\/bbycroft.net\/llm\">(Pretty advanced and detailed) LLM visualization<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/playground.tensorflow.org\/#activation=tanh&amp;batchSize=10&amp;dataset=circle&amp;regDataset=reg-plane&amp;learningRate=0.03&amp;regularizationRate=0&amp;noise=0&amp;networkShape=4,2&amp;seed=0.48844&amp;showTestData=false&amp;discretize=false&amp;percTrainData=50&amp;x=true&amp;y=true&amp;xTimesY=false&amp;xSquared=false&amp;ySquared=false&amp;cosX=false&amp;sinX=false&amp;cosY=false&amp;sinY=false&amp;collectStats=false&amp;problem=classification&amp;initZero=false&amp;hideText=false\">Neural Network Playground<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/docs.google.com\/document\/d\/15N4cCkl6gwrcQUAOJlJCQ-vy3tspuXHZHz2n1com0rc\/edit?usp=sharing\">Some great hands-on activity ideas<\/a> (it says \u201cmiddle school,&#8221; but I think they\u2019re still useful!)<\/li>\n\n\n\n<li><a href=\"https:\/\/aipedagogy.org\/\">metaLAB\u2019s AI Pedagogy Project<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.criticalracedigitalstudies.com\/peoplesguide\">A People\u2019s Guide to Finding Algorithmic Bias<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.digitaltechnologieshub.edu.au\/teach-and-assess\/classroom-resources\/lesson-ideas\/\">Some great hands-on lesson ideas<\/a> (I like \u201c<a href=\"https:\/\/classic.csunplugged.org\/activities\/community-activities\/artificial-intelligence\/#:~:text=A%20classroom%20activity%20called%20The%20Brain%2Din%2Da%2DBag\">Brain-in-a-Bag<\/a>\u201d)<\/li>\n\n\n\n<li><a href=\"https:\/\/colab.research.google.com\/drive\/15wS338BwTx8ibizVv0JFSeJ7l7pESUUJ?usp=sharing\">A Colab notebook by Ulysses Pascal<\/a> (a former TA) that allows students to tweak GPT<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Every year, I spend some time introducing students to the mechanics of machine learning with neural nets. I definitely don&#8217;t go into great depth; I usually only have one class for this. But I try to unpack at least some of the major concepts, so that ML isn&#8217;t quite such a black box. Whether you&#8217;re [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2377","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts\/2377","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/comments?post=2377"}],"version-history":[{"count":3,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts\/2377\/revisions"}],"predecessor-version":[{"id":2382,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts\/2377\/revisions\/2382"}],"wp:attachment":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/media?parent=2377"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/categories?post=2377"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/tags?post=2377"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}