AI Learning Resources
In this edition, we’ll share efficient resources for catching up on the past decade of fundamental machine learning concepts and progress.
These public materials come from the top-notch resources found in Blue Dot Impact's “AI Governance Course” curriculum, a program I’m delighted to be facilitating this year.
The resources include:
What is a Neural Network? – Video by 3Blue1Brown (2017)
The core of modern AI systems, a neural network, is loosely inspired by the human brain. This video provides a visual introduction to what these programs are, helping you understand the terminology referred to in most AI discussions without needing a deep technical understanding.
Gradient Descent: How Neural Networks Learn – Video by 3Blue1Brown (2017)
Engineers don't directly specify how neural networks process inputs but train them with examples. This video visually explains this concept without requiring a deep technical understanding.
How ChatGPT Works Technically – Video by ByteByteGo (2023)
Gain a high-level insight into how ChatGPT was trained and operated, bridging the gap between “neural network” basics and cutting-edge large language models (LLMs). Current language models in mid-2023 pose certain limited security risks, of which we must be aware. But more capable AI systems that offer both greater risks and opportunities are likely to develop from the current systems.
Visualizing the Deep Learning Revolution – Article by Richard Ngo (2023)
This article surveys rapid advances in AI over the last decade and provides insights into possible future developments, focusing on four domains: vision, games, language-based tasks, and science. The first two have more limited real-world applications but provide particularly graphic and intuitive examples of the pace of progress.