Building Systems with the ChatGPT API vs Stanford CS229 Machine Learning

Across 11 short lessons (roughly 90 minutes total), the course covers a complete pipeline for multi-step LLM systems: how language models and tokenisation work, the chat format and system-user message separation, input classification for query routing, the OpenAI Moderation API, chain-of-thought prompting to handle multi-step questions, chaining several focused prompts where each consumes the previous output, output checking, and a two-part section on evaluating LLM responses at the system level. Reviewers consistently praise the logical progression and the theory-to-practice balance. The principal mark-down is age and depth: the course was built on GPT-3.5 Turbo in 2023 and has not been meaningfully updated, so it predates tool calling, structured JSON outputs, and reasoning models, and it stops short of real-world deployment concerns such as latency management, cost at scale, and production observability.

Isa Fulford, Member of Technical Staff at OpenAI, leads the code demonstrations while Andrew Ng frames the broader concepts and asks the questions a beginner would actually ask. Reviewers across blogs and Coursera call the pairing "highly knowledgeable and effective communicators." The teacher-demonstrator dynamic mirrors how a learner thinks through a new problem step by step, keeping each lesson of five to twenty minutes focused and coherent. Because Fulford comes directly from the team that built the ChatGPT API, the design decisions behind the Moderation API, the chat format, and tokenisation carry genuine authority rather than third-hand explanation.

The course is free on the DeepLearning.AI platform with every Jupyter notebook runnable directly in-browser — no OpenAI API key, no local Python environment, and no subscription required. The Coursera guided-project version is also free to audit. For roughly 90 minutes of hands-on instruction from two of the most credible names in the field, delivering reusable architecture patterns for multi-step LLM systems, the value proposition is essentially unmatched among paid or free alternatives. The only caveats are that a graded assignment and certificate on the Coursera version sit behind a paid enrolment, and the free tier leaves no portfolio artefact by default.

The patterns taught — classify the input, moderate for safety, reason in steps, chain focused prompts rather than one monolithic prompt, then evaluate the output — are exactly how production LLM features are structured in practice. Multiple reviewers note that the progression from basic API calls to a multi-stage orchestrated system reflects real engineering work. The gap is that the 2023 course predates the patterns now central to production LLM development (tool calling, structured outputs, retrieval-augmented generation), and at least one practitioner reviewer noted that the finished chatbot example would require substantial hardening before it approached something ready for deployment beyond a prototype.

Every lesson pairs a video with a runnable Jupyter notebook, and the course builds one coherent end-to-end example: a customer-service chatbot that classifies incoming queries, runs them through the Moderation API, applies chain-of-thought prompting to multi-step reasoning, chains successive focused prompts, retrieves product information, and evaluates whether its own output actually addresses the user's question. The Coursera version holds a 4.7/5 rating across 346 learners. The caveat is that there is no graded project or kept portfolio artefact on the free tier, and the supplied notebooks now require fixes (deprecated API syntax, missing helper files) to run locally outside the course sandbox.

Reviewers consistently praise the mathematical depth — full derivations of GLMs, SVMs, EM, factor analysis and learning theory. The honest caveat is that the curriculum predates the Transformer era and deep learning gets brief treatment.

Andrew Ng's blackboard teaching gets repeated praise — one HN reviewer specifically prefers it to the Coursera version because he uses the board. The lecture pacing is academic and unhurried, which some find rigorous and others find slow.

Completely free — full 2018 lecture series on YouTube, all lecture notes, problem sets and section materials at cs229.stanford.edu. No certificate, no grading, no paywall. Reviewers consistently call it the highest-value rigorous ML resource available.

Zero official support for the YouTube cohort — no forum, no grading, no TA office hours, no cs50.ai-style tutor. Self-learners rely on community GitHub repos for solutions. Honest weakness, not unique to CS229.

Theory transfers durably — gradient descent, GLMs, regularisation, EM and learning theory remain foundational. The honest gap is that CS229 was not designed as a practical-first course; deployment, modern frameworks and Transformers are out of scope.