Building Systems with the ChatGPT API vs Building Systems with the ChatGPT API

Across 11 short lessons (roughly 90 minutes total), the course covers a complete pipeline for multi-step LLM systems: how language models and tokenisation work, the chat format and system-user message separation, input classification for query routing, the OpenAI Moderation API, chain-of-thought prompting to handle multi-step questions, chaining several focused prompts where each consumes the previous output, output checking, and a two-part section on evaluating LLM responses at the system level. Reviewers consistently praise the logical progression and the theory-to-practice balance. The principal mark-down is age and depth: the course was built on GPT-3.5 Turbo in 2023 and has not been meaningfully updated, so it predates tool calling, structured JSON outputs, and reasoning models, and it stops short of real-world deployment concerns such as latency management, cost at scale, and production observability.

Isa Fulford, Member of Technical Staff at OpenAI, leads the code demonstrations while Andrew Ng frames the broader concepts and asks the questions a beginner would actually ask. Reviewers across blogs and Coursera call the pairing "highly knowledgeable and effective communicators." The teacher-demonstrator dynamic mirrors how a learner thinks through a new problem step by step, keeping each lesson of five to twenty minutes focused and coherent. Because Fulford comes directly from the team that built the ChatGPT API, the design decisions behind the Moderation API, the chat format, and tokenisation carry genuine authority rather than third-hand explanation.

The course is free on the DeepLearning.AI platform with every Jupyter notebook runnable directly in-browser — no OpenAI API key, no local Python environment, and no subscription required. The Coursera guided-project version is also free to audit. For roughly 90 minutes of hands-on instruction from two of the most credible names in the field, delivering reusable architecture patterns for multi-step LLM systems, the value proposition is essentially unmatched among paid or free alternatives. The only caveats are that a graded assignment and certificate on the Coursera version sit behind a paid enrolment, and the free tier leaves no portfolio artefact by default.

The patterns taught — classify the input, moderate for safety, reason in steps, chain focused prompts rather than one monolithic prompt, then evaluate the output — are exactly how production LLM features are structured in practice. Multiple reviewers note that the progression from basic API calls to a multi-stage orchestrated system reflects real engineering work. The gap is that the 2023 course predates the patterns now central to production LLM development (tool calling, structured outputs, retrieval-augmented generation), and at least one practitioner reviewer noted that the finished chatbot example would require substantial hardening before it approached something ready for deployment beyond a prototype.

Every lesson pairs a video with a runnable Jupyter notebook, and the course builds one coherent end-to-end example: a customer-service chatbot that classifies incoming queries, runs them through the Moderation API, applies chain-of-thought prompting to multi-step reasoning, chains successive focused prompts, retrieves product information, and evaluates whether its own output actually addresses the user's question. The Coursera version holds a 4.7/5 rating across 346 learners. The caveat is that there is no graded project or kept portfolio artefact on the free tier, and the supplied notebooks now require fixes (deprecated API syntax, missing helper files) to run locally outside the course sandbox.

The course is tightly structured across 11 short lessons: how LLMs and tokenization work, the chat format, input classification, the Moderation API, chain-of-thought reasoning, prompt chaining, output checking and system-level evaluation, all tied together by a running customer-service example. Reviewers repeatedly praise the clarity and the theory-to-practice balance. The honest mark-down is depth and age: it was built on GPT-3.5 Turbo in 2023, so it predates tool calling, structured JSON outputs and reasoning models, and it does not go deep on real-world deployment beyond the safety checks.

Isa Fulford (Member of Technical Staff at OpenAI) demonstrates while Andrew Ng frames the concepts, and reviewers consistently call the pairing knowledgeable and effective communicators. The teacher-demonstrator dynamic mirrors how a beginner actually thinks through each step, and the pacing of 5-20 minute lessons keeps momentum. This is the most authoritative free source for building multi-step LLM systems, and it shows.

Free on the DeepLearning.AI platform with runnable in-browser notebooks, and free to audit the Coursera version. For roughly 90 minutes of content that teaches a reusable architecture for chaining LLM calls, the value is hard to beat. The only caveats are that the platform's graded assignment and certificate sit behind a Pro upgrade, and that the aging notebook code can eat time if you insist on running it locally rather than in-browser.

The standout feature for most reviewers is the hands-on coding: you build prompt chains that consume prior completions, glue Python around model calls, and assemble a full customer-service chatbot that classifies queries, moderates input, reasons step by step and evaluates its own output. The caveat is that there is no graded, kept portfolio artefact on the free tier, and the supplied notebooks now require fixes (deprecated API syntax, missing Utils.py and products.json) to run outside the course sandbox.

The patterns taught — chaining, moderation, evaluation, routing — are exactly the building blocks of production LLM features, and developers report the course gave them a structured mental model they could apply immediately. But it is a one-hour primer with no certificate on the free tier and no capstone, so on its own it is a strong foundation rather than a credential. Its career value is as the second step in a sequence, not a destination.