Building Systems with the ChatGPT API vs Generative AI with Large Language Models

Across 11 short lessons (roughly 90 minutes total), the course covers a complete pipeline for multi-step LLM systems: how language models and tokenisation work, the chat format and system-user message separation, input classification for query routing, the OpenAI Moderation API, chain-of-thought prompting to handle multi-step questions, chaining several focused prompts where each consumes the previous output, output checking, and a two-part section on evaluating LLM responses at the system level. Reviewers consistently praise the logical progression and the theory-to-practice balance. The principal mark-down is age and depth: the course was built on GPT-3.5 Turbo in 2023 and has not been meaningfully updated, so it predates tool calling, structured JSON outputs, and reasoning models, and it stops short of real-world deployment concerns such as latency management, cost at scale, and production observability.

Isa Fulford, Member of Technical Staff at OpenAI, leads the code demonstrations while Andrew Ng frames the broader concepts and asks the questions a beginner would actually ask. Reviewers across blogs and Coursera call the pairing "highly knowledgeable and effective communicators." The teacher-demonstrator dynamic mirrors how a learner thinks through a new problem step by step, keeping each lesson of five to twenty minutes focused and coherent. Because Fulford comes directly from the team that built the ChatGPT API, the design decisions behind the Moderation API, the chat format, and tokenisation carry genuine authority rather than third-hand explanation.

The course is free on the DeepLearning.AI platform with every Jupyter notebook runnable directly in-browser — no OpenAI API key, no local Python environment, and no subscription required. The Coursera guided-project version is also free to audit. For roughly 90 minutes of hands-on instruction from two of the most credible names in the field, delivering reusable architecture patterns for multi-step LLM systems, the value proposition is essentially unmatched among paid or free alternatives. The only caveats are that a graded assignment and certificate on the Coursera version sit behind a paid enrolment, and the free tier leaves no portfolio artefact by default.

The patterns taught — classify the input, moderate for safety, reason in steps, chain focused prompts rather than one monolithic prompt, then evaluate the output — are exactly how production LLM features are structured in practice. Multiple reviewers note that the progression from basic API calls to a multi-stage orchestrated system reflects real engineering work. The gap is that the 2023 course predates the patterns now central to production LLM development (tool calling, structured outputs, retrieval-augmented generation), and at least one practitioner reviewer noted that the finished chatbot example would require substantial hardening before it approached something ready for deployment beyond a prototype.

Every lesson pairs a video with a runnable Jupyter notebook, and the course builds one coherent end-to-end example: a customer-service chatbot that classifies incoming queries, runs them through the Moderation API, applies chain-of-thought prompting to multi-step reasoning, chains successive focused prompts, retrieves product information, and evaluates whether its own output actually addresses the user's question. The Coursera version holds a 4.7/5 rating across 346 learners. The caveat is that there is no graded project or kept portfolio artefact on the free tier, and the supplied notebooks now require fixes (deprecated API syntax, missing helper files) to run locally outside the course sandbox.

Across three weeks (roughly 16 hours), the course covers the full generative AI project lifecycle: the Transformer architecture from the "Attention Is All You Need" paper, prompt engineering, in-context learning, Chinchilla scaling laws, instruction fine-tuning, parameter-efficient fine-tuning (LoRA), and reinforcement learning from human feedback (RLHF). Reviewers repeatedly praise how it grounds each technique in the relevant research paper before showing the "how," which builds genuine understanding of the "why." The most consistent content criticism is that week three squeezes too many topics (RLHF, model optimisation, RAG, ReAct) in at shallow depth and feels disjointed after the RLHF section.

The course is fronted by Andrew Ng with AWS instructors Antje Barth, Mike Chambers, Shelbee Eigenbrode and Chris Fregly delivering the technical content. Reviewers describe the delivery as technically clear, well-diagrammed and well-paced, with one calling Andrew Ng "like a rock star in Artificial Intelligence teaching." The multi-instructor AWS panel draws consistently positive marks for explaining production concepts from real experience, though it is a panel format rather than a single narrative voice.

At roughly USD 49 with six months of access — and the AWS SageMaker lab compute included in that price — multiple reviewers explicitly call it "not overpriced" for the breadth of current, applied content. The main value caveats are that the labs do not require writing original code (so you can finish for the certificate without coding), and that the included lab budget is finite — at least one learner exhausted it after a technical glitch on the very first lab and could not continue.

The three SageMaker labs (dialogue summarisation prompt engineering, PEFT fine-tuning with LoRA, and RLHF detoxification) give learners an end-to-end view of real LLM pipelines using PyTorch and the Hugging Face transformers library. The near-universal complaint is that the labs are "run all the cells" walkthroughs with no original coding, no graded homework, and no self-built project — you can submit by clicking through. Reviewers value them as illustrations but warn they do not verify skill or prepare you to build a similar application from scratch.

The curriculum maps closely to how LLM applications are actually scoped, adapted and deployed in industry — model selection, cost-aware optimisation (quantisation, pruning, distillation), fine-tuning strategy, RLHF alignment and RAG-style augmentation. The modern toolchain (SageMaker, Hugging Face, PyTorch) is exactly what practitioners use. The gap is between conceptual fluency and hands-on ability: because the labs require no original code, several reviewers recommend pairing the course with a build-it-yourself resource such as the Hugging Face NLP course to close the implementation gap.