Building Systems with the ChatGPT API vs Machine Learning Engineer Nanodegree

Across 11 short lessons (roughly 90 minutes total), the course covers a complete pipeline for multi-step LLM systems: how language models and tokenisation work, the chat format and system-user message separation, input classification for query routing, the OpenAI Moderation API, chain-of-thought prompting to handle multi-step questions, chaining several focused prompts where each consumes the previous output, output checking, and a two-part section on evaluating LLM responses at the system level. Reviewers consistently praise the logical progression and the theory-to-practice balance. The principal mark-down is age and depth: the course was built on GPT-3.5 Turbo in 2023 and has not been meaningfully updated, so it predates tool calling, structured JSON outputs, and reasoning models, and it stops short of real-world deployment concerns such as latency management, cost at scale, and production observability.

Isa Fulford, Member of Technical Staff at OpenAI, leads the code demonstrations while Andrew Ng frames the broader concepts and asks the questions a beginner would actually ask. Reviewers across blogs and Coursera call the pairing "highly knowledgeable and effective communicators." The teacher-demonstrator dynamic mirrors how a learner thinks through a new problem step by step, keeping each lesson of five to twenty minutes focused and coherent. Because Fulford comes directly from the team that built the ChatGPT API, the design decisions behind the Moderation API, the chat format, and tokenisation carry genuine authority rather than third-hand explanation.

The course is free on the DeepLearning.AI platform with every Jupyter notebook runnable directly in-browser — no OpenAI API key, no local Python environment, and no subscription required. The Coursera guided-project version is also free to audit. For roughly 90 minutes of hands-on instruction from two of the most credible names in the field, delivering reusable architecture patterns for multi-step LLM systems, the value proposition is essentially unmatched among paid or free alternatives. The only caveats are that a graded assignment and certificate on the Coursera version sit behind a paid enrolment, and the free tier leaves no portfolio artefact by default.

The patterns taught — classify the input, moderate for safety, reason in steps, chain focused prompts rather than one monolithic prompt, then evaluate the output — are exactly how production LLM features are structured in practice. Multiple reviewers note that the progression from basic API calls to a multi-stage orchestrated system reflects real engineering work. The gap is that the 2023 course predates the patterns now central to production LLM development (tool calling, structured outputs, retrieval-augmented generation), and at least one practitioner reviewer noted that the finished chatbot example would require substantial hardening before it approached something ready for deployment beyond a prototype.

Every lesson pairs a video with a runnable Jupyter notebook, and the course builds one coherent end-to-end example: a customer-service chatbot that classifies incoming queries, runs them through the Moderation API, applies chain-of-thought prompting to multi-step reasoning, chains successive focused prompts, retrieves product information, and evaluates whether its own output actually addresses the user's question. The Coursera version holds a 4.7/5 rating across 346 learners. The caveat is that there is no graded project or kept portfolio artefact on the free tier, and the supplied notebooks now require fixes (deprecated API syntax, missing helper files) to run locally outside the course sandbox.

Reviewers consistently praise the project curation and AWS SageMaker coverage, but the deep learning section is widely flagged as too short and the lectures lean engineering-first rather than theory-first.

Instructor quality on individual lessons is strong (clear videos, mix of Jupyter notebooks and text), but the program has many authors and no single pedagogical voice across the four-course track.

The biggest drag on the score. Monthly subscription at $249-399 makes the total cost roughly $800-1500+, and reviewers consistently compare it unfavourably to cheaper Coursera, Georgia Tech OMSCS or fast.ai alternatives.

Mentor-graded project reviews are the most praised feature across the entire sample. Multiple reviewers report personalised written feedback within 30-45 minutes and treat this as the main differentiator vs MOOCs.

Projects are real and end-to-end (SageMaker deployment, sentiment analysis, capstone) which transfers better than passive video courses, but reviewers flag heavy use of boilerplate code as a brake on independent skill-building.