MCP Benchmark Courses

Lightning safety courses built by Claude Opus 5.5 through each authoring tool's MCP connection, from the OSHA and NOAA fact sheet "Lightning Safety When Working Outdoors." Each tool built three versions: no guidance, a design prompt, and a full design brief. Built October 2026, published as the agent left them.

See the stage 3 design pack (the brief, the 14 images and every prompt)

Coassemble

• Stage 1: no guidance (hosted by Coassemble)
• Stage 2: design prompt (hosted by Coassemble)
• Stage 3: full design (hosted by Coassemble)

Evolve

• Stage 1: no guidance (web export from Evolve)
• Stage 2: design prompt (web export from Evolve)
• Stage 3: full design (web export from Evolve)

Mindsmith

• Stage 1: no guidance (three lessons, hosted by Mindsmith): lesson 1, lesson 2, lesson 3
• Stage 2: design prompt (hosted by Mindsmith)
• Stage 3: full design (hosted by Mindsmith)

Parta

• Stage 1: no guidance
• Stage 2: design prompt
• Stage 3: full design

Same course as 2025: Responsible ChatGPT Use at Work

Last year I built this course by hand in each tool. This October the agent built it from the same storyboard, images, narration clips and videos, one build per tool, published as the agent left it. Last year's hand build is linked next to each.

• Coassemble: agent build (hosted by Coassemble; no media, its connection can't upload) · 2025 hand build
• Evolve: agent build (web export from Evolve) · 2025 hand build
• Mindsmith: agent build (hosted by Mindsmith; not in the 2025 test)
• Parta: agent build (SCORM export from Parta) · 2025 hand build

Same course, no authoring tool

The agent also built this course as a plain web page from the same storyboard and media, with a browser to check its work. Then each tool's agent rebuilt that page through its MCP connection. Those rebuilds aren't published here.

• Web page: agent build (HTML, CSS and JavaScript; no authoring tool)