Tag: model comparison

  • How ChatGPT helped draft our first acclimatisation lab setup

    Date: 24 June 2025

    transparency label: AI-heavy

    Our latest Lab Note records a quick experiment where I asked two ChatGPT models to draft the outline for an “acclimatisation” session – the starter lab we plan to run with newcomers to AI.

    Highlights:

    • Model face‑off: I ran the same prompt in parallel on model o3 and model 4o. The reasoning‑focused o3 delivered a tight nine‑part outline. 4o wandered off‑piste.
    • Time cost: The branch test took three minutes and gave us a clear winner.
    • Transparency: The Lab Note carries an AI‑heavy label because most of the prose came straight from o3. I trimmed, corrected one hallucination, and signed off.

    If you are curious about our process or want to see how structured prompting keeps the bot on track, read the full note here: First Acclimatisation Session Lab Note →

  • Drafting Anapoly’s first Lab Setup with ChatGPT

    Transparency label: AI‑heavy (ChatGPT model o3 produced primary content; Alec Fearon curated and lightly edited)


    Purpose of experiment

    Use ChatGPT as a thinking partner to create a first draft of an acclimatisation lab setup for Anapoly AI Labs and to compare output quality between two models (o3 and 4o).

    Author and date

    Alec Fearon, 24 June 2025

    Participants

    • Alec Fearon – experiment lead
    • ChatGPT model o3 – reasoning model
    • ChatGPT model 4o – comparison model

    Lab configuration and setup

    Interaction took place entirely in the ChatGPT Document Workbench. The first prompt was duplicated into two branches, each tied to a specific model. All files needed for reference (conceptual framework, lab note structure) were pre‑uploaded in the project space.

    Preamble

    Alec wanted a concise, critical first draft to stimulate team discussion. The exercise also served as a live test of whether o3’s “reasoning” advantage produced materially better drafts than the newer 4o model.

    (more…)