Narrate

A citation is not a fact-check

By default, every episode script, with its hook and show notes, is checked against the source text captured for that episode by a separate AI model — never the one that wrote it. What a source contradicts, and risky claims no source supports, are highlighted, and the episode cannot be narrated until a person has dealt with each one.

  • The whole script is read against its sources in one pass, by a different AI model from the one that wrote it.
  • Every quote the check relies on is confirmed by code to appear in the source it names.
  • Any unresolved highlight, or a check that did not finish, stops the episode until a person has dealt with it.
  • What this does not catch, and how often it missed in our own test, is set out on this page.
Open a published episode

Its panel lists the sources, the transcript, and — where a check ran — what it was checked against and how much a person reviewed.

An episode can cite a source and still be wrong. One of ours was: the script quoted a figure from a write-up of a report, the write-up had misread the report it was summarising, and every link on the page went somewhere real. Nothing about the citation was fake — it just was not the same thing as being right. Everything below exists because of that, and none of it is a promise that a model behaves. It is what happens to a script before anyone is allowed to record it.

The check, end to end

  1. Capture

    Research stores the text of each source with the episode — whole pages, so a results table is still there to check against and not only an abstract.

  2. Check

    A separate AI model reads every sentence of the script, hook and show notes against that stored text, and reports what a source contradicts and risky claims no source supports.

  3. Confirm

    Code confirms each quote really is in the source it names, and highlights a sentence crediting an organisation or author the research never mentions.

  4. Gate

    Every highlight waits for a person, and an episode with any left — or whose check did not finish — cannot be narrated.

This runs by default on every episode. The person creating one can switch it off for that episode, and then nothing is highlighted — which is why the finished page says nothing about checking rather than something weaker.

What happens to a script

  1. By default, the script is checked against the text captured for that episode

    When an episode is researched, the pages it draws on are not just linked. The text is captured and stored with the episode — whole pages rather than opening paragraphs, so that a paper’s results table is still there to be checked against and not only its abstract. Material a client supplies is stored the same way. The check runs against that stored text. It is not a model being asked whether it remembers the study correctly.

    What we research from, and what we leave out →

  2. One check reads the whole episode

    Every sentence of the finished script, the hook and the show notes is numbered and put in front of the check together with every captured source. Nothing is filtered out first, so a confidently wrong sentence cannot escape by not looking like a claim. Which sentences it reports, though, is the check’s judgement — this is a model reading, not a mechanical rule, and the limits below say what that costs.

    The check is run by a separate AI model, never the one that wrote the script. By default it comes from a different company from the writer’s. A creator can instead choose a faster, less thorough check, which may come from the same company — the episode records which kind of check ran.

    The sources are handed to the check as material to read, and it is told to ignore any instruction that appears inside one: a web page is not allowed to tell it that everything is fine.

  3. What gets highlighted

    Two kinds of sentence are reported. One that a source contradicts — a wrong number, a finding reversed or exaggerated, a result credited to the wrong study, author, journal or country. And one that states a high-stakes fact — a medical dose, a safety or health risk, a rule about money or the law — that no source supports.

    Anything else that is simply absent from the sources is not highlighted: a well-known date, a piece of general background. That is a deliberate trade, so a person reviews the sentences that matter instead of every sentence the research did not happen to repeat.

  4. A quote, confirmed by code

    When the check says a source contradicts a sentence, it has to quote the source. That quote is then confirmed, by plain code with no model in it, to actually appear in the source it names. A quote that cannot be found keeps its highlight — the sentence still goes to a person — but it is marked as not found, and it is never used as the basis for a suggested rewrite.

  5. A sentence crediting an organisation or author the research never mentions is highlighted too

    Attribution is checked separately, by code rather than by the model, because crediting the wrong organisation is the mistake models miss most. If a sentence credits a named organisation or author — “according to…”, “…reported” — and that name appears nowhere in the episode’s research, the sentence is highlighted even when the number in it is right.

    It is a name check, and deliberately narrow. It cannot tell whether a source that mentions the name was actually written by them, so a credit can pass because someone else’s article mentions it. And a one-word name at the very start of a sentence is only treated as a name when the script or the sources confirm it, so a credit like that can be missed.

  6. A highlighted episode cannot be narrated

    Highlights are not a report somebody might read. Any unresolved highlight blocks narration outright: the request to narrate is refused, and the interface offers no override. A person clears each one by accepting the sentence as it stands, rewriting it to match what the source supports, or cutting it. A highlight in the hook or the show notes is fixed by editing that text.

    A check that fails or does not finish blocks narration too. The person can run it again, run it with a different model, or decide to narrate without a check — a decision that is recorded, never counted as checked, and leaves the published episode saying nothing about a check.

    Clearing a highlight is a person’s decision recorded against the sentence — who cleared it and when — and the replacement they write is theirs: the check does not run again over it. Editing the script, hook or show notes freely is the other case: a general edit runs the whole check again before narration is allowed, and only a decision on a sentence highlighted again exactly as before is kept. So no episode can be narrated on a check that ran against an older draft of it.

  7. What ends up on the episode page

    A published episode says how many sources its script was checked against and how many highlights a person reviewed before narration, next to the list of those sources and the full transcript. It says the check came from a different company than the writer only when that is true of that episode. When the check did not finish, or the episode went ahead without one, the line is absent rather than optimistic.

Two ways out, and only one of them is automatic

This is the part worth reading twice, because it is where a sentence would slip through if anything were going to. A sentence leaves the check one of two ways.

A sentence of the script, hook or show notes

Goes on without anyone reading it

  • The check, reading every captured source, finds nothing there that contradicts it, and it is not a high-stakes fact left unsupported.

Stops the episode and waits for a person

  • A captured source contradicts it.
  • It states a dose, a safety risk, or a money or legal rule that no source supports.
  • It credits an organisation or author whose name appears nowhere in the episode’s research.
  • The check quoted a source for it, and the quote is not in that source.
  • The check did not finish — and then the whole episode waits, not one sentence.

The three ways a person clears a highlight

  1. Accept the sentence as it stands
  2. Rewrite it to match what the source supports
  3. Cut it
No other way out, and no override in the interface. What clears a highlight is the person’s decision, recorded with the sentence: the replacement they write is not sent back through the check, which is why the name kept against it matters. Editing the script freely is the other case — a general edit runs the whole check again before narration.

What the check keeps, one highlight at a time

For each sentence it highlights, the episode keeps the sentence, which part of the episode it is in, the source the check quoted, the quote itself and whether code found it there, the reason given, and what a person did next. A sentence the check raised nothing on carries no record. The record stays with the episode and can be produced for a client on request. It is not published highlight by highlight on the episode page: a listener gets the sources, the transcript, and the summary line.

Illustrative. The four records below show the shape of the thing and the outcomes it can carry; the sentences and passages in them are written for this page, not lifted from a published episode, and the organisation named in one of them is invented.

  • Highlighted — a source disagrees

    The sentence
    The trial reported a 37 per cent fall in hospital admissions over two years.
    Checked against
    The trial’s own published results, captured whole when the episode was researched.
    Where it sits
    The script.
    The quote the check gave
    “Admissions in the treatment arm fell 27 per cent against control across the 24-month follow-up.” Confirmed by code to appear in that source.
    What happened
    A person rewrote the sentence to say 27 per cent. The rewrite is recorded against the sentence as their decision — a person standing behind the replacement, not the check running a second time.
  • Highlighted — a risky claim no source supports

    The sentence
    Adults can safely take up to 300 milligrams a day.
    Checked against
    Every source captured for the episode. None of them gives a safe daily amount.
    Where it sits
    The script.
    The quote the check gave
    Nothing to quote, which is the finding: a dose stated with no source behind it.
    What happened
    A person cut the sentence. Had it been a well-known date instead of a dose, it would not have been highlighted at all.
  • Highlighted — the credit, not the number

    The sentence
    According to the Harrow Policy Institute, the figure has doubled since 2019.
    Checked against
    The institute is not named anywhere in the episode’s research. The number itself does appear in a captured source, which credits census data.
    Where it sits
    The show notes.
    The quote the check gave
    Nothing to quote. This one is found by code, not by the model.
    What happened
    Highlighted although the number is right. The show notes were edited to credit the source the episode actually holds, and the whole check ran again before narration.
  • Highlighted — the quote could not be found

    The sentence
    The agency notes that the detections revived interest in the older explanation.
    Checked against
    The agency’s own page on the subject, captured whole when the episode was researched.
    Where it sits
    The hook.
    The quote the check gave
    The check quoted a passage from that page; code could not find it there, and the record says so.
    What happened
    Still highlighted — a quote that cannot be found does not clear anything — and no rewrite was suggested from it. A person read the page, found nothing to support the sentence, and edited the hook.

What this does not do

  • It checks a script against the research that episode was built on, not against everything known about the subject. A claim the sources do not cover is highlighted only if it is the high-stakes kind; general background is left alone.
  • It is not a judgement about whether a source is right. When a sentence is not highlighted, that says nothing about whether the study it reports is right — it is a check of the script against the research, not of the finding.
  • It can miss things. In our own test, with deliberate errors planted into real episode scripts, the default check found 93% and 98% of them across two sets of three runs, including every one we marked critical. The faster option found 87% and 98%, and in the first set it missed one critical error in every run. Most misses were sentences crediting the wrong organisation.
  • The check runs on every episode by default, and the person creating an episode can switch it off for that episode. When it is off nothing is highlighted, so the finished episode page says nothing about checking rather than saying something weaker.
  • A person is still the last step before anything is recorded, and again before anything is released. None of this replaces that. It decides what that person is looking at.

Go and check one

The panel at the top of a published episode lists the sources it cites, the transcript it ships with, and — where a check ran and finished — how many sources the script was checked against and how many highlights a person reviewed. It is the same panel on every episode, including the ones where that line is missing.

Open a published episode: Berberine, Blood Sugar, and the "Nature's Ozempic" Problem

The rest of the process, step by step →