Skip to main content
BiasedDecisions

Antisemitic stereotypes

Do AI models repeat antisemitic stereotypes?

We asked three AI models yes-or-no questions built on six antisemitic stereotypes, after adding a short phrase saying the person is Jewish. This page shows what each model did, on real biographies and on made-up loan narratives, and whether it is being Jewish or being devout that moves the model.

These are tests of what the models answer. They say nothing about Jewish people, and the stereotypes are described only so the tests can be checked.

What we asked

We took short professional biographies and added one phrase saying who the person is. Then we asked yes-or-no questions about the person, three worded differently for each of six antisemitic stereotypes, and we averaged the three. We compared each answer with the answer after a harmless phrase of the same size, and with the same phrase for Christian and Muslim people, so the effect of naming any group cancels out. The score is how many percentage points more often the model gave the answer the stereotype predicts.

The six stereotypes we tested

Each comes from a published source. Where these stereotypes come from lists the sources and how far we checked each.

The five ways of saying who the person is

Real short professional biographies

Two thousand real biographies, 500 of them answered by each model in this first pass. Every result on its own page.

Largest clear score across the five wordings. Each tile opens the full board, including every wording and range. “No clear positive score” is not zero and does not mean the model is free of bias.

  • Jev: its largest result was 1.96 percentage points on dual loyalty, when the phrase was Devout Jew (range 1.83 to 2.08).
  • Laya: its largest result was 1.55 percentage points on dual loyalty, when the phrase was Devout Jew (range 1.11 to 1.99).
  • Kev: its largest result was 1.03 percentage points on secret coordination, when the phrase was Devout Jew (range 0.96 to 1.10).

Made-up small-business loan narratives

Two hundred loan narratives written for this test, so no real person is described. Every result on its own page.

Largest clear score across the five wordings. Each tile opens the full board, including every wording and range. “No clear positive score” is not zero and does not mean the model is free of bias.

  • Jev: its largest result was 2.26 percentage points on secret coordination, when the phrase was Devout Jew (range 2.16 to 2.37).
  • Laya: its largest result was 4.45 percentage points on favouring one's own, when the phrase was Devout Jew (range 4.01 to 4.96).
  • Kev: its largest result was 2.47 percentage points on secret coordination, when the phrase was Israeli (range 2.36 to 2.60).

Being Jewish, or being devout?

A phrase such as “a devout Jew” carries two signals at once: religious practice and Jewish identity. Earlier work found that almost any religious label moves a model on some questions. To separate the two, we compare “a devout Jewish” with the plain phrase “a Jewish” on the same biographies. A positive score means the model gave the answer the stereotype predicts more often. A difference well away from zero means the two phrases do not move the model alike.

Jev

Laya

Kev

Does the job it picks change?

We also asked whether the same phrases change which of two occupations a model says a biography describes, such as paralegal or attorney. The occupation results are on their own board.

What this does not show

Release v1.49.1, published .

Every number on this site is worked out from the models' saved answers, on 2026-09-30, at version 8b908ef of the public repository, with bd report --json --date 2026-09-30. You can download every number in one data file. About this site.

Where the answers come from: studies/<task>-<cue>.jsonl (re-run from the saved answers with bd replay).

Biased-Decisions is MIT-licensed (source). Bias in Bios (De-Arteaga et al., 2019) is MIT-licensed on the Hugging Face Hub. Typefaces: Jersey 25 and Montserrat, SIL Open Font License.