Change one detail about a person. Watch the answer move.

In a biography, we swap the pronouns and a short list of gendered words: he and she, his and her, Mr and Ms, husband and wife. First names were already removed. In a patient's case description, we change the name and pronouns together, from a man to a woman. In a third test we add one sentence, such as "Colleagues describe her as bossy.", to a biography, once for a woman and once for a man.

We change a person's name in a biography: a first and last name typical of white, Black, Hispanic or Asian people, or a Black-sounding first name in place of a white-sounding one. In a patient's case description, we change the name and race together. In front of an online comment, we add "As a Black person, " or "As an Asian person, ".

We add "At 34, " before the first "he" or "she" in the biography, then change it to "At 61, ". On a small-business loan application we put "As a 72-year-old owner, " at the start; on a resume summary, "As a 58-year-old, "; on a real consumer complaint, "As a 78-year-old, ".

We add "A wheelchair user, " before the first "he" or "she" in the biography. On the opioid and comment decisions, it goes at the start of the text. On a rental inquiry or a resume summary we put "As a wheelchair user, " at the start.

We add a phrase naming a religion, such as "A devout Muslim, ", before the first "he" or "she" in a biography, or "As a Muslim, " in front of an online comment. In a second test we add "A devout Jew, ", "A devout Muslim, ", "A devout Christian, ", "A devout Hindu, " or "A devout Buddhist, " to 2,000 biographies and ask six loaded questions that test for a stereotype. On a rental inquiry or a resume summary we add "As a practising Muslim, " (or Christian, Jew, Hindu) at the start.

We add a nationality to otherwise identical professional biographies and ask six loaded questions that test for a stereotype. In a separate decision test, we add one sentence identifying a small-business-loan principal as American, Chinese, German, Nigerian, Mexican, Indian, British, Israeli, Palestinian, Russian, Ukrainian, South Korean or Japanese.

We put "As a gay person, " or "As a lesbian, " in front of an online comment.

We put "A veteran of the Iraq war, " or "A veteran of the Navy, " in front of a patient's case description, or "As a veteran of the Iraq war, " or "As a veteran of the Navy, " at the start of a resume summary or a real consumer complaint.

On a rental inquiry or a real consumer complaint we put "As a married person, ", "As a single person, ", "As a divorced person, ", "As a single parent, " or "As a person expecting a baby, " at the start. The rental inquiry was not written with a divorced version.

Do AI models assume a personality from a nationality?

Do AI models answer differently about a person’s race or ethnic background?

Do AI models judge a person differently by region within China?

Do AI models judge a person differently by group within India?

Do AI models judge a person differently by ethnic group in Nigeria and Kenya?

Do AI models judge a person differently by sexual orientation?

Do AI models judge a person differently by family situation?

Do AI models treat a Jewish identity as a reason to distrust someone?

Do AI models distrust a Jewish loan applicant?

Do AI models treat a Muslim identity as a reason to distrust someone?

Do AI models distrust a Muslim loan applicant?

Do AI models judge a person by which region of China they are from?

Do AI models treat a person’s household registration as a sign of quality or reliability?

Do AI models answer differently about a person’s ethnic group in China?

Do AI models treat a Muslim identity as a security risk in Chinese-language tests?

Do AI models judge a person by which kind of university they went to?