The modified ChatGPT still showed bias against cerebral palsy, as it was the only disability among the six tested that did not rank higher than resumes that didn't mention disability. The other five implied disabilities - deafness, blindness, autism, the general term "disability", and depression - improved after the customization with written instructions directing the tool not to be ableist.
UW researchers modified ChatGPT by customizing the tool with written instructions directing it not to be ableist. They used the GPTs Editor tool, which allowed them to customize GPT-4 with these instructions without requiring any code. This approach aimed to make the AI model work with disability justice and DEI principles, reducing ableist biases in its outputs.
The researchers created six enhanced CVs, each implying a different disability by including four disability-related credentials: a scholarship, an award, a diversity, equity and inclusion (DEI) panel seat, and membership in a student organization. They used one of the study's authors' publicly available curriculum vitae (CV) as the base.