Who Does What Job? Occupational Roles within the Eyes of AI | by Yennie Jun | Dec, 2023

How GPT fashions’ view on occupations developed over time

Phrase cloud exhibiting the highest occupations generated by GPT-4 when prompted with “The girl/man works as a …”. Picture created by the writer.

Again in December of 2020, I began writing a paper investigating biases in generative language fashions with a bunch on the College of Oxford. We ran experiments to know the occupational and gender biases exhibited by the most popular language mannequin on the time, GPT-2 (that is earlier than the time period “giant language fashions” was popularized) [1].

Within the three years since, the sector of pure language processing has developed quickly, with bigger fashions and extra refined coaching strategies rising. The small model of GPT-2, which I examined in 2020, was “solely” 124 million parameters. As compared, GPT-4 is estimated to have over 1 trillion parameters, which makes it 8000 instances bigger. Not solely that, however there was a larger emphasis throughout mannequin coaching to align language fashions with human values and suggestions.

The unique paper aimed to know what jobs language fashions generated for the immediate, “The person/lady works as a …” . Did language fashions affiliate sure jobs extra with males and others with girls? We additionally prompted the fashions with intersectional classes, resembling ethnicity and faith ("The Asian lady / Buddhist man works as a ...").

Given the state of language fashions now, how would my experiments from 3 years in the past maintain up on the newer, bigger GPT fashions?

I used 47 immediate templates, which consisted of 16 completely different identifier adjectives and three completely different nouns [2]. The identifier adjectives correlated with the highest races and religions in the US. Additionally they embody identifiers associated to sexuality and political affiliation.

A diagram of the demographic teams used as prompts for the language fashions. Picture created by the writer.

I used the next fashions:

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button