Annotator for social reasoning annotation
We are recruiting participants for a research experiment to evaluate the conversational understanding abilities of language models. This research focuses on building a dataset to assess the social reasoning capabilities of language models in conversational contexts. Participants will be asked to observe dialogues from movies and label the social relationships between the speakers. The social relationships we are primarily interested in include:
Social role-based relationships (e.g., parent-child, romantic partners, mentor-mentee)
Aspects of the relationship between speakers (e.g., intimacy, hierarchy, purpose of the conversation - work-oriented vs. casual)
Gender and age of the speakers in the dialogue
We are recruiting participants who meet the following criteria:
Comfortable using web pages for research participation.
Fluent in English and highly familiar with American culture (having resided in the U.S. for 5+ years).
Aged 18 or older.
Not offended by labeling dialogues that may contain profanity, offensive language, or violent scenes.
Apply Now
Apply Now
Social role-based relationships (e.g., parent-child, romantic partners, mentor-mentee)
Aspects of the relationship between speakers (e.g., intimacy, hierarchy, purpose of the conversation - work-oriented vs. casual)
Gender and age of the speakers in the dialogue
We are recruiting participants who meet the following criteria:
Comfortable using web pages for research participation.
Fluent in English and highly familiar with American culture (having resided in the U.S. for 5+ years).
Aged 18 or older.
Not offended by labeling dialogues that may contain profanity, offensive language, or violent scenes.
Apply Now
Apply Now