[Remote] Insight Analyst (Japanese) | $11/hr Remote
Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking an AI Quality Analyst specializing in personalization for a short-term contract. The role involves evaluating AI model responses and ensuring effective use of personal data in conversations.
Responsibilities
ā¢ Evaluate a personalization feature for Gemini
ā¢ Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences
ā¢ Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses
ā¢ Evaluate model responses based on intent and appropriate personalization
ā¢ Analyze responses for grounding issues, including flawed inferences or hallucinations
ā¢ Assess integration quality to ensure personal data is incorporated naturally into responses
ā¢ Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness
ā¢ Write clear rationales referencing specific conversation turns
ā¢ Extract and verify debug information to confirm correct use of summaries and data sources
ā¢ Maintain data hygiene by deleting evaluation conversations after completion
Skills
ā¢ Experience in data annotation, AI quality evaluation, content moderation, or related roles
ā¢ Strong Japanese proficiency (reading and writing)
ā¢ Willingness to use a primary personal Google account and enable personal data sources for assessment
ā¢ Strong analytical thinking and attention to detail
ā¢ Experience with creative prompt engineering and personalization concepts
ā¢ Ability to provide structured feedback and clear written explanations
ā¢ Ability to work independently in a remote environment
ā¢ Desktop or laptop with a stable internet connection
Company Overview
ā¢ At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. It was founded in 2022, and is headquartered in , with a workforce of 11-50 employees. Its website is https://www.crossinghurdles.com/.
Apply tot his job
Apply To this Job
Responsibilities
ā¢ Evaluate a personalization feature for Gemini
ā¢ Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences
ā¢ Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses
ā¢ Evaluate model responses based on intent and appropriate personalization
ā¢ Analyze responses for grounding issues, including flawed inferences or hallucinations
ā¢ Assess integration quality to ensure personal data is incorporated naturally into responses
ā¢ Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness
ā¢ Write clear rationales referencing specific conversation turns
ā¢ Extract and verify debug information to confirm correct use of summaries and data sources
ā¢ Maintain data hygiene by deleting evaluation conversations after completion
Skills
ā¢ Experience in data annotation, AI quality evaluation, content moderation, or related roles
ā¢ Strong Japanese proficiency (reading and writing)
ā¢ Willingness to use a primary personal Google account and enable personal data sources for assessment
ā¢ Strong analytical thinking and attention to detail
ā¢ Experience with creative prompt engineering and personalization concepts
ā¢ Ability to provide structured feedback and clear written explanations
ā¢ Ability to work independently in a remote environment
ā¢ Desktop or laptop with a stable internet connection
Company Overview
ā¢ At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. It was founded in 2022, and is headquartered in , with a workforce of 11-50 employees. Its website is https://www.crossinghurdles.com/.
Apply tot his job
Apply To this Job