Our Fortune 100 client is looking for a skilled Linguistic Engineer to maintain high-quality data annotation practices for our topline quality evaluation pipelines.
This is an onsite, hybrid role in the Bay area or Redmond, WA.
Job Responsibilities:
- Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
- Deliver rater feedback and design and execute on rater quality improvement plans.
- Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
- Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
- Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
- This is not an annotator position, though annotation will occasionally be required to accommodate urgent requests.
Skills
- Basic Python, intermediate SQL with strong desire to grow required for this position.
- Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.
- Ability to analyze numerical rating results and draw conclusions based on data.
- Intermediate stats / math for data analysis.
- Written and oral communication skills necessary for communicating on project milestones and for reporting findings.
Education/Experience
- Bachelor’s degree in computational linguistics, speech science, or related field OR graduate degree in linguistics OR industry similar experience required.
- Master’s degree or beyond preferred OR equivalent industry experience.
- Additional learning via Coursera, Udemy, or other online resources great too.
Hybrid Role: Must be able to work Wednesday – Sunday:
Wed-Fri: onsite /Sat -Sun: WFH
Wed-Fri: onsite /Sat -Sun: WFH
If you are interested, please send me your resume & we can find a time to chat. My email address is [email protected]
We offer a referral bonus if you refer a colleague who is hired. Anzu Global is also actively seeking candidates with experience in Artificial Intelligence AI, Natural Language Processing NLP, Machine Learning ML, and Computational Linguistics.