STEM Evaluator
Synstack Technologies is seeking a STEM Evaluator to join their AI Quality & Evaluation team. The role focuses on enhancing the accuracy and pedagogical effectiveness of large language models across multiple STEM disciplines. Responsibilities include developing quality rubrics, designing evaluation datasets, and collaborating with engineers to refine model performance. This position sits at the intersection of AI model evaluation and content quality assurance.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
Experience not specified
Function
Research
Work mode
Onsite, India
Company
Tier 2
What you will work on
Synstack Technologies is seeking a STEM Evaluator to join their AI Quality & Evaluation team. The role focuses on enhancing the accuracy and pedagogical effectiveness of large language models across multiple STEM disciplines. Responsibilities include developing quality rubrics, designing evaluation datasets, and collaborating with engineers to refine model performance. This position sits at the intersection of AI model evaluation and content quality assurance.
TAL's take
Solid specialized research role in AI evaluation, but lacks specific YOE requirements and company branding.
Clear responsibilities focused on AI model evaluation across specific STEM domains, though it is slightly broad in the subjects covered.
Must haves
- Expertise in Mathematics, Physics, Chemistry, Biology, Coding, or Finance
- Ability to develop and enforce quality rubrics
- Experience evaluating model outputs for accuracy
- Design evaluation datasets for model benchmarking
- Collaborate with AI/ML Engineers
Tools and skills
About the company
unfamiliar company, default mid-tier