Specialist - Research Engineering
This AI/ML QA Specialist role at LTM focuses on building and maintaining evaluation frameworks for LLMs and AI agents. You will define quality metrics, build evaluation pipelines, and ensure model robustness regarding hallucination and safety. The position requires strong Python programming and hands-on experience with LLM stacks. You will play a key role in integrating these evaluations into CICD pipelines.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
5+ years
Function
Quality Assurance
Work mode
Onsite, India
Company
Tier 2
What you will work on
This AI/ML QA Specialist role at LTM focuses on building and maintaining evaluation frameworks for LLMs and AI agents. You will define quality metrics, build evaluation pipelines, and ensure model robustness regarding hallucination and safety. The position requires strong Python programming and hands-on experience with LLM stacks. You will play a key role in integrating these evaluations into CICD pipelines.
TAL's take
Role has well-defined responsibilities in the AI evaluation space, though company brand is not globally recognized.
JD provides a clear mandate, specific technical requirements, and defined deliverables for the AI/ML evaluation role.
Must haves
- 5 years experience in QA
- 2 years experience in AIML systems
- Hands-on LLM evaluation experience
- Strong Python programming
- Experience with evaluation metrics like BLEU and ROUGE
Tools and skills
Nice to have: deepeval, ragas, trulens, promptfoo, rag, chaos testing.
About the company
unfamiliar company, default mid-tier
Posts mentioning LTM
TCS or LTMINDTREE?
I am a 2021-25 CSE graduate. I gave the on-campus NQT on 3rd October 2024 and got selected for a Digital Role at TCS (7 LPA) today! I was already placed at LTIMindtree for the GET Role (4.05 LPA) a few months earlier. Now, based on my research, I realized that LTI's training is one of the best in the industry, and as a fresher, I really want to attend it. However, TCS is offering a much higher package! So, what can be the proper action plan to make the best of both offers in terms of learning and monetary benefits? One good piece of advice I received was to: Join LTI first (assuming they provide the joining date before TCS). Learn as much as possible during their training, and then transition to TCS for the better pay. However, I have a concern: Since LTI is a full-time offer, they will definitely generate my EPFO account (UAN). Will TCS accept me if I already have an existing UAN/EPFO account? At the same time, the TCS application form stated that candidates with up to 2 years of work experience are eligible, so technically, they might consider candidates with an existing EPFO account. What should I do? Please, any senior or brilliant mind, help me out here with solid advice! 🙏
Can I exchange LTM ID card in banglore office
Like my base location is noida, i have LTIMindtree ID card , now LTM card is required, can I exchange card in Banglore office?
Resigned from LTM due to bench policy.Can I rejoin LTM. Can anyone refer me for same.Skills - Java Springboot microservices .Not working .