Test Manager – AI Architect / Manager - Manager - Operate
The Test Manager – AI Architect leads the AI-led Quality Engineering vision for enterprise clients within PwC's Advisory practice. You will define end-to-end AI strategy, architect AI-driven QA platforms, and deploy intelligent automation bots using GenAI and RAG frameworks. The role requires balancing hands-on technical architecture with strategic leadership and stakeholder communication. Success involves integrating AI-driven metrics into CI/CD pipelines and mentoring technical leaders to scale intelligent automation.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
6+ years
Function
Engineering
Work mode
Onsite, India
Company
Tier 2
What you will work on
The Test Manager – AI Architect leads the AI-led Quality Engineering vision for enterprise clients within PwC's Advisory practice. You will define end-to-end AI strategy, architect AI-driven QA platforms, and deploy intelligent automation bots using GenAI and RAG frameworks. The role requires balancing hands-on technical architecture with strategic leadership and stakeholder communication. Success involves integrating AI-driven metrics into CI/CD pipelines and mentoring technical leaders to scale intelligent automation.
Must haves
- 6+ years experience in QA automation or software engineering
- 3+ years experience with AI-driven automation or intelligent testing frameworks
- 2+ years hands-on experience building or testing AI-based tools
- Proficiency in LangChain, LangSmith, and LlamaIndex
- Experience with DeepEval or RAGAS evaluation frameworks
- Knowledge of ML metrics such as precision, recall, and F1 score
- Hands-on experience testing RAG pipelines and agent-based solutions
Tools and skills
Nice to have: custom llm fine-tuning, open-source llm hosting, multi-cloud ai tooling, predictive analytics tools, ai observability platforms, lucidchart, miro.
About the company
Global consultancy firm with a established delivery center in India.