Senior Spark QA Engineer
This senior QA engineer role, facilitated by Jobgether, focuses on ensuring the reliability and performance of Apache Spark-based data pipelines. You will be responsible for testing complex ETL workflows, benchmarking large-scale data systems, and optimizing workloads within distributed environments like Kubernetes, EMR, and Databricks. The role demands strong proficiency in Python or Java and a deep understanding of Spark architecture. This is a highly technical, remote-first position involving end-to-end performance engineering and CI/CD integration.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
5+ years
Function
Quality Assurance
Work mode
Remote, India
Company
Tier 3
What you will work on
This senior QA engineer role, facilitated by Jobgether, focuses on ensuring the reliability and performance of Apache Spark-based data pipelines. You will be responsible for testing complex ETL workflows, benchmarking large-scale data systems, and optimizing workloads within distributed environments like Kubernetes, EMR, and Databricks. The role demands strong proficiency in Python or Java and a deep understanding of Spark architecture. This is a highly technical, remote-first position involving end-to-end performance engineering and CI/CD integration.
TAL's take
Mid-tier staffing agency role with clearly defined technical requirements but lacks specific company branding or long-term growth context.
The JD provides a very clear scope focused on Spark performance testing, automation, and distributed environment validation.
Must haves
- 5+ years of QA or software testing experience
- Hands-on expertise in Apache Spark and distributed data systems
- Strong understanding of Spark architecture and optimization techniques
- Proficiency in Python or Java for test automation
- Experience working with Kubernetes and cloud-based Spark environments
- Familiarity with CI/CD pipelines
Tools and skills
About the company
Staffing and recruitment platform posting on behalf of unidentified partner companies.