Senior Data Engineer (Hybrid Work Schedule)
Quorum Software is seeking a Senior Data Engineer in Pune to help scale their enterprise data platform for the energy industry. The role involves designing and maintaining scalable medallion architecture pipelines, developing RESTful APIs, and optimizing data transformations using PySpark and SQL on Azure. You will collaborate with data scientists to support ML workflows and mentor junior team members. This position is a technical hands-on role requiring strong expertise in the Databricks ecosystem and Azure cloud services.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
4+ years
Function
Engineering
Work mode
Hybrid, India
Company
Tier 2
What you will work on
Quorum Software is seeking a Senior Data Engineer in Pune to help scale their enterprise data platform for the energy industry. The role involves designing and maintaining scalable medallion architecture pipelines, developing RESTful APIs, and optimizing data transformations using PySpark and SQL on Azure. You will collaborate with data scientists to support ML workflows and mentor junior team members. This position is a technical hands-on role requiring strong expertise in the Databricks ecosystem and Azure cloud services.
TAL's take
Solid role at a specialized energy sector software company with clear technical responsibilities and stack expectations.
The JD provides a clear, well-defined scope, specific technical stack, and concrete expectations for the first year.
Must haves
- 4+ years of hands-on data engineering experience
- Strong understanding of data pipeline design patterns
- Solid hands-on experience with Databricks including Delta Lake and Unity Catalog
- Proficiency in PySpark and Spark SQL
- Experience building RESTful APIs using Python frameworks
- Strong SQL skills for performance tuning
- Hands-on experience with Azure data services
Tools and skills
Nice to have: microsoft fabric, microsoft onelake, dbt, kafka, mqtt, azure event hubs, terraform, bicep.
About the company
Established industry-specific software provider for the energy sector with global operations.