Databricks - Data Engineer
Tredence Inc. is hiring a Senior Data Engineer to design and maintain high-performance data solutions using Databricks and PySpark. The role involves building complex data pipelines, managing ingestion frameworks, and implementing governance via Unity Catalog. Candidates are expected to have deep technical expertise in Delta Lake and Medallion Architecture within client-facing environments. This position focuses on optimizing distributed processing workloads and driving engineering best practices.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
6+ years
Function
Engineering
Work mode
Onsite, India
Company
Tier 2
What you will work on
Tredence Inc. is hiring a Senior Data Engineer to design and maintain high-performance data solutions using Databricks and PySpark. The role involves building complex data pipelines, managing ingestion frameworks, and implementing governance via Unity Catalog. Candidates are expected to have deep technical expertise in Delta Lake and Medallion Architecture within client-facing environments. This position focuses on optimizing distributed processing workloads and driving engineering best practices.
TAL's take
Solid senior role with specific, well-defined technical expectations in a established services firm, though lacking flagship tier 1 brand status.
The JD provides a highly specific set of technical requirements, architectural patterns (Medallion), and tooling (Unity Catalog, Asset Bundles) clearly defining the daily expectations.
Must haves
- 6+ years of hands-on experience in Data Engineering using Databricks
- Strong hands-on experience with Databricks and PySpark
- Proficiency in SQL and PLSQL
- Experience building large-scale and complex data pipelines
- Hands-on experience with Delta Lake, Medallion Architecture, and Unity Catalog
- Strong troubleshooting and performance tuning skills in Spark/Databricks environments
- Experience with CI/CD processes, Git, and Databricks Asset Bundles
Tools and skills
Nice to have: data quality frameworks, dimensional modeling, azure, agile, scrum, databricks certification.
About the company
Tredence is an established data analytics and engineering services company, fitting the tier 2 criteria for mid-sized product/services firms.
Posts mentioning Tredence Inc.
Tredence vs Wipro
I have offers from Tredence and Wipro. Which one is safe to join in terms of bench policy and job security?
How is data science role in tredence analytics?
23 grad,got placed as associate data scientist at tredence analytics at 12lpa How is data engineering/science as a career and how easy is it to shift to sde backend roles after 1 year,had one more offer of sde at 8lpa but rejected that as it was from a small startup so risk.of.layoffs
Tredence company review?
I'll be joining Tredence as a Data Science Associate and got it on campus from a tier 3 college. CTC 12LPA. What should I expect?