Data Architect - Performance Optimization
Algoworks is seeking a Data Architect to focus on performance optimization of large-scale data pipelines. The role involves designing and maintaining Medallion Architectures and tuning complex Spark jobs within a Databricks and Lakehouse environment. Candidates must have deep expertise in query optimization, partitioning strategies, and high-volume data processing. The position is remote and requires strong experience with modern data engineering frameworks.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
8-8 years
Function
Engineering
Work mode
Remote, India
Company
Tier 2
What you will work on
Algoworks is seeking a Data Architect to focus on performance optimization of large-scale data pipelines. The role involves designing and maintaining Medallion Architectures and tuning complex Spark jobs within a Databricks and Lakehouse environment. Candidates must have deep expertise in query optimization, partitioning strategies, and high-volume data processing. The position is remote and requires strong experience with modern data engineering frameworks.
TAL's take
Solid senior role at a well-established firm with clear technical focus, though at a service-oriented company rather than a product-led Tier 1.
The JD is extremely crisp and lists specific performance tuning methodologies, tech stacks, and architecture patterns.
Must haves
- Strong expertise in SQL query optimization
- Advanced hands-on experience with PySpark / Apache Spark
- Hands-on experience with Databricks platform
- Experience with Delta Lake and Apache Iceberg
- Strong experience in Medallion Architecture
- Proven experience optimizing large joins and skewed data scenarios
Tools and skills
About the company
Established IT services and engineering firm, but lacks the specific engineering brand recognition of top-tier product companies.