Data Engineer
Agile Technology Solutions is seeking a Data Engineer to design and maintain scalable data pipelines for a client. The role involves integrating data from various sources including OT, IoT, and enterprise systems using AWS and Databricks. You will be responsible for ETL/ELT development, data quality, and supporting downstream analytics and BI initiatives. This is a permanent onsite role requiring strong expertise in the AWS cloud ecosystem.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
5-7 years
Function
Engineering
Work mode
Onsite, India
Company
Tier 3
What you will work on
Agile Technology Solutions is seeking a Data Engineer to design and maintain scalable data pipelines for a client. The role involves integrating data from various sources including OT, IoT, and enterprise systems using AWS and Databricks. You will be responsible for ETL/ELT development, data quality, and supporting downstream analytics and BI initiatives. This is a permanent onsite role requiring strong expertise in the AWS cloud ecosystem.
TAL's take
Tier 3 staffing/consulting firm, role is a generic data engineering position for an unnamed client with a specific location constraint.
The JD is clear, coherent, and lists specific technical stacks and responsibilities expected for the role.
Must haves
- Strong experience in AWS Cloud Platform
- Hands-on expertise in Python programming
- Strong knowledge of PySpark and Spark optimization
- Experience with Databricks platform
- Expertise in AWS Glue for ETL development
- Knowledge of SQL and data warehousing concepts
Tools and skills
About the company
Small IT services company providing staffing/recruitment services, does not meet criteria for tier 1 or 2 product companies.