Big Data Engineer
D Square Consulting Services Pvt Ltd is seeking a Big Data Engineer to manage and support large-scale market regulation data infrastructure. The role involves monitoring, troubleshooting, and automating data pipelines in a hybrid cloud environment using AWS, Azure, and various database technologies. Candidates are expected to manage batch processing, infrastructure stability, and CI/CD pipelines while working night shifts. The position requires a background in systems administration and scripting to optimize system performance and ensure data integrity.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
5+ years
Function
Engineering
Work mode
Remote, unknown
Company
Tier 3
What you will work on
D Square Consulting Services Pvt Ltd is seeking a Big Data Engineer to manage and support large-scale market regulation data infrastructure. The role involves monitoring, troubleshooting, and automating data pipelines in a hybrid cloud environment using AWS, Azure, and various database technologies. Candidates are expected to manage batch processing, infrastructure stability, and CI/CD pipelines while working night shifts. The position requires a background in systems administration and scripting to optimize system performance and ensure data integrity.
TAL's take
Tier 3 consulting firm with a role that requires night shift work and carries a heavy, broad operational maintenance scope.
Role has a clear focus on data infra and support, but contains a very broad list of responsibilities that overlap significantly with SRE/DevOps roles.
Must haves
- 5+ years experience as a Big Data Engineer or support role
- Strong background in Linux and Windows system administration
- Hands-on experience with AWS and Azure cloud services
- Proficiency in SQL, Python, and Bash scripting
- Bachelor's degree in Computer Science or related field
Tools and skills
Nice to have: workload automation, containerization, observability.
About the company
Small technology consulting and services company with limited industry footprint.