Data Engineer – Real Time Streaming
D4 Insight is hiring a Data Engineer to design and optimize enterprise-scale real-time streaming platforms. The role involves building scalable pipelines, implementing Kafka and Flink integrations, and managing data architecture within Cloudera and Kubernetes environments. Candidates require strong experience in distributed data processing and cloud-native platform development. This position is based in Bengaluru and operates in a hybrid model.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
5+ years
Function
Engineering
Work mode
Hybrid, India
Company
Tier 2
What you will work on
D4 Insight is hiring a Data Engineer to design and optimize enterprise-scale real-time streaming platforms. The role involves building scalable pipelines, implementing Kafka and Flink integrations, and managing data architecture within Cloudera and Kubernetes environments. Candidates require strong experience in distributed data processing and cloud-native platform development. This position is based in Bengaluru and operates in a hybrid model.
TAL's take
Solid role scope and clear technical requirements at a mid-tier company.
Clear title, specific technical stack, and well-defined responsibilities.
Must haves
- Strong expertise in Apache Kafka / Confluent Kafka
- Experience with Apache Flink or Apache Beam
- Hands-on experience in PySpark Streaming
- Knowledge of Python or Java programming
- Experience with Cloudera CDP and Kubernetes
Tools and skills
About the company
unfamiliar company, default mid-tier