Big Data Lead / Architect
Smart Analytica is seeking a Big Data Architect to lead scalable data infrastructure projects. The role involves designing and optimizing distributed data processing pipelines using the Hadoop ecosystem and Spark/PySpark. You will collaborate with stakeholders to ensure platform security, scalability, and performance. This position requires deep technical expertise in data architecture and the ability to mentor team members in a fast-paced environment.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
7-15 years
Function
Engineering
Work mode
Onsite, India
Company
Tier 2
What you will work on
Smart Analytica is seeking a Big Data Architect to lead scalable data infrastructure projects. The role involves designing and optimizing distributed data processing pipelines using the Hadoop ecosystem and Spark/PySpark. You will collaborate with stakeholders to ensure platform security, scalability, and performance. This position requires deep technical expertise in data architecture and the ability to mentor team members in a fast-paced environment.
TAL's take
Solid mid-tier firm with clear architectural scope and specific, high-scale technical requirements.
Crisp JD with clearly defined technical stack, architectural expectations, and project-based context.
Must haves
- Strong expertise in Hadoop ecosystem technologies
- Experience with Spark, PySpark, and SQL
- Hands-on experience in distributed data processing
- Performance tuning of Spark jobs and SQL queries
- Experience in Hadoop cluster architecture and resource optimization
- Stakeholder management and technical leadership experience
Tools and skills
Nice to have: aws, azure, gcp.
About the company
Established niche data/AI services company, lacks global flagship unicorn or FAANG status.
Posts mentioning Smart Analytica
Transitioning out of Data Analytics
It's almost been one year since I starting working as a data analyst (first job overall) at a saas startup. It's been good so far, learnt a lot about business as well as data, but feeling kinda saturated now. I find growth/ product roles to be more attractive (direct impact on the growth of the org). But I'm an unsure where to start, and what are the skill sets that I need to have. Being in data I'm well versed with SQL, data pipelines and some business functions as well. If anyone has any thoughts, feel free to share!
Seeking Suggestions on KNIME Data Analytics tool
Hello Data Experts, I am excited to start my data analytics journey with KNIME, an analytics and ETL tool. As I explore this field, I’m seeking advice from experienced professionals: • How is KNIME as a tool for data analytics? • Does it have a promising future in the industry? • How easy is it to transition to other data analytics tools from here? I would love to hear about your experiences, suggestions, and insights on KNIME and the broader data analytics landscape. Your guidance will mean a lot to me as I navigate this path. Thank you!
DevOps or Data Analytics? Any suggestions would be greatly appreciated
I have been working at Big 4 for 3 years on OutSystems project (low-code/no code). Realized coding isn’t for me as i struggle with logic building so I’m looking to switch to a non-coding role. Currently considering DevOps or Data Analytics, but both are totally new, so I’d have to start from scratch. I’m currently at 10 LPA in NCR. Which one should I go for in terms of growth and package? If there’s some other good non coding field that may be good pls suggest . Any suggestions/recommendations would help! Thanks in advance