Software engineer to data engineer transitioning
Hey Guys, I have worked as a backend software engineer for 5 years, tech stack includes, spring boot,Java, SQL, docker, Apache Kafka, rest APIs.
However I have had bad luck twice now, after I switched from my first company, I got stuck in a super complex project where the business logic was just beyond anyone to implement, I had quit from there and after that I got in a service based company where I got stuck in a legacy java app where the environment was very toxic, shitty managers sucking up to client and putting all pressure on us.
I don't think software is for me or I'm getting stuck in the wrong places not sure, but I'm thinking of switching to data engineering as I believe it is repetitive work and might be less stressful compared to software engineering.
For anyone working in data engineering, how should I start learning it as a beginner and what courses should I do, which tech stack to focus on, basically I wanted to know how to start getting into this field.
Is it less stressful compared to software? I don't care about repetitive work, I just want to have peace of mind now. Let me know your thoughts and any good culture companies that hire for data engineers.
One interview, 1000+ job opportunities
Take a 10-min AI interview to qualify for numerous real jobs auto-matched to your profile 🔑
- As compared to development, it can be less stressful as you have to build/connect pipelines and do data transformation. ( as per my little experience)
- You might require SQL ,python, AWS sagemaker, databricks platform etc. for which there are good courses in yt and udemy
- A lot of companies hire data engineers namely MasterCard, Nielsen etc. you can try on those companies though they say you need to have experience with a similar domain or as a data engineer.
I can refer you to Eli Lilly