Data Engineering

I want to become a serious cracked level Data Engineer.

I'm decent at PySpark, built some pipelines. Recently, I overcame a professional hurdle by actually going slightly deep into the engineering architecture of PySpark and wrote some good SQL queries that solved a critical problem.

I want to go deep in Big Data management and architecture.

I also started brushing up on System Design to understand other software architecture so that I can become better.

Any advice for me to learn more and become better would go a long way.