TwirlyNoodle
TwirlyNoodle
23mo

Trending @Accenture; Seeking advice on Data Engineering

I am an emerging Data Engineer. I have got one offer in similar role and currently learning data engineering. I have 60 days notice left and still learning new concepts in data engineering everyday. Can you suggest me few key areas, tools and technology i should focus on.? Additionally, I am working on Azure cloud only.

23mo ago
JazzyBanana
JazzyBanana

What is your project skills in Accenture?

TwirlyNoodle
TwirlyNoodle

Currently working as lead for data engineers and data analyst, so i have understanding of how this whole process works. Although trying to learn more on this

SwirlyDonut
SwirlyDonut

Hello, Would like to have a discussion on azure related DE stuff and also need some insights from you 😅.

DerpyNugget
DerpyNugget
23mo

Go for Big Data , spark , Hadoop , Hive , Databricks

DizzyCoconut
DizzyCoconut
23mo

+1

TwirlyNoodle
TwirlyNoodle

I am currently learning databricks and data factory. Also learning about the architecture about the concepts in these.

DizzyCoconut
DizzyCoconut
23mo

As you are working on Azure learn about the ETL process and focus on using Azure Data Factory, Data flows, data lake, Logic Apps and more azure resources. Learn SQL or any other database for data ingestion. Also focus on different ways of data extraction, for instance take an example like - extracting and transforming data via python using Azure batch account and ingesting the transformed data in SQL/Snowflake database. Then after this the next topic should be Azure DevOps and I am not much familiar with Azure kubernetes but this one is also trending these days in azure.

TwirlyNoodle
TwirlyNoodle

Thank You for detailed information.

Discover more
Curated from across