Data Engineer
Dubai, United Arab Emirates
Job Description
13167-Data Engineer
Experience: 5-8
Posted: 03 Feb,2023
Location: United Arab Emirates
Apply Now
Data Engineer
Work Location : Dubai
:
Roles & Responsibilities :
Knowledge, Skills & Abilities :
Experience:
:
- Data Factory, Stream Analytics, Databricks, SQL Database and PowerBI
- The Data Engineer will be accountable for crafting and overseeing data systems within Microsoft Azure. The objective is to guarantee effective data storage, handling, and accessibility for business intelligence and analytics needs. Collaborating with data scientists and stakeholders, they will create efficient, scalable data storage options, data pipelines, automated data processing systems, and reports utilizing PowerBI.
Roles & Responsibilities :
- Designing and implementing data storage solutions, such as data warehouses, data lakes, and databases.
- Building and maintaining data pipelines to extract, transform, and load data from various sources into data storage solutions.
- Writing code to automate data processing and ensure data quality.
- Ensuring the security and privacy of data through proper access controls and encryption.
- Collaborating with data scientists and other stakeholders to understand their data needs and implement data solutions to meet those needs.
- Monitoring data processing performance and identifying opportunities for optimization.
- Troubleshooting and resolving data processing and storage issues.
- Staying up to date with the latest data engineering technologies and industry trends.
- Participating in the design and implementation of data-driven applications and systems.
- Managing and maintaining data documentation, including data dictionaries and data flow diagrams
Knowledge, Skills & Abilities :
- Expertise in Azure data storage solutions such as Azure Blob Storage, Azure Data Lake Storage, and Azure SQL Database.
- In-depth knowledge of Azure data processing technologies such as Azure Data Factory, Azure Stream Analytics, and Azure Databricks.
- Familiarity with Azure security features such as Azure Active Directory and Azure Key Vault.
- Proficiency in programming languages such as SQL, Python, and ability to write complex scripts and data transformations.
- Good experience in big data technologies such as Apache Hadoop, Apache Spark, and Apache Kafka.
- Good experience with cloud migration strategies and methodologies.
- Proficiency in data modelling and data warehousing concepts.
- Ability to design and implement data pipelines, build scalable data integration solutions, and perform data transformations.
- Understanding of data governance and data management principles.
- Strong analytical, problem-solving, and troubleshooting skills.
- Expertise in Business Intelligence (BI) tools such as Power BI, Tableau, and MicroStrategy.
- Ability to designing and implementing BI solutions and dashboards.
- Knowledge of data visualization techniques and experience in creating interactive reports and dashboards.
- Understanding of data warehousing and data mining concepts.
- Strong ability to work with large data sets and perform data analysis.
Experience:
At least 4-8 years of Data engineering or Software development experience.
Qualifications :
Qualifications :
- Bachelor or master\xe2\x80\x99s degree in computer science or related field.
Required Skills
Skill
Years
Months
Data Engineer
8
0
Microsoft PowerBI
8
0
Apache Hadoop
8
0
Apache Spark
8
0
Apache Kafka
8
0
cloud migration strategies and methodologies.
8
0
Data Modelling
8
0
Data Warehousing
8
0
Tableau
8
0
MicroStrategy
8
0
Azure SQL database
8
0
Azure Data Lake Storage
8
0
Azure Blob Storage
8
0
Python
8
0
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1504508
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationDubai, United Arab Emirates
-
EducationNot mentioned