Job Description

A leading global market leader is hiring for the below:
Job Code: JPC- 3469
Role: Data Engineering Lead/ Specialist
Location: Abu Dhabi
Contract Duration: 1 Year and renewable
Payroll: Sundus
Experience: 7+ years
Education Required: Bachelors Degree, Masters Degree
Position Overview

• Client's Technology Services are seeking an accomplished Data Engineering Lead with extensive hands-on experience in Azure Cloud services, including Azure Data Lake, Synapse Analytics, Azure SQL Database, Azure Blob Storage, Azure Logic Apps, ETL processes, and PowerBI.
• The ideal candidate will also possess demonstrable experience in Agile methodology, serving as a Scrum Master, and utilizing Azure DevOps.
• This role will be supported by both onsite and offsite resources (Client and vendor). It is pivotal in our organization's data strategy with responsibility for transforming complex data into actionable insights through compelling visualizations and ensuring effective communication with business stakeholders.

Responsibilities
Data Architecture & Engineering:

• Design and implement data architecture solutions for Azure Synapse Analytics and Azure SQL Database.
• Define data models, schemas, and structures to optimize data storage and retrieval.
• Ensure data pipelines and ETL processes align with architectural requirements.
• Provide guidance on data governance, security, and compliance best practices.
• Develop and maintain data pipelines for ingesting, transforming, and loading data into Azure Synapse Analytics and Azure Data Lake Storage.
• Implement data integration solutions using tools such as Rackspace Guzzle and Azure Blob Storage.
• Optimize data workflows for performance, scalability, and reliability. Collaborate with the Data Architect to ensure data architecture principles are applied consistently.

Azure Cloud Expertise:

• Architect scalable and efficient data solutions using Azure Cloud services including Azure Data Lake, Synapse Analytics, Azure SQL Database, Azure Blob Storage, and Azure Logic Apps.
• Design and implement data pipelines to ingest, process, and store data from various sources into Azure-based environments.
• Optimize data storage, retrieval, and processing for performance and cost efficiency.

ETL Processes:

• Design, develop, and maintain ETL processes to extract, transform, and load data from disparate sources into Azure Data Lake and Azure SQL Database.
• Ensure data integrity, consistency, and quality throughout the ETL process by implementing robust validation and error handling mechanisms.
• Monitor ETL jobs for performance and reliability, troubleshooting and resolving issues as needed.

Oversee Design and Development of Visualizations:

• Help the team to:
• Create interactive dashboards, reports, and visualizations using PowerBI to deliver actionable insights to senior stakeholders within client.
• Collaborate closely with business users to understand their requirements and translate them into effective visualization solutions.
• Utilize best practices in data visualization to present complex data in a clear, concise, and visually appealing manner.

Business Analysis:

• Gather and document business requirements for data analytics and reporting.
• Liaise between business stakeholders and technical teams to ensure alignment of solution design with business needs.
• Conduct data analysis and data profiling to identify trends, patterns, and insights. Create user stories, use cases, and functional specifications for Power BI reports and dashboards.

Agile Methodology and Scrum Master / Team Lead Responsibilities:

• Lead the Agile development process as a Scrum Master, facilitating daily stand-ups, sprint planning, sprint reviews, and retrospectives.
• Drive the adoption of Agile best practices, ensuring the team delivers high-quality solutions on time and within scope.
• Collaborate with Product Owners to prioritize backlog items, define user stories, and establish acceptance criteria.
• Coordinate with the team to ensure delivery achieves customer delight.

Azure DevOps Utilization:

• Utilize Azure DevOps for project management, source control, continuous integration, and continuous deployment.
• Configure and maintain Azure DevOps pipelines for automated build, test, and deployment processes.
• Monitor and optimize Azure DevOps workflows to streamline development activities and enhance productivity.

Stakeholder Communication and Engagement:

• Communicate effectively with business stakeholders at client premises to understand their data visualization needs, gather feedback, and ensure alignment with business objectives.
• Present data visualizations and insights in a clear and understandable manner, catering to different levels of stakeholders.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, or a similar STEM subject.
• Minimum of 7 years of experience in data visualization, Azure Cloud services, ETL processes, PowerBI, Agile methodology, and Azure DevOps.
• Experience working as a Scrum Master and strong understanding of Agile principles and practices.
• Proficiency in running projects and deliverables from Azure DevOps
• Expertise in designing and developing interactive dashboards, reports, and visualizations using PowerBI.
• In-depth knowledge of Azure Cloud services including Azure Data Lake, Synapse Analytics, Azure SQL Database, Azure Blob Storage, and Azure Logic Apps.
• Strong written and verbal communication skills with experience in engaging with business stakeholders at all levels of an organisation.
• Proven leadership experience, with the ability to lead and mentor a team of data professionals.

Skills Required