Data Engineer

Abu Dhabi, United Arab Emirates, United Arab Emirates

Job Description

General Responsibilities Design and maintain cloud, on-premises, and hybrid data platform architectures Identify, design and implement full data warehouse and Big Data solutions Design and maintain optimal data pipeline architectures for batch and real-time processing Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc Work in a customer facing environment alongside with technical and business stakeholders to assist with data-related needs Manage the workload of team members though productivity and collaborations tools such as DevOps and JIRA Execute regular work review and coaching of team members Provide regular and effective progress updates to and work closely with Project Managers to ensure the management of any delivery risks or issues Take responsibility for making key decisions to ensure the successful implementation of all initiatives Contribute and support the business development team with solution design, budget and high-level schedule

Job Specific Responsibilities Strong hands-on experience on implementing modern data platform solutions Experience supporting and working with cross-functional teams in a dynamic environment Capable of leading data initiatives and communicate clearly with business stakeholders Ability to work efficiently without supervision Advanced working SQL and Python knowledge and experience working with relational and unstructured databases and, query authoring (SQL) and Pyspark as well as working familiarity with a variety of databases Experience building and optimizing data pipelines, architectures and data sets Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement Build processes supporting data transformation, data structures, metadata, dependency and workload management Technical aspects of Data Governance including glossary, metadata, data quality, master data management & data lifecycle management Security, authentication and authorization Experience working in agile/scrum setup Experience with Azure Devops or any other Devops practice Experience building and maintaining Data Lakes Experience building and maintaining Azure Data Lakes and Synapse Azure environments Experience with Data Lineage and Data cleansing tools CluedIn preferred

Qualifications and Experience Bachelor of Science Degree in IT/Computer Science/ Computer Engineering. Minimum 7 years of relevant experience in Data Analysis and BI solutions preferred . Azure Certified (Data track) ex (dp-900, pl-200, DA-100). Experience in Azure-based data platform mainly Azure Data Factory, Azure SQL, and Azure Synapse Experience in Power BI and Cognos.

Beware of fraud agents! do not pay money to get a job

MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1619311
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Abu Dhabi, United Arab Emirates, United Arab Emirates
  • Education
    Not mentioned