We are looking for a skilled Data Engineer to design, optimize, and maintain efficient data structures that support high-performance data processing and retrieval. The ideal candidate will have a strong foundation in algorithms, databases, and programming, ensuring data integrity, scalability, and efficiency. Experience:
Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and load data from various sources into our data warehouse or data lake.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement solutions that support business insights and decision-making.
Optimize data pipelines and processes for performance, reliability, and scalability.
Design and implement data models, schemas, and metadata to support data governance and analytics requirements.
Monitor and troubleshoot data processing jobs, performance issues, and data quality problems.
Ensure data security, privacy, and compliance with regulatory requirements.
Stay updated on emerging technologies and best practices in data engineering
and contribute to the continuous improvement of our data infrastructure and processes.
Document technical specifications, data flows, and system architecture.
Experience with data security in the data management domain specially at the level of data lakes.
Experience with relational databases (e.g., MS SQL Server) and NoSQL databases (e.g., MongoDB, Cassandra).
Experience with cloud platforms (AWS, Azure, or GCP) and familiarity with DevOps
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.