As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust ETL pipelines, transforming raw data into actionable insights. You will work closely with stakeholders to facilitate data integration and ensure data quality across platforms. The ideal candidate will have a strong technical background and a passion for data engineering.
Key Responsibilities
:
Design and implement ETL pipelines using Data Bricks and Azure Data Factory.
Manage and optimize data storage solutions with SQL Server.
Collaborate with cross-functional teams to gather data requirements and implement data solutions that support broader business objectives.
Develop and maintain scalable data architectures and workflows.
Utilize DevOps practices to automate data operations and enhance deployment processes.
Write and optimize Python scripts for data processing and analysis.
Monitor and troubleshoot data pipelines to ensure data accuracy and availability.
Stay current with industry trends and technologies to continuously enhance data engineering practices.
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
6+ years of experience in data engineering or a similar role.
Strong proficiency in Data Bricks and SQL Server.
Hands-on experience with Azure Data Factory for data integration and transformation.
Demonstrated experience in developing and maintaining ETL pipelines.
Familiarity with DevOps practices and tools.
Proficient in Python scripting for data manipulation and analysis.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Solid hands-on experience with the following technologies:
Data Bricks
SQL Server
Azure Data Factory
ETL pipeline development and management
DevOps practices and tools
APPLY AS SOON AS POSSIBLE!
Job Type: Full-time
Pay: AED15,000.00 - AED17,000.00 per month
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.