Job Description

Position Summary

We are seeking a skilled

Data Engineer

with strong expertise in building and managing

ETL/ELT pipelines using PySpark

within an

AWS cloud environment

. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data workflows to support multiple data sources, while ensuring seamless integration with

Power BI

for reconciliation, reporting, and advanced analytics.

Key Responsibilities

Data Pipeline Development

o Design, develop, and maintain scalable

ETL/ELT pipelines

using

PySpark

.

o Implement data ingestion from multiple data sources (Finance, CRM, Payment Gateways, etc.) into AWS Data Lake/Warehouse.

o Ensure efficient

data partitioning, schema management, and optimization

for large datasets.

Cloud & Infrastructure (AWS)

o Leverage

AWS services

(S3, Glue, EMR, Redshift, Lambda, Step Functions) for data engineering workflows.

o Implement

data security, access control, and compliance

in line with organizational standards.

o Automate deployments using

CI/CD pipelines

.

Data Integration & Reporting

o Prepare curated datasets for

Power BI dashboards

and reports.

o Enable reconciliation processes by providing granular, auditable datasets.

o Collaborate with BI developers to ensure data accuracy, integrity, and performance in reporting.

Collaboration & Process

o Work closely with

Business Analysts, Data Scientists, and ERP functional teams

to understand requirements.

o Participate in

data governance initiatives

, ensuring metadata, lineage, and quality controls are implemented.

o Provide support for

ad-hoc analytics requests

from stakeholders.

Required Skills & Qualifications

Technical Skills

o Strong programming in

Python

with deep knowledge of

PySpark

.

o Proven experience in

ETL/ELT pipeline development

in distributed environments.

o Expertise in

AWS data services

(S3, Glue, EMR, Redshift, Athena, Lambda, Kinesis).

o Proficiency in

SQL (analytical queries, optimization, tuning)

.

o Familiarity with

Power BI integration

(Direct Query, Dataflows, Gateways).

Data Engineering Practices

o Experience with

data lakes, warehouses, and star/snowflake schema design

.

o Knowledge of

data quality frameworks, reconciliation processes, and auditability controls

.

o Hands-on experience with

workflow orchestration tools

.

Soft Skills

o Strong problem-solving and analytical skills.

o Ability to collaborate across IT, business, and analytics teams.

o Clear communication for technical and non-technical stakeholders.

Preferred Qualifications

Experience with

ERP data models

(Finance, CRM - Reconciliation).

Exposure to

machine learning data preparation

(feature engineering, training/test datasets).

Certification(s):

o AWS Certified Data Analytics - Specialty

o Databricks/Spark Developer Certification

o Microsoft Power BI Data Analyst Associate

Job Type: Full-time

Ability to commute/relocate:

Ajman: Reliably commute or planning to relocate before starting work (Preferred)
Application Question(s):

Availability to start immediately Visa Status
Experience:

Data Engineer: 3 years (Preferred)
Language:

* English (Preferred)