Our client is known as the Work Life Platform, they are one of the leading employee benefits SaaS platforms that is on a constant mission to make a world class employee experience accessible to every company. They are redefining the way work works for the better, making automated HR, Payroll, Employee Benefits, and Insurance a possibility for all businesses. They are looking for a Lead Data Engineer to Join their team.
Duties and Responsibilities
Designing the data model for data collection in the data warehouse
Data Collection and data storage from existing and new data sources to the Data Warehouse and Data Lakes
Building ETL solutions to enable batch processing and real-time data processing.
Maintaining data pipelines and monitoring data quality through Data Fitness, Data Lineage, Data Governance, and Data Stability
Performing query performance tuning on the data warehouse for faster and reliable data querying through BI tools
Using Master Data Management techniques like Customer 360 to integrate all the customer data and interactions to have a comprehensive view of customers to provide a personalized user experience.
Building automation workflows and integrations for data transfer to various tools and applications
Requirements
Relevant experience of over 6 years
Experience in SQL and programming languages like Python and Scala
Experience in managing data warehouse and building data models.
Experience with 3NF, Dimensional Models, and Data Vault
Expertise in building ETL pipelines
Experience in workflow management platforms like Airflow
Experience with engineering processes like Unit Testing and CI/CD
Experience with Data Lake Technologies like Big query
Outstanding critical thinking and analytical skills
Self-motivated with the ability to work independently as well as in a team and comfortable in a dynamic environment.
Efficiently organized and detail-oriented, able to ensure quality and accuracy of the output.
Ability to build strong relationships with colleagues, effectively collaborating across departments.