Job Description

-------------------

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.

- Grade Specific

-------------------------------------

The involves leading and managing a team of data engineers, overseeing data engineering projects, ensuring technical excellence, and fostering collaboration with stakeholders. They play a critical role in driving the success of data engineering initiatives and ensuring the delivery of reliable and high-quality data solutions to support the organization's data-driven objectives.

Skills (competencies)

-------------------------

Ab Initio

Agile (Software Development Framework)

Apache Hadoop

AWS Airflow

AWS Athena

AWS Code Pipeline

AWS EFS

AWS EMR

AWS Redshift

AWS S3

Azure ADLS Gen2

Azure Data Factory

Azure Data Lake Storage

Azure Databricks

Azure Event Hub

Azure Stream Analytics

Azure Sunapse

Bitbucket

Change Management

Client Centricity

Collaboration

Continuous Integration and Continuous Delivery (CI/CD)

Data Architecture Patterns

Data Format Analysis

Data Governance

Data Modeling

Data Validation

Data Vault Modeling

Database Schema Design

Decision-Making

DevOps

Dimensional Modeling

GCP Big Table

GCP BigQuery

GCP Cloud Storage

GCP DataFlow

GCP DataProc

Git

Google Big Tabel

Google Data Proc

Greenplum

HQL

IBM Data Stage

IBM DB2

Industry Standard Data Modeling (FSLDM)

Industry Standard Data Modeling (IBM FSDM))

Influencing

Informatica IICS

Inmon methodology

JavaScript

Jenkins

Kimball

Linux - Redhat

Negotiation

Netezza

NewSQL

Oracle Exadata

Performance Tuning

Perl

Platform Update Management

Project Management

PySpark

Python

R

RDD Optimization

SantOs

SaS

Scala Spark

Shell Script

Snowflake

SPARK

SPARK Code Optimization

SQL

Stakeholder Management

Sun Solaris

Synapse

Talend

Teradata

Time Management

Ubuntu

Vendor Management