Data Engineer
Dubai, United Arab Emirates
Job Description
Overview / Responsibilities:
Job Objective
Collects, consolidates and migrates data from multiple and different types of sources so it can be put in one place for use in machine learning model generation and application building, to programmatically analyze and discover business insights. Integrates, rearranges and consolidates large volumes of data over many systems, providing a new unified information base for business intelligence. Develops, constructs, tests and maintains architectures, such as databases and large-scale processing
systems.
Collects, consolidates and migrates data from multiple and different types of sources so it can be put in one place for use in machine learning model generation and application building, to programmatically analyze and discover business insights. Integrates, rearranges and consolidates large volumes of data over many systems, providing a new unified information base for business intelligence. Develops, constructs, tests and maintains architectures, such as databases and large-scale processing
systems.
Responsibilities
1) Creates data sets by extracting large amounts of raw data from multiple different operational systems and copying into a data warehouse, application or database system.
2) Cleans data to identify and remove human, machine or instrument errors, validate records, apply formatting and remove codes that are system-specific.
1) Creates data sets by extracting large amounts of raw data from multiple different operational systems and copying into a data warehouse, application or database system.
2) Cleans data to identify and remove human, machine or instrument errors, validate records, apply formatting and remove codes that are system-specific.
3) Transforms data by converting data from its previous forms into a new form that can be placed in a database, using rules, lookup tables etc
4) Loads cleaned data into target database.
5) Recommend and implement ways to improve data reliability, efficiency, and quality. Employ a variety of languages and tools to marry systems together or try to hunt down opportunities to acquire new data from other systems.
6) Ensure that the architecture that is in place supports the requirements of the data scientists and the client.
7) Develop data set processes for data modeling, mining, and production. Skills / Qualifications:
4) Loads cleaned data into target database.
5) Recommend and implement ways to improve data reliability, efficiency, and quality. Employ a variety of languages and tools to marry systems together or try to hunt down opportunities to acquire new data from other systems.
6) Ensure that the architecture that is in place supports the requirements of the data scientists and the client.
7) Develop data set processes for data modeling, mining, and production. Skills / Qualifications:
Knowledge, skills and experience
1) Comfortable exploring engineering and sensor data from equipment and machines (e.g. pressures, temperatures, flowrates, fluid densities) to derive insight (working alongside various subject matter experts internal and external to the business).
2) High STEM performer with strong mathematical track record.
1) Comfortable exploring engineering and sensor data from equipment and machines (e.g. pressures, temperatures, flowrates, fluid densities) to derive insight (working alongside various subject matter experts internal and external to the business).
2) High STEM performer with strong mathematical track record.
3) Track record (reference projects from workplace, academia, etc.) working with at least one high-level rapid prototyping language such as R or Python
4) Knowledge of a scalable/Big Data language such as Scala/Spark (not essential but would be an advantage).
5) Working knowledge of at least one main-stream cloud computing service such as Microsoft Azure or Amazon Web Services (not essential but would be an advantage).
6) Strong visualization and presentation layer design skills and appreciation. ETL (Extract, Transform, Load) skillset
4) Knowledge of a scalable/Big Data language such as Scala/Spark (not essential but would be an advantage).
5) Working knowledge of at least one main-stream cloud computing service such as Microsoft Azure or Amazon Web Services (not essential but would be an advantage).
6) Strong visualization and presentation layer design skills and appreciation. ETL (Extract, Transform, Load) skillset
7) Experienced with with database systems, data API\'s and ETL tools
Experienced in data modeling and setting up data warehouse solutions
8) Working knowledge of operational data tools such as SAP, Oracle, Cassandra, MySQL, Redis, Risk, PostgreSQL, MongoDB, neo4j, Hive, and Sqoop.
9) Competent in high level programming language such as Scala, Java, and C#.
10) Experience working with large and complex data sets.
11) Experience working with data and features derived from engineering/industrial sources.
12) Experience building and deploying machine learning models to solve problems.
Experienced in data modeling and setting up data warehouse solutions
8) Working knowledge of operational data tools such as SAP, Oracle, Cassandra, MySQL, Redis, Risk, PostgreSQL, MongoDB, neo4j, Hive, and Sqoop.
9) Competent in high level programming language such as Scala, Java, and C#.
10) Experience working with large and complex data sets.
11) Experience working with data and features derived from engineering/industrial sources.
12) Experience building and deploying machine learning models to solve problems.
Personal attributes
1) Be passionate about delivering high quality work
2) Self-motivated, enthusiastic and committed to delivering first class services
3) Able to work autonomously Company Overview:
1) Be passionate about delivering high quality work
2) Self-motivated, enthusiastic and committed to delivering first class services
3) Able to work autonomously Company Overview:
Wood is a global leader in consulting and engineering, helping to unlock solutions to critical challenges in energy and materials markets. We provide consulting, projects and operations solutions in 60 countries, employing around 35,000 people. www.woodplc.com Diversity Statement:
We are an equal opportunity employer that recognises the value of a diverse workforce. All suitably qualified applicants will receive consideration for employment on the basis of objective criteria and without regard to the following (which is a non-exhaustive list): race, colour, age, religion, gender, national origin, disability, sexual orientation, gender identity, protected veteran status, or other characteristics in accordance with the relevant governing laws.
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1506119
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationDubai, United Arab Emirates
-
EducationNot mentioned