Network Big Data Sr. Engineer Vois
Cairo, Egypt
Job Description
Role purpose: The Sr Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides expert guidance and delivers through self and others to:
1. Integrate the necessary data from several sources necessary for analysis and for Technology actions
2. Build applications and products that make use of large volumes of data and generate outputs that allow actions that generate incremental value
3. Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and support) to speed up delivery in the Big Data Programme, assuring quality, performance and alignment to the Group technology blueprint of components releases in the platform
4. Support stakeholders and functions in obtaining benefiting business value from the operational data
Key accountabilities and decision ownership
Core competencies, knowledge and experience
Must have technical / professional qualifications:
#_VOIS
1. Integrate the necessary data from several sources necessary for analysis and for Technology actions
2. Build applications and products that make use of large volumes of data and generate outputs that allow actions that generate incremental value
3. Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and support) to speed up delivery in the Big Data Programme, assuring quality, performance and alignment to the Group technology blueprint of components releases in the platform
4. Support stakeholders and functions in obtaining benefiting business value from the operational data
Key accountabilities and decision ownership
- Designing and producing high performing stable end-to-end applications to perform complex processing of batch and streaming massive volumes of data in a multi-tenancy big data platform in the cloud (Hadoop on-premises will be consider), and output insights back to business systems according to their requirements.
Core competencies, knowledge and experience
Bachelor degree in Computer Science, Engineering or a related subject
- Experience of working on projects that span multi-disciplinary areas of differing size and complexity to meet business expectations and deliver results
- Confident and able to liaise and influence at all levels within Vodafone and/or relevant customer organizations
- Able to communicate effectively across organisational, technical and political boundaries, understanding the context
- Understands business requirements, Drives improvements and process innovation
Must have technical / professional qualifications:
Expert level experience with Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn); Cloudera distribution; experience with similar cloud provider solutions also considered (AWS, GCP, Azure)- Strong hands-on software development experience in Python programming; Scala, Java desirable
- Excellent knowledge in UNIX/Linux administration and bash scripting
- Expert skill level on Apache Nifi, Apache Kafka, CDAP, Apache Spark, Python programming, bash scripting, Apache Airflow
- Very Good knowledge with data movement techniques and best practices to handle large volumes of data.
- Experience with data warehousing architecture and data modelling best practices.
- Experience with File Systems, server architectures, and distributed systems.
- Google Cloud certified Professional Data Engineer and/or Cloud Architect
#_VOIS
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1444362
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationCairo, Egypt
-
EducationNot mentioned