We are looking for a Snr Data Consultant with over 5 year of experience in working with data and delivering business analytics projects to clients. Needs to have the ability to manage the project\xe2\x80\x99s tasks and deliverables, work with team members and be accountable of technical and architectural decisions. Ability and experience working in agile /scrum methodology
Design and maintain cloud, on-premises, and hybrid data platform architectures
Identify, design and implement full data warehouse and Big Data solutions
Design and maintain optimal data pipeline architectures for batch and real-time processing
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
Work in a customer facing environment alongside with technical and business stakeholders to assist with data-related needs
Manage the workload of team members though productivity and collaborations tools such as DevOps and JIRA
Execute regular work review and coaching of team members
Provide regular and effective progress updates to and work closely with Project Managers to ensure the management of any delivery risks or issues
Take responsibility for making key decisions to ensure the successful implementation of all initiatives
Contribute and support the business development team with solution design, budget and high-level schedule
Strong hands-on experience on implementing modern data platform solutions
Experience supporting and working with cross-functional teams in a dynamic environment
Capable of leading data initiatives and communicate clearly with business stakeholders
Ability to work efficiently without supervision
Advanced working SQL and Python knowledge and experience working with relational and unstructured databases and, query authoring (SQL) and Pyspark as well as working familiarity with a variety of databases
Experience building and optimizing data pipelines, architectures and data sets
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
Build processes supporting data transformation, data structures, metadata, dependency and workload management
Technical aspects of Data Governance including glossary, metadata, data quality, master data management & data lifecycle management
Security, authentication and authorization
Experience working in agile/scrum setup
Experience with Azure Devops or any other Devops practice
Experience building and maintaining Data Lakes
Experience building and maintaining Azure Data Lakes and Synapse Azure environments
Experience with Data Lineage and Data cleansing tools \xe2\x80\x93 CluedIn preferred
Software / Tools experience required:
Extensive experience with core Azure data cloud services: Data Factory, SQL DW, Azure Data Lake, Analysis Services, Databricks, Cosmos DB
Experience with relational SQL and NoSQL databases, including some of the following: SQL DW, SQL Database, SQL Server, Cosmos DB, and Snowflake
Experience with big data tools: Hadoop, Spark, Databricks
Experience with data pipeline and workflow management tools: SSIS, Data Factory, Talend, Informatica, etc.
Experience with stream-processing systems: Kafka, Azure Event Hub, Azure IoT Hub, Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, C# etc.
Experience with data visualization tools, mainly considering Power BI and Tableau
DevOps / DataOps and CI / CD frameworks
Proven knowledge on Machine Learning and AI
Experience with data lineage tools and data cleansing tools
Bayt
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.