You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness and business value.
You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
You participate in early state design and feature definition activities.
Responsible for implementing robust data pipeline using Microsoft, Databricks Stack.
Responsible for creating reusable and scalable data pipelines.
You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
Skills
Advanced working knowledge and experience with relational and non-relational databases.
Experience building and optimizing Big Data data pipelines, architectures and data sets.
Strong analytic skills related to working with unstructured datasets.
Strong experience in Azure Datafactory, Databricks, Eventhub, Python, PySpark, Synapse and SQL.
Azure Devops experience to deploy the ADF pipelines.
Qualifications and Experience
Minimum 3-5 years of relevant experience.
Bachelor’s degree.
Knowledge/Experience with Azure cloud stack.
Company: Techcarrot
Employment Type: Full Time
Education Level: Bachelor
Experience: 3 Years
Job Type: IT
Beware of fraud agents! do not pay money to get a job
MNCJobsGulf.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.