Job Description

Job Title:(Big Data) Real-Time Data Warehouse Development Engineer

Job Responsibilities:

Plan, design, and implement real-time data systems to support the department's user growth initiatives, delivering both real-time and batch data solutions for business teams. Develop real-time data marts and business metrics for user growth-related analytics. Optimize the performance and stability of real-time data processing and data services to ensure reliable delivery of business-critical data.

Job Requirements:

Blockchain Technology

: Have an understanding of core concepts such as blockchain encryption technology and distributed ledgers. Be familiar with the relevant mechanisms and principles of blockchains like Bitcoin, Ethereum, and Solana.

Big Data

: Be proficient in commonly used distributed systems within the big data ecosystem, such as Kafka,Spark, Flink, SelectDB, StarRocks, etc., and be familiar with their working principles and performance optimization. Master data warehouse modeling and ETL development processes, and be able to design and optimize data storage and management solutions to adapt to the characteristics of blockchain data. Possess knowledge related to data mining and machine learning, and be able to use algorithms to extract valuable information from massive blockchain data.

Programming Languages

: Be proficient in at least one programming language, such as Java, Python, Go, etc., for developing big data processing programs, blockchain smart contracts, and interacting with various systems. Be familiar with programming libraries for interacting with the blockchain, such as Web3.js or Web3.py, and be able to read, write, and analyze on-chain data. Solid foundation in computer science, programming, and data structures/algorithms, with strong engineering discipline and efficient problem-solving skills. Proficient in mainstream big data and streaming data processing technologies with hands-on experience in building and maintaining distributed systems such as Flink, Storm, Flume, Kafka, etc. Good understanding of data warehouse architecture, data modeling methodologies, and data governance practices. Strong passion for data-driven insights with the ability to abstract and understand business logic. Strong command of database concepts, with proven experience in SQL and ETL development. Familiar with at least one OLAP engine such as Elasticsearch (ES), HBase, Druid, Doris, or Hologres; proficient in at least one programming language such as Java, Scala, or Python. Experience in real-time data development in the blockchain industry is a plus. Must be based in or willing to work from our office located in ADGM, Abu Dhabi.
Job Type: Full-time

Pay: AED15,000.00 - AED25,000.00 per month

Application Question(s):

Do you have at least 8 years of overall work experience, including a minimum of 2 years in blockchain-related big data development?
Yes / No

Which OLAP engines are you proficient in? (Select all that apply)
SelectDB

StarRocks

Doris

Hologres

Others (please specify): ______

None

Do you have at least 2 years of hands-on experience using Apache Flink in a production environment?
Yes / No