Data Engineer (Abu Dhabi, UAE)

Summary

The IT company Andersen invites a Data Engineer to join its team for working with a company from the UAE.

This position requires on-site in the Abu Dhabi office, but we are also open to considering candidates from other countries for relocation.

The customer is a government entity that manages public affairs and oversees various corporate and philanthropic projects. The company is embarking on a transformative digital journey to enhance its operational efficiency and customer experiences.

The project focuses on digital transformation in the UAE to develop and support digital solutions, enhance social services, strengthen public engagement, advance international relations, and optimize administrative processes.

Technology stack: SQL, NoSQL, Hadoop, Spark, Kafka, Flink, Apache Airflow, dbt, Talend, Informatica, Azure Synapse, Delta Lake, Iceberg, Hudi.

Responsibilities

• Designing and managing data pipelines, ETL processes, and data storage solutions.
• Working with SQL, NoSQL, and big data technologies.
• Ensuring data quality, governance, and compliance with security standards.
• Collaborating with AI Engineers to prepare and process datasets for machine learning.
• Developing and optimizing scalable data architectures.
• Automating ETL/ELT workflows.
• Implementing data streaming solutions.
• Ensuring data security and compliance by implementing access controls, encryption, and monitoring.
• Monitoring and maintaining data pipeline performance, troubleshooting issues and optimizing workflows.
• Building and maintaining data warehouses and data lakes.
• Enabling self-service data access by designing and managing data catalogs and metadata systems.
• Optimizing query performance and indexing strategies.
• Managing data versioning and lineage tracking.
• Implementing CI/CD for data pipelines.
• Collaborating with DevOps teams to containerize and deploy data services.
• Supporting data scientists and analysts.

Requirements

• Experience as a Data Engineer for 2+ years.
• Strong experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra, Redis).
• Expertise in big data technologies (Hadoop, Spark, Kafka, Flink).
• Hands-on experience with ETL/ELT tools (Apache Airflow, dbt, Talend, Informatica).
• Proficiency in Python for data processing.
• Experience with cloud data platforms (Azure Synapse).
• Understanding of data modeling, indexing, and partitioning for performance optimization.
• Knowledge of data lake architectures (Delta Lake, Iceberg, Hudi).
• Familiarity with data security best practices (RBAC, encryption, GDPR, HIPAA compliance).
• Experience with data lineage, metadata management, and observability tools.
• Understanding of MLOps and data preparation for AI/ML applications.
• Level of English – from Upper-Intermediate and above.

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn additional up to 1,000 EUR per month by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!