Data Engineer (Abu Dhabi, UAE)

Summary

Andersen is hiring a Data Engineer in Abu Dhabi to build a secure data platform supporting AI-driven supply chain analytics, forecasting, and scalable enterprise data integration.

The customer is an organization operating in the technology and consulting domain, supporting businesses with the implementation of digital initiatives and process improvements. The company delivers a range of services related to software solutions, system enhancements, and advisory support, helping clients adapt to evolving technological landscapes through flexible engagement approaches and scalable delivery models.

The project is focused on building a defense-grade data foundation to enable AI-driven supply chain intelligence. The team designs scalable Data Lakehouse infrastructure that integrates enterprise systems and complex datasets to support forecasting, analytics, and generative AI capabilities in a highly secure environment.

Responsibilities

• Architecting and deploying ingestion pipelines to extract high-volume transactional data from SAP S/4HANA, Ariba, and PLM systems, ensuring near real-time availability for forecasting models.
• Building connectors for external market intelligence feeds (e.g., S&P Global, Orbis, EcoVadis) to enrich internal procurement data with macroeconomic and geopolitical signals.
• Designing and implementing a standardized procurement data model and taxonomy across multiple entities, harmonizing fragmented datasets into a cohesive layer for analytics.
• Engineering pipelines to ingest and process unstructured technical data, including PDF tender documents, CAD metadata, and historical CONOPS, transforming them into vector-ready formats for RAG applications.
• Managing and optimizing Vector Databases to store embeddings of archival proposals and engineering snippets, ensuring high-speed retrieval for AI drafting assistants.
• Establishing data lineage and traceability protocols that link requirements to physical components, supporting the Model-Based Systems Engineering (MBSE) "Digital Thread".
• Implementing Role-Based Access Control (RBAC), audit logging, and data redaction policies to ensure compliance with export controls and strict on-premise security requirements.
• Deploying automated data quality frameworks to validate BOM (Bill of Materials) completeness and cost data accuracy before it reaches AI models.
• Optimizing pipelines for on-premise GPU clusters and air-gapped environments, ensuring efficiency within existing infrastructure limits.

Requirements

• Experience in Data Engineering for 5+ years, with 2+ years focused on building pipelines for ML or Generative AI applications in an enterprise setting.
• Expert proficiency in Python, SQL, and modern data engineering frameworks (Apache Spark, Kafka, Airflow).
• Strong experience extracting data from complex ERP environments, specifically SAP S/4HANA and SAP Ariba.
• Deep understanding of Data Lakehouse architectures (Databricks/Delta Lake), Relational Databases (PostgreSQL), and Vector Databases (Weaviate/Milvus).
• Experience building pipelines for RAG solutions, Conversational agents and classical ML models with tools like dbt, dagster, or prefect.
• Proficiency with containerization (Docker, Kubernetes) and CI/CD pipelines for deploying data workflows in secure environments.
• Ability to understand "Bill of Materials" (BOM) structures and procurement lifecycles.
• Ability to navigate the "Governance Collision" between agile data work and rigid systems engineering requirements, ensuring data deliverables meet formal Stage Gate reviews.
• Proven ability to work alongside Data Scientists and Backend Engineers to define data schemas that support predictive modelling and AI agents.
• Level of English – from Upper-Intermediate and above.

Desired skills

• Experience in Supply Chain, Manufacturing, or Defense sectors.
• Familiarity with SAP BTP.

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!

Locations

The united arab emirates