AI Data Engineer

Summary

Andersen is hiring an AI Data Engineer for a project enhancing data and AI platform, improving data quality, accessibility, and analytics for supply chain operations.

The customer is a large international company operating in the commodities and supply chain sector, managing complex processes across sourcing, production, logistics, and global distribution. The business is focused on sustainability, efficiency, and innovation, while actively investing in digital transformation, cloud technologies, data platforms, automation, and analytics. It offers opportunities to work on large-scale technology solutions supporting critical operations worldwide.

The project focuses on enhancing and optimizing the client’s existing data and AI platform within the agriculture and commodities domain. The team will work with large-scale datasets related to crop production, supply chains, and sales operations to improve data quality, accessibility, and analytical capabilities.

Responsibilities

• Designing and implementing data pipelines for AI and ML workloads using Azure Data Factory and Synapse Analytics, ensuring reliable data ingestion and transformation.
• Developing and maintaining ETL/ELT processes using SQL, Python, and Spark to process large-scale datasets for machine learning use cases.
• Building and managing data pipelines that support ML models, including data preparation, feature generation, and delivery to training and inference systems.
• Working with Azure Data Lake and Blob Storage to store, organize, and optimize structured and unstructured data for AI applications.
• Collaborating with AI engineers and data scientists to ensure data availability, quality, and consistency across the machine learning lifecycle.
• Implementing and maintaining feature stores and data versioning strategies, enabling reproducibility and traceability of ML experiments.
• Ensuring compliance with data governance and security standards in Azure, including access control, data protection, and auditing.
• Monitoring and optimizing data pipelines for performance, scalability, and cost-efficiency, identifying and resolving bottlenecks.
• Supporting integration of data pipelines with downstream systems, including model training, deployment, and analytics platforms.

Requirements

• Experience as a Data Engineer for 4+ years.
• Hands-on experience with Azure Data Factory and Azure Synapse Analytics.
• Experience with data ingestion and transformation for AI/ML workloads.
• Strong proficiency in SQL, Python, and Spark for large-scale data processing.
• Experience building and managing data pipelines for machine learning models.
• Knowledge of Azure Data Lake and Azure Blob Storage.
• Understanding of data governance and security in Azure environments.
• Experience with feature stores and data versioning for ML solutions.
• Level of English – from Intermediate+ and above.

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!

Локации

Worldwide