Data Engineer (India)
ВакансіїSummary
Andersen is hiring a Data Engineer in India for a project with a Georgian digital bank. The role involves data infrastructure modernization and support for analytics in a mobile-first environment.
The customer is a rapidly growing digital financial platform that operates entirely through mobile applications, without any physical branches. The company has been providing convenient and secure financial services, including quick loans, money transfers, utility payments, and card management, all without bureaucracy or hidden fees.
The project is modernizing data infrastructure by migrating legacy pipelines to a new platform, implementing an on-premises LakeHouse architecture, applying PII anonymization/tokenization, and developing analytics applications for users and automated systems.
Responsibilities
- Designing and optimizing ETL/ELT pipelines using SQL and Python.
- Migrating legacy pipelines to a modern data platform.
- Implementing an on-prem LakeHouse using Delta Lake/Apache Iceberg.
- Ensuring PII anonymization/tokenization for data security.
- Developing real-time/batch processing solutions with Spark/Flink/Kafka.
- Deploying and managing cloud data infrastructure (AWS/Azure) using Docker.
- Building analytics applications with PostgreSQL/ClickHouse/Trino.
- Maintaining and automating workflows with Apache Airflow.
Requirements
- Experience in data engineering or a related field for 5+ years.
- Strong experience with SQL and Python for data processing.
- Hands-on experience with Apache Spark, Flink and Kafka for real-time and batch data processing.
- Experience working with cloud environments (AWS, Azure) and object storage solutions (MinIO).
- Understanding of RDBMS and SQL Engines like PostgreSQL, MS SQL, ClickHouse, and Trino.
- Experience with Docker.
- Knowledge of Apache Airflow.
- Familiarity with Delta Lake and Apache Iceberg for data lake implementations.
- Level of English – from Intermediate+.
Desired skills
- Experience with Elasticsearch for search and analytics.
- Exposure to DBT for analytics engineering.
- Experience working with Scala in data engineering projects.
Reasons to join us
- Andersen cooperates with such businesses as Siemens, Johnson & Johnson, AstraZeneca, BNP Paribas, Allianz, Ryanair, TUI, Verivox, etc..
- For the past four years, our company has been growing annually by 60%-100%, and we constantly involve top-notch specialists in our team.
- We have been strengthening our expertise since 2007. During this time, we have formed excellent teams with streamlined processes, where you can learn something new from your colleagues every day and enjoy your work.
- The company has mentoring and adaptation systems for each new employee. Our transparent performance review and assessment systems will allow you to determine your development path and plan your growth.
- The most important thing that we value in our employees is a commitment to continuous learning. The company supports them in this and gives them access to the best educational platforms, seminars, and practices. In addition, for over 17 years, Andersen has assembled a huge knowledge base and established a robust resource management institution.
- Our employees are provided with a benefit package and an extensive set of bonuses.
- We at Andersen have many different ways to grow. You can improve as a specialist or a manager, and all your activities will be decently rewarded.
- Work format: Onsite job from the office located in Bangalore.
Join us!
Будемо раді бачити вас!
Ми обробляємо персональні дані відповідно до GDPR
Продовжуєш шукати вакансію мрії в ІТ? Тоді натисни тут, щоб побачити повний перелік вакансій у команді Andersen. У нас постійно відкриваються нові позиції!