AI Engineer

Summary

Andersen is hiring an AI Engineer to enhance a cloud-based collaboration platform by building scalable AI infrastructure and intelligent features that improve performance, analytics, and reliability.

The customer is an international company delivering professional and technology-enabled solutions that support effective collaboration, structured communication, and operational efficiency for organizations. It operates in a fast-growing environment, focusing on scalability, security, and continuous improvement while developing digital platforms used by diverse clients worldwide.

The project is focused on enhancing a secure, cloud-based board management platform with intuitive meeting tools, real-time collaboration, and advanced analytics. It also includes building and maintaining scalable AI infrastructure, orchestration patterns, and observability to ensure reliable and intelligent platform performance.

Responsibilities

• Translating product requirements into AI workflows and quality criteria.
• Designing, implementing, and optimizing prompts using LangFuse.
• Building evaluation datasets from real customer scenarios.
• Establishing quality gates and measurement systems (precision, recall, accuracy).
• Setting up and maintaining LangFuse for observability and prompt experimentation.
• Tuning workflows based on production telemetry and evaluation results.
• Partnering with Product and QE on acceptance criteria and test strategy.

Requirements

• Experience as an AI Engineer, LLM Application Engineer or in a similar role for 4+ years.
• Proven experience designing and implementing AI/LLM‑based workflows in production environments.
• Strong understanding of prompt engineering, including prompt optimization, evaluation, and experimentation (experience with LangFuse is a strong advantage).
• Demonstrated ability to translate product requirements into structured AI workflows, quality criteria, and evaluation plans.
• Hands‑on experience building evaluation datasets, preferably derived from real customer interactions or behavioral data.
• Solid understanding of quality metrics for LLM applications (e.g., precision, recall, accuracy, hallucination rate) and how to operationalize them.
• Experience setting up observability and monitoring for LLM systems, ideally using LangFuse or similar platforms.
• Ability to tune prompts, workflows, and system behavior based on telemetry, evaluations, and production performance data.
• Experience collaborating closely with Product, Quality Engineering, and cross‑functional teams to define acceptance criteria and test strategies.
• Proficiency with LLM frameworks and tooling (e.g., LangChain, LlamaIndex, Semantic Kernel, custom orchestration).
• Strong Python skills and familiarity with modern ML/AI development practices.
• Level of English – from Upper-Intermediate and above.

Desired skills

• Experience working with vector databases, embeddings, retrieval systems (RAG), or prompt‑based pipelines.
• Familiarity with API integrations, model routing, and workflow automation.
• Understanding data quality, dataset curation, and annotation best practices.
• Exposure to evaluation tooling (e.g., LangFuse evals, TruLens, Ragas, custom evaluators).

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn an additional up to 1,000 USD per month by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!

Locations

Worldwide