Senior AI Engineer (Agent Framework)

Summary

Andersen is hiring a Senior AI Engineer (Agent Framework) to build scalable AI systems and orchestration solutions for a cloud platform, enabling intelligent automation and reliable performance.

The customer is an international company delivering professional and technology-enabled solutions that support effective collaboration, structured communication, and operational efficiency for organizations. It operates in a fast-growing environment, focusing on scalability, security, and continuous improvement while developing digital platforms used by diverse clients worldwide.

The project is focused on enhancing a secure, cloud-based board management platform with intuitive meeting tools, real-time collaboration, and advanced analytics. It also includes building and maintaining scalable AI infrastructure, orchestration patterns, and observability to ensure reliable and intelligent platform performance.

Responsibilities

• Translating product requirements into AI workflows and quality criteria.
• Designing, implementing, and optimizing prompts using LangFuse.
• Building evaluation datasets from real customer scenarios.
• Establishing quality gates and measurement systems (precision, recall, accuracy).
• Setting up and maintaining LangFuse for observability and prompt experimentation.
• Tuning workflows based on production telemetry and evaluation results.
• Partnering with Product and QE on acceptance criteria and test strategy.

Requirements

• Experience in software engineering for 5+ years, including deep expertise in .NET/C# and building production microservices in Azure.
• Experience in developing LLM-powered applications for 2+ years, including at least one production agentic or multi-step AI system.
• Bachelor's degree in computer science, Engineering, IT, or equivalent experience.
• Experience with Semantic Kernel or similar agent frameworks (e.g., LangChain, AutoGen).
• Strong understanding of prompt engineering, context management, and LLM behavior control.
• Experience in implementing guardrails (filtering, grounding, PII handling, policy enforcement).
• Familiarity with LLM evaluation methods (automated evaluations, LLM-as-judge, benchmarking).
• Experience with observability and tracing in AI systems (e.g., OpenTelemetry, Azure Monitor).
• Experience with API gateways (routing, rate limiting, failover), Azure API Management preferred.
• Understanding cloud-native architecture (event-driven systems, APIs, containers in Azure).
• Experience with AI-assisted development tools (e.g., Claude Code, PlayerZero).
• Level of English – from Intermediate+ and above.

Desired skills

• Experience with Model Context Protocol (MCP) — building servers, consuming tools, and managing resource exposure
• Solid understanding of Azure AI Search - index design, hybrid retrieval, semantic ranking, and integration patterns
• Familiarity with Microsoft Agent Framework or multi-agent coordination patterns
• Experience with Azure OpenAI Service, fine-tuning, or model deployment pipelines
• Experience with enterprise AI gateway platforms — Bifrost, LiteLLM, or comparable LLM proxy/routing infrastructure.
• Background in regulated or enterprise environments with strict compliance and safety requirements
• Contributions to open-source AI tooling or internal AI platform/enablement work

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn an additional up to 1,000 USD per month by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!

Lokalizacje

Worldwide