Senior AI Engineer (Agent Framework)

Вакансії
PLWarsaw1 Rondo Daszyńskiego00-843

Summary

Andersen is hiring a Senior AI Engineer (Agent Framework) to build scalable AI systems and orchestration solutions for a cloud platform, enabling intelligent automation and reliable performance.

The customer is an international company delivering professional and technology-enabled solutions that support effective collaboration, structured communication, and operational efficiency for organizations. It operates in a fast-growing environment, focusing on scalability, security, and continuous improvement while developing digital platforms used by diverse clients worldwide.

The project is focused on enhancing a secure, cloud-based board management platform with intuitive meeting tools, real-time collaboration, and advanced analytics. It also includes building and maintaining scalable AI infrastructure, orchestration patterns, and observability to ensure reliable and intelligent platform performance.

Responsibilities

  • Translating product requirements into AI workflows and quality criteria.
  • Designing, implementing, and optimizing prompts using LangFuse.
  • Building evaluation datasets from real customer scenarios.
  • Establishing quality gates and measurement systems (precision, recall, accuracy).
  • Setting up and maintaining LangFuse for observability and prompt experimentation.
  • Tuning workflows based on production telemetry and evaluation results.
  • Partnering with Product and QE on acceptance criteria and test strategy.

Requirements

  • Experience in software engineering for 5+ years, including deep expertise in .NET/C# and building production microservices in Azure.
  • Experience in developing LLM-powered applications for 2+ years, including at least one production agentic or multi-step AI system.
  • Bachelor's degree in computer science, Engineering, IT, or equivalent experience.
  • Experience with Semantic Kernel or similar agent frameworks (e.g., LangChain, AutoGen).
  • Strong understanding of prompt engineering, context management, and LLM behavior control.
  • Experience in implementing guardrails (filtering, grounding, PII handling, policy enforcement).
  • Familiarity with LLM evaluation methods (automated evaluations, LLM-as-judge, benchmarking).
  • Experience with observability and tracing in AI systems (e.g., OpenTelemetry, Azure Monitor).
  • Experience with API gateways (routing, rate limiting, failover), Azure API Management preferred.
  • Understanding cloud-native architecture (event-driven systems, APIs, containers in Azure).
  • Experience with AI-assisted development tools (e.g., Claude Code, PlayerZero).
  • Level of English – from Intermediate+ and above.

Desired skills

  • Experience with Model Context Protocol (MCP) — building servers, consuming tools, and managing resource exposure
  • Solid understanding of Azure AI Search - index design, hybrid retrieval, semantic ranking, and integration patterns
  • Familiarity with Microsoft Agent Framework or multi-agent coordination patterns
  • Experience with Azure OpenAI Service, fine-tuning, or model deployment pipelines
  • Experience with enterprise AI gateway platforms — Bifrost, LiteLLM, or comparable LLM proxy/routing infrastructure.
  • Background in regulated or enterprise environments with strict compliance and safety requirements
  • Contributions to open-source AI tooling or internal AI platform/enablement work

Reasons to join us

  • Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
  • The opportunity to change the project and/or develop expertise in an interesting business domain.
  • Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
  • Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
  • The opportunity to earn an additional up to 1,000 USD per month by participating in the company's activities.
  • Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
  • Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
  • Certification compensation (AWS, PMP, etc).
  • Referral program.
  • English courses.
  • Private health insurance and compensation for sports activities.

Join us!

Локації

Worldwide

Будемо раді бачити вас!

або Порекомендувати друга

Ми обробляємо персональні дані відповідно до GDPR

Шукаєте нові можливості для розвитку? Ознайомтеся з відкритими позиціями в Andersen просто зараз