AI Solution Architect (Germany)

Summary

Andersen is hiring an AI Solution Architect in Germany to design and integrate scalable AI systems, supporting a major digital-transformation program and enabling modern, reliable AI-driven services.

The customer is a large international technology provider delivering end-to-end digital solutions for enterprise-level organizations. The company focuses on IT consulting, cloud services, cybersecurity, and managed operations, supporting clients across various industries with complex digital-transformation needs. With decades of experience, the customer emphasizes innovation, reliability, and high security standards.

The project is part of a large European digital transformation initiative aimed at integrating advanced AI into mission-critical systems. The team focuses on building scalable AI solutions, modernizing legacy architectures, and ensuring reliable deployment to support next-generation public and private sector services.

Responsibilities

• Defining the overall architecture and technical strategy for AI/GenAI systems, ensuring scalability, robustness and alignment with organizational standards.
• Selecting appropriate models, frameworks, serving stacks and infrastructure components for AI workloads.
• Designing end-to-end RAG, vector search and agent-based AI solutions, including data flows, orchestration logic and system boundaries.
• Overseeing model lifecycle processes: training, fine-tuning, evaluation, deployment, monitoring and continuous improvement.
• Providing architectural guidance to development teams and ensuring consistent implementation across projects.
• Preparing architectural documentation, diagrams, guidelines and decision records.
• Collaborating with security, data, infrastructure and product teams to ensure compliance, reliability and performance.
• Evaluating new AI technologies, tools and frameworks and assessing their relevance for the organization's ecosystem.
• Reviewing complex incidents, performance issues and design flaws, providing direction for remediation and optimization.
• Supporting procurement and vendor evaluation for AI platforms, hosting, data systems or model providers.

Requirements

• Experience in software engineering for 10+ years with at least 3-4 years in AI/ML solution design.
• Strong expertise in designing LLM/GenAI architectures, including model selection, serving, orchestration and scaling.
• Practical experience with Python and modern AI frameworks (PyTorch, TensorFlow, JAX)
• Deep understanding of transformer models, embeddings, vector search and RAG architectures.
• Experience designing agent-based systems and AI orchestration frameworks (LangGraph, LangChain, AutoGen or equivalents).
• Hands-on experience with MLOps practices, model lifecycle management, versioning and monitoring.
• Knowledge of vector databases (FAISS, Milvus, Pinecone, Chroma) and search optimization techniques.
• Experience designing high-availability AI inference services using vLLM, Triton, TensorRT or similar serving technologies.
• Solid understanding of cloud environments for AI workloads (AWS/GCP/Azure), GPU/accelerator usage and cost optimization.
• Ability to translate business requirements into AI solution architectures, integration patterns and technical specifications.
• Experience defining security, compliance and data governance standards for AI systems.
• Strong communication skills for working with stakeholders, engineering teams and management.
• Level of English – from Upper-Intermediate and above.
• Level of German – from Intermediate+ and above.

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!