Validation Engineer - Multi-Agent AI Systems (f/m/x)
INNOVATION IS IMAGINING WHAT NO ONE ELSE CAN.
At the BMW Group, everything starts with passion. It turns a profession into a vocation. It drives us to keep reinventing mobility and bring innovative ideas onto the roads. Enthusiasm for joint projects turns a team into a strong unit where every opinion is valued. It is only when expertise, highly professional processes and enjoyment of work unite that we can shape the future together.
We are building an inter-domain multi-agent system that spans ADAS, Infotainment and backend services for the intelligent vehicle of the future. A dedicated team designs and implements this system – your job is to prove it works. You will own the virtual validation of this multi-agent AI system in a cloud-based test environment, developing AI-assisted validation strategies that systematically explore the behavioural space of interacting agents and uncover failures that conventional testing would miss.
What awaits you?
- You build and operate cloud-based validation environments for a multi-agent system that operates across ADAS, Infotainment and backend-service domains – defining test architectures, scenario pipelines, behavioural oracles and regression suites.
- Also, you design AI-assisted exploration strategies to navigate the semantic search space of the system under test: agent-based probing of behavioural boundaries, adaptive test strategies, and optimization techniques to surface edge cases and failure modes.
- It is your responsibility to develop coverage models and metrics for non-deterministic multi-agent systems and use them to steer test generation and assess release readiness.
- You establish validation methodologies suited to stochastic AI behaviour: metamorphic testing, property-based testing, adversarial probing and acceptance criteria grounded in confidence intervals rather than binary pass/fail.
- You build observability and diagnostics tooling for validation runs – distributed tracing, trajectory replay, automated failure clustering and root-cause triage — so that discovered issues can be rapidly understood and communicated to the design team.
- Furthermore, you evaluate and select the LLMs/SLMs that power your validation agents and test-generation systems, balancing latency, cost and accuracy for large-scale test campaigns.
- You close the feedback loop between validation findings and system improvement by structuring discovered failures, coverage gaps and behavioural anomalies into actionable knowledge for the design and context-engineering teams.
What should you bring along?
- University degree in Computer Science, AI/ML, Systems Engineering, or a related field.
- 3–5 years of hands-on experience in validation, verification or quality engineering for complex AI, ML or software-intensive systems.
- Expert-level programming skills in at least one high-level language (C++, Java, Kotlin or Python).
- Proficiency in AI-assisted development using coding agents such as Claude Code, GitHub Copilot or OpenCode.
- Understanding of agentic AI architectures, agent patterns and multi-agent interaction.
- Ability to apply optimization, search or operational-research techniques (genetic/evolutionary algorithms, Bayesian optimisation, Monte Carlo methods) to testing or exploration problems.
- Experience with automotive software quality processes (e.g. ASPICE, ISO 26262) is a plus.
You enjoy working in an international team and are passionate about software quality? Apply now!
Find out more about Artificial Intelligence at the BMW Group here.
Note: Please apply exclusively online via our career portal. Applications via other channels (esp. e-mail) cannot be considered.
What do we offer?
- Challenging projects with which we are shaping the mobility of tomorrow together.
- Wide range of personal and professional development opportunities.
- Attractive, fair and performance-related remuneration.
- High level of job security.
- Annual special payments such as vacation pay, Christmas bonus, and profit sharing.
- Flexible working hours including 6 weeks annual leave and overtime compensation.
- Discounted BMW & MINI conditions.
- Many other benefits at bmw.jobs/benefits
Start date: from now on
Type of employment: unlimited
Working hours: Full-time
If you apply, the next stages of the recruiting process include an online test followed by technical interviews with the hiring manager (either virtual or in person).
You can find helpful tips on your application and the application process here.
At the BMW Group, we place great importance on equal treatment and equal opportunities. Our recruiting decisions are based on the personality, experience, and skills of the applicants. Learn more here.