Senior Engineering Manager, Autonomy Evaluation Applications

As Senior Manager of Eval Applications, you will lead these four teams through their managers and tech leads, and own the roadmap, execution, and staffing for how we measure driving quality and turn it into decisions. The work is concrete: using scene classifiers to find simulation tests that don't exercise the behavior they were written to check, or ranking the subsystem failures behind a drop in driving quality so the right team fixes the right thing first. You'll set priorities, build the team, and make sure partner teams trust and act on what we produce. You'll work with the org's principal and staff engineers, who lead evaluation methodology, and with the Software Validation and Safety teams, who use our results in test strategy and release decisions.

• ◆Own the strategy, roadmap, and quarterly plans for Eval Applications, tied to the AV program's product milestones and release needs. Decide what the teams build, what they stop, and in what order.
• ◆Make evaluation results trusted and used. Partner teams in Autonomy, Simulation, Systems, Safety, and Software Validation should know what each metric and scene classifier means, how accurate it is, and when to rely on it.
• ◆Run the loop from observed driving behavior to ranked problems to fixes, so issues found in road and simulation testing get sized, routed to the owning team, and tracked to closure.
• ◆Make sure teams can tell quickly and reliably whether a software or model change improved driving, including regression detection that release reviews can depend on.
• ◆Set and track org-level measures of evaluation quality and impact, such as classifier precision and recall, time from a new question to a trusted answer, and how often our findings change a decision.
• ◆Keep the technical bar high through design reviews, code review standards, testing, and statistically sound analysis, and work with principal and staff engineers on technical direction.
• ◆Bring in new methods where they pay off, including VLM- and LLM-based classification and triage with human review, and AI-assisted development across the team.
• ◆Turn results into clear recommendations for engineering and executive leadership: what changed, how confident we are, and what to do next.

Leadership

• ◆Hire, develop, and retain managers, tech leads, engineers, and data scientists, and grow the next layer of leaders.
• ◆Lead through managers and tech leads with clear ownership, steady operating rhythms, and real accountability. Run performance management fairly and directly.
• ◆Shape team structure and staffing as priorities change, balancing near-term program needs against longer-term investments in methods and tooling.
• ◆Resolve cross-team conflicts over priorities, ownership, and contradictory results, and align stakeholders on what to do next.
• ◆Work with Autonomy Evaluation and AV leadership on long-term evaluation strategy and the decisions that affect release confidence.

• ✓10+ years of experience in autonomous systems, robotics, ML evaluation, applied data science, or large-scale data platforms, with a track record of turning analysis into decisions and shipped improvements.
• ✓5+ years of people leadership, including leading managers or tech leads across multiple teams.
• ✓A track record of hiring and developing strong managers and engineers, and building teams that do well when priorities shift.
• ✓Ownership of the strategy, roadmap, and execution for a distinct technical area, with measurable outcomes for cross-functional customers.
• ✓Hands-on depth in evaluating ML or autonomy systems, including metric design, classifier precision and recall, sampling, experimental design, and statistical confidence. You can review an analysis and tell when its conclusion doesn't hold.
• ✓Strong stakeholder engagement. You build trusted relationships with partner teams and leadership, and keep them aligned through changing priorities and disagreement.
• ✓Production Python and SQL experience in team environments, and comfort reviewing designs and code.
• ✓A record of influencing priorities across organizations without direct authority, using data that others trust.
• ✓Strong ability to turn ambiguous questions and uncertain results into clear plans and recommendations for executive, engineering, and cross-functional audiences.
• ✓Bachelor's, Master's, or PhD in Computer Science, Robotics, Mechanical or Aerospace Engineering, Machine Learning, Statistics, Data Science, or a related field, or equivalent practical experience.

What Will Give You a Competitive Edge (Preferred Qualifications)

• ✓Experience in autonomous driving or field robotics, including driving-log analysis and results from both simulation and on-road testing.
• ✓Experience le