Senior/Staff Evaluation Data Analyst
Nebius — London, England, United Kingdom · In-Person · Staff+
Role description
Role Overview
Nebius is looking for an experienced Data Analyst to own the quality measurement and improvement cycle end-to-end, designing and building evaluation systems for complex technology products, such as search, AI agents, and voice technologies.
What You Will Do
You will own the quality measurement and improvement cycle, design and build evaluation systems, evaluate response quality, investigate quality regressions, and help prioritize the product and engineering roadmap.
Why It Might Be a Fit
We expect you to have substantial hands-on experience designing and building evaluation or quality measurement systems, strong Python skills, a solid foundation in mathematical statistics, and strong analytical judgment.
Requirements
- Substantial hands-on experience designing and building evaluation or quality measurement systems for complex technology products
- Strong Python skills and an engineering mindset
- A solid foundation in mathematical statistics and practical experience with experimental design, sampling, uncertainty, and measurement bias
- Strong analytical judgment and the ability to reason across user needs, product behavior, and technical systems
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams