Senior/Staff Evaluation Data Analyst
Nebius — London, England, United Kingdom · In-Person · Staff+
Role description
Role Overview
Nebius is seeking an experienced Data Analyst to own the quality measurement and improvement cycle end-to-end, design and build evaluation systems, and evaluate response quality across multiple dimensions.
What You Will Do
You will own ambiguous problems from initial framing through implementation, diagnosis, and measurable product improvement, and have a strong analytical mindset to turn ideas into reliable pipelines and tools.
Why It Might Be a Fit
You will have the independence to make progress in a fast-moving environment where requirements, methods, and definitions of success are still evolving, and will have the opportunity to shape the future of AI.
Requirements
- Substantial hands-on experience designing and building evaluation or quality measurement systems for complex technology products
- A track record of owning ambiguous problems from initial framing through implementation, diagnosis, and measurable product improvement
- Strong Python skills and an engineering mindset
- A solid foundation in mathematical statistics and practical experience with experimental design, sampling, uncertainty, and measurement bias
- Strong analytical judgment and the ability to reason across user needs, product behavior, and technical systems
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams