Principal ML Solutions Architect - Token Factory

Role description

Role Overview

This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. The Principal ML Solutions Architect will act as the most senior technical authority for customers leveraging Token Factory's serverless inference and fine-tuning platforms.

What You Will Do

Own the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value. Optimize LLM inference at the framework and hardware level and codify the resulting best practices into reusable playbooks for the team.

Why It Might Be a Fit

We're looking for a Principal ML Solutions Architect to act as the most senior technical authority for customers leveraging Token Factory's serverless inference and fine-tuning platforms. You will set technical direction across our largest and most strategic accounts, own the hardest performance and quality problems end to end, mentor other Solutions Architects, and serve as a primary technical voice shaping the platform roadmap with backend, product, and research teams.

Requirements

• 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI
• Demonstrated technical leadership: owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers
• Expert knowledge of the LLM ecosystem: model architectures, fine-tuning approaches, and inference internals
• Deep, hands-on command of inference optimization: quantization, KV-cache management, batching, routing, etc.
• Hands-on experience with: Running LLMs in production at scale, LLM fine-tuning, including SFT/LoRA and data preparation/curation, LLM evaluation, Inference frameworks and libraries (vLLM, SGLang, TensorRT-LLM), Strong Python programming skills

Benefits

• 100% company-paid medical, dental, and vision coverage for employees and families
• Up to 4% company match with immediate vesting
• 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
• Up to $85/month for mobile and internet
• Company-paid short-term, long-term, and life insurance coverage