Member of Technical Staff (Data Scientist, Evals)

Preferred Qualifications

• 1+ years of experience working with LLMs at scale, specifically with LLM-as-a-judge setups
• Prior experience working on customer-facing web products or consumer apps, with real user traffic at scale
• A strong research background, with experience applying research methods to real-world ML problems
• Experience defining evaluation metrics (e.g., factual consistency, hallucination rate, retrieval precision) and building ground truth datasets