Search Quality Analyst

Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering — designing metrics, building data pipelines, and improving the quality of our search and answer systems.



This role is hybrid in Belgrade, London or Berlin.



Responsibilities

• Find and diagnose quality issues in our search pipeline

• Design metrics from scratch to track and measure search quality

• Build datasets for model training, including LLM-as-a-judge labeling pipelines

• Improve search snippet quality and page selection algorithms for indexing

• Design and analyze A/B experiments to validate improvements

Qualifications

• 4+ years of experience as a data analyst or in a related role

• Strong coding skills — expected to write production-grade code at a mid-level backend engineer level

• Proficiency with SQL and Python

• Demonstrated hands-on experience with at least one of the following:

• Designing metrics from scratch (not just analyzing existing A/B experiments)

• Building labeling pipelines using LLM-as-a-judge

• Training ML models that shipped to production with measurable metric improvements

• Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals

Preferred Qualifications

• Experience working on search-related products

• Knowledge of statistics and A/B experiment design

• Experience with Apache Spark or Databricks