Member of Technical Staff (Index Engineer, Search Crawler)
Perplexity has an opening for a Member of Technical Staff (Index Engineer, Search Crawler) in London, United Kingdom. The listing describes it as a full-time, staff/principal-level position.
DGJ summary of this job
Our own short read of this listing, built only from the facts it gives. The employer’s original text follows further down.
Perplexity has an opening for a Member of Technical Staff (Index Engineer, Search Crawler) in London, United Kingdom. The listing describes it as a full-time, staff/principal-level position.
From the advert, the main requirements are 5+ years of experience.
The advert mentions Rust and C++ among the skills and tools for this role.
The employer does not state a salary in this listing; DGJ Insight below shows an official pay benchmark for the place where one exists.
Visa sponsorship is not mentioned. Applicants from outside United Kingdom should check the official work permit route before applying.
Dev Global Jobs found this job on Arbeitnow on Nov 17, 2026.
- Employer
- Perplexity
- Location
- London, United Kingdom
- Job type
- Full-time
- Level (from the title)
- staff/principal-level
- Pay
- Not stated by the employer
- Experience asked
- 5+ years
- Found
- Nov 17, 2026 on Arbeitnow
- Employer text
- 303 words, about 1 min to read
- Apply only on the official page (arbeitnow.co.uk). Dev Global Jobs is not the employer and never asks for a fee.
- Compare your own experience with the 5+ years the advert asks for, and show it clearly near the top of your CV.
- Mirror the skills the advert names (Rust and C++) in your CV where you really have them; applicant tracking systems look for these words.
- Read the employer’s full text below (about 1 min) before you apply.
- Build or check your CV with the free DGJ CV Builder.
DGJ Insight
Our own data about this role and place, from official statistics and our live job index.
Source: OECD Average annual wages, 2025
UN living-cost index for United Kingdom (ICSC post adjustment 76.6), as of 1 Nov 2026.
Source: ICSC post adjustment classifications (icsc.un.org)
- Skilled Worker visa: Job offer from a licensed sponsor at the required skill and salary level; English requirement
- Health and Care Worker visa: Eligible health and social care roles with a licensed sponsor
- Global Talent visa: Endorsement as a leader or potential leader in a listed field
Official routes: UK Visas and Immigration (GOV.UK)
About the role
Full text from the employer, as published on Arbeitnow, arranged into sections. Nothing added or removed.
AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.
01Responsibilities
Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.
Work on storage formats, compaction, and update mechanisms that keep data accessible and current.
Keep pipelines reliable and predictable under high-throughput conditions.
Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.
Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.
Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.
Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.
Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.
02Qualifications
5+ years of experience building production backend or data infrastructure systems.
Strong programming experience in Go, C++, or Rust.
Experience with high-throughput data processing systems and very large datasets.
Experience building or operating databases, storage systems, data planes, or indexing pipelines.
Strong understanding of distributed systems, fault tolerance, consistency, and scalability.
Experience running production systems and handling operational incidents.
A systems-thinking mindset and the ability to reason about end-to-end data flows.
Find more English Speaking Jobs in United Kingdom on Arbeitnow
Ask CSI about this job
Answers link to jobs and tools on Dev Global Jobs.
Review Dev Global Jobs
Used this site to find a job? Tell other job seekers what worked and what did not.