IT & Software

Crawler Infrastructure Site Reliability Engineer

Perplexity

London · Ontario · Canada

Improve crawler throughput with Kubernetes operations and observability on Perplexity’s Crawler team. Build safer deployments and durable reliability fixes for production services. As a Site Reliability Engineer, you will operate fetching and rendering fleets while improving availability, latency, throughput, and resource efficiency. You will use Python, C++, Rust, or Go alongside Terraform, CI/CD workflows, and production Kubernetes. The work focuses on dependable crawler operations. Key Responsibilities:

Optimize Kubernetes workloads and supporting crawler infrastructure Maintain infrastructure as code and CI/CD deployment pipelines Define SLOs, monitoring, alerting, and observability Diagnose queue backlogs, network failures, and bottlenecks Lead incidents and convert postmortems into reliability improvements Requirements:

Five-plus years in SRE, production engineering, or backend infrastructure Strong programming skills in Python, C++, Rust, or Go Hands-on cloud, Kubernetes, Terraform, and automated deployment experience Strong Linux and networking fundamentals Experience diagnosing distributed-system failures and production incidents Apply production engineering, Kubernetes, and observability expertise to strengthen Perplexity’s crawler reliability and throughput.

#J-18808-Ljbffr

Reference: WJ-3875_16326102 · Posted 17 Nov 2026, 01:25 AM

Find more on GigBlow

This role is listed on GigBlow for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.

Browse jobs