IT & Software

Crawler Infrastructure Site Reliability Engineer

Perplexity

London · Ontario · Canada

Improve crawler throughput with Kubernetes operations and observability on Perplexity’s Crawler team. Build safer deployments and durable reliability fixes for production services.

As a Site Reliability Engineer, you will operate fetching and rendering fleets while improving availability, latency, throughput, and resource efficiency. You will use Python, C++, Rust, or Go alongside Terraform, CI/CD workflows, and production Kubernetes. The work focuses on dependable crawler operations.

Key Responsibilities:

  • Optimize Kubernetes workloads and supporting crawler infrastructure
  • Maintain infrastructure as code and CI/CD deployment pipelines
  • Define SLOs, monitoring, alerting, and observability
  • Diagnose queue backlogs, network failures, and bottlenecks
  • Lead incidents and convert postmortems into reliability improvements

Requirements:

  • Five-plus years in SRE, production engineering, or backend infrastructure
  • Strong programming skills in Python, C++, Rust, or Go
  • Hands-on cloud, Kubernetes, Terraform, and automated deployment experience
  • Strong Linux and networking fundamentals
  • Experience diagnosing distributed-system failures and production incidents

Apply production engineering, Kubernetes, and observability expertise to strengthen Perplexity’s crawler reliability and throughput.

#J-18808-Ljbffr

Reference: WJ-4483_1643548 · Posted 16 Nov 2026, 05:11 PM

More jobs like this:

Find more on GigBlow

This role is listed on GigBlow for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.

Browse jobs