AI & Emerging technologies

Staff Machine Learning Infrastructure Engineer

Cohere

Toronto · Ontario · Canada

Build high-performance machine learning systems at Cohere with Kubernetes, distributed systems, and production infrastructure expertise. Work model details are not specified.

Cohere seeks Members of Technical Staff for its Model Serving team. You will develop, deploy, and operate the AI platform delivering large language models through easy-to-use API endpoints. The work supports optimized NLP models in low-latency, high-throughput, high-availability environments.

Key Responsibilities:

  • Develop the AI platform serving Cohere large language models
  • Deploy optimized NLP models to production environments
  • Operate low-latency, high-throughput, highly available systems
  • Collaborate across teams on mission-critical infrastructure
  • Create customized deployments for customer-specific needs

Requirements:

  • 5+ years running production infrastructure at large scale
  • Design experience with distributed systems and Kubernetes
  • Experience supporting GPU workloads on Kubernetes clusters
  • Cloud experience with GCP, Azure, AWS, or OCI
  • Golang, C++, or other high-performance server languages

Apply machine learning infrastructure, Kubernetes, and distributed systems expertise to Cohere’s scalable Model Serving platform.

#J-18808-Ljbffr

Reference: WJ-4483_1652020 · Posted 17 Nov 2026, 07:10 PM

Find more on GigBlow

This role is listed on GigBlow for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.

Machine Learning jobs in other states

Browse jobs