Staff Machine Learning Infrastructure Engineer
Cohere
Build high-performance machine learning systems at Cohere with Kubernetes, distributed systems, and production infrastructure expertise. Work model details are not specified. Cohere seeks Members of Technical Staff for its Model Serving team. You will develop, deploy, and operate the AI platform delivering large language models through easy-to-use API endpoints. The work supports optimized NLP models in low-latency, high-throughput, high-availability environments. Key Responsibilities:
Develop the AI platform serving Cohere large language models Deploy optimized NLP models to production environments Operate low-latency, high-throughput, highly available systems Collaborate across teams on mission-critical infrastructure Create customized deployments for customer-specific needs Requirements:
5+ years running production infrastructure at large scale Design experience with distributed systems and Kubernetes Experience supporting GPU workloads on Kubernetes clusters Cloud experience with GCP, Azure, AWS, or OCI Golang, C++, or other high-performance server languages Apply machine learning infrastructure, Kubernetes, and distributed systems expertise to Cohere’s scalable Model Serving platform.
#J-18808-Ljbffr
Develop the AI platform serving Cohere large language models Deploy optimized NLP models to production environments Operate low-latency, high-throughput, highly available systems Collaborate across teams on mission-critical infrastructure Create customized deployments for customer-specific needs Requirements:
5+ years running production infrastructure at large scale Design experience with distributed systems and Kubernetes Experience supporting GPU workloads on Kubernetes clusters Cloud experience with GCP, Azure, AWS, or OCI Golang, C++, or other high-performance server languages Apply machine learning infrastructure, Kubernetes, and distributed systems expertise to Cohere’s scalable Model Serving platform.
#J-18808-Ljbffr
Reference: WJ-3875_16509891 · Posted 18 Nov 2026, 03:27 AM
More jobs like this: