Canonical page: https://taskbull.si/AIJobs/inference-engineer-jobs/ [TaskBull](https://taskbull.si/) / [AI jobs](https://taskbull.si/AIJobs/) / Inference engineering SPECIALIST CAREERS · CANADA & THE US # Inference engineer jobs Make trained models perform reliably in production. Browse LLM inference, model serving and AI infrastructure roles across Canada and the US. GPU serving Latency & throughput Distributed systems Performance measurement [Browse roles ↓](https://taskbull.si/AIJobs/inference-engineer-jobs/#jobs)[Explore this career ↗](https://taskbull.si/AIJobs/inference-engineer-jobs/#career-guide) APPLY DIRECTLY WITH EMPLOYERS ## 9 current roles [Search all AI jobs ↗](https://taskbull.si/AIJobs/#jobs) A Anthropic Curated from employer ### [Performance Engineer, Inference Systems](https://taskbull.si/AIJobs/jobs/anthropic-performance-engineer-inference-systems/) San Francisco / New York City / Seattle · Hybrid Python Performance profiling SQL USD $350,000–$850,000 / year [View role ↗](https://taskbull.si/AIJobs/jobs/anthropic-performance-engineer-inference-systems/) Source checked 2026-10-30 f fal Curated from employer ### [Machine Learning Engineer, Safety](https://taskbull.si/AIJobs/jobs/fal-machine-learning-engineer-safety/) San Francisco · On-site five days a week · Full-time Python PyTorch Kubernetes USD $180,000–$250,000 / year [View role ↗](https://taskbull.si/AIJobs/jobs/fal-machine-learning-engineer-safety/) Source checked 2026-10-30 T Tubi Curated from employer ### [Staff Software Engineer, ML Infra & Distributed Systems](https://taskbull.si/AIJobs/jobs/tubi-staff-software-engineer-ml-infra-distributed-systems/) Toronto, Ontario · Hybrid Scala AWS Distributed systems CAD $164,600–$235,100 / year [View role ↗](https://taskbull.si/AIJobs/jobs/tubi-staff-software-engineer-ml-infra-distributed-systems/) Source checked 2026-10-30 D DRW Curated from employer ### [AI Inference Platform Engineer](https://taskbull.si/AIJobs/jobs/drw-ai-inference-platform-engineer/) Chicago, Illinois · Confirm work model NVIDIA GPUs vLLM Linux USD $200,000–$250,000 / year [View role ↗](https://taskbull.si/AIJobs/jobs/drw-ai-inference-platform-engineer/) Source checked 2026-10-30 G General Compute Curated from employer ### [Inference Engineer](https://taskbull.si/AIJobs/jobs/general-compute-inference-engineer/) San Francisco / New York City · Hybrid · Full-time LLM serving KV cache Distributed systems Pay: see employer [View role ↗](https://taskbull.si/AIJobs/jobs/general-compute-inference-engineer/) Source checked 2026-10-30 B Baseten Curated from employer ### [Forward Deployed Engineer (Training)](https://taskbull.si/AIJobs/jobs/baseten-forward-deployed-engineer-training/) San Francisco / New York · Hybrid · Full-time GPU workloads Model evaluation Distributed systems USD $200,000–$400,000 / year [View role ↗](https://taskbull.si/AIJobs/jobs/baseten-forward-deployed-engineer-training/) Source checked 2026-10-30 M Modal Curated from employer ### [Forward Deployed Engineer - ML](https://taskbull.si/AIJobs/jobs/modal-forward-deployed-engineer-ml/) New York / San Francisco · On-site · Full-time vLLM SGLang Model training USD $180,000–$250,000 / year [View role ↗](https://taskbull.si/AIJobs/jobs/modal-forward-deployed-engineer-ml/) Source checked 2026-10-30 M Modal Curated from employer ### [Forward Deployed Engineer - Systems](https://taskbull.si/AIJobs/jobs/modal-forward-deployed-engineer-systems/) New York / San Francisco · On-site · Full-time Cloud architecture Docker Kubernetes USD $180,000–$240,000 / year [View role ↗](https://taskbull.si/AIJobs/jobs/modal-forward-deployed-engineer-systems/) Source checked 2026-10-30 C Cohere Curated from employer ### [Forward Deployed Engineer, Inference](https://taskbull.si/AIJobs/jobs/cohere-forward-deployed-engineer-inference/) United States · On-site · City not specified · Full-time Kubernetes vLLM Distributed serving USD $240,000–$325,000 base / year* [View role ↗](https://taskbull.si/AIJobs/jobs/cohere-forward-deployed-engineer-inference/) Source checked 2026-10-30 Each role shows its source-check date and known location restrictions. A listing can close before its review window ends; confirm current availability with the employer. [How we review listings](https://taskbull.si/AIJobs/about/). UNDERSTAND THE WORK ## Inference engineeringcareer guide. By TaskBull AIJobs · Updated October 30, 2026 ### Inference engineering focuses on running models Inference is the work of serving a trained model to produce outputs. Engineers in this area can build serving platforms, improve runtime performance, manage deployment and investigate reliability. The focus differs from training a new model, although the systems and skills can overlap. Read whether a vacancy owns low-level performance, platform operations or integration with customer workloads. ### Compare serving runtimes and infrastructure responsibilities An LLM inference engineer might work with batching, caching, scheduling or GPU memory. Platform roles can also involve model onboarding, observability, rollout controls and capacity planning. Tools such as vLLM, TensorRT-LLM or SGLang appear in parts of this field, but no single runtime defines every job. Compare the employer’s actual stack and expected level of systems expertise. ### Show measurements with enough context to be meaningful For a portfolio experiment, state the model, hardware, request pattern and measurement method. Compare latency, throughput and cost alongside output correctness. Explain warm-up, concurrency and tradeoffs rather than reporting a single unexplained speedup. A reproducible benchmark and a careful account of limitations help an interviewer understand whether the result would transfer to a production workload. ### Check location and seniority before applying Infrastructure vacancies can require substantial distributed-systems or performance experience. Some are office-based even when the wider company hires remotely. Use the role’s stated arrangement and country restrictions. Employer pay bands vary with seniority, location and compensation structure; the examples on this board are individual vacancies, not a salary survey of the inference engineering market. ### Sources and reading Career guidance draws on the examples below and TaskBull’s editorial analysis. Employer sources describe their own roles; they do not endorse this board. - [Anthropic — Performance Engineer, Inference Systems ↗](https://job-boards.greenhouse.io/anthropic/jobs/5224564008) - [DRW — AI Inference Platform Engineer ↗](https://job-boards.greenhouse.io/drweng/jobs/8230509) BEFORE YOU APPLY ## Your careerquestions. What other titles describe inference engineering? AI inference platform engineer, inference systems engineer, model serving engineer and ML infrastructure engineer can overlap. Some ML infrastructure jobs focus on training instead, so check the duties. Is inference engineering the same as prompt engineering? No. These roles usually emphasize serving infrastructure, systems performance and reliable deployment. Prompt design can affect a workload, but it does not replace the required systems skills. EXPLORE RELATED WORK ## Another way in. [Applied AI engineer jobs ↗](https://taskbull.si/AIJobs/applied-ai-jobs/)[Forward deployed engineer jobs ↗](https://taskbull.si/AIJobs/forward-deployed-engineer-jobs/)[AI evaluation & testing jobs ↗](https://taskbull.si/AIJobs/ai-evaluation-jobs/) BUILDING AN AI TEAM? ## Find people who canmake it work. Submit an active role for review. Choose a monthly employer plan from USD $99. Every submitted role is reviewed before publication. [Submit your role ↗](https://taskbull.si/AIJobs/post-a-job/)