Canonical page: https://taskbull.si/AIJobs/jobs/general-compute-inference-engineer/

[← Back to the shortlist](https://taskbull.si/AIJobs/#jobs) G General Compute Curated employer source

# Inference Engineer

San Francisco / New York City · Hybrid

[Inference engineer jobs ↗](https://taskbull.si/AIJobs/inference-engineer-jobs/) LLM serving KV cache Distributed systems Observability

THE OPPORTUNITY

## A role wortha closer look.

Build the serving layer that turns models running on specialized accelerators into reliable customer services. Own request routing, batching, cache management and autoscaling, including production monitoring and incident response. As an early engineer, help decide the architecture and roadmap for an inference platform designed around alternative hardware.

### Experience highlighted by the employer

- At least five years operating infrastructure systems, including real production experience serving language models.
- Strong concurrency, networking and scheduling fundamentals, plus experience owning reliability and on-call response.

### Location & eligibility

Employer lists hybrid work in San Francisco or New York City. Confirm office attendance and US authorization or sponsorship directly; the reviewed description gives no sponsorship guarantee.

### Compensation

See the employer’s original listing for current compensation details. We do not estimate an undisclosed currency or salary.

### Before you apply

This is TaskBull’s concise summary, not the employer’s full job description. Review the complete responsibilities, terms, accessibility information and privacy notice on the original application page.

[Read the full employer listing ↗](https://jobs.ashbyhq.com/generalcompute/b30498a8-997a-47f2-a64a-fd4fdbc6b375)

YOUR NEXT STEP

## Make yourwork count.

Apply directly with General Compute. Your application stays with the employer and its hiring platform.

[Apply with employer ↗](https://jobs.ashbyhq.com/generalcompute/b30498a8-997a-47f2-a64a-fd4fdbc6b375) Employer General Compute Work arrangement Hybrid Source checked 2026-10-30 Review window ends 2026-11-13 The review date is our freshness limit, not the employer’s application deadline.

[Report a closed or changed role ↗](mailto:info.taskbull@gmail.com?subject=AIJobs%20listing%20update%3A%20general-compute-inference-engineer)