🇺🇸 USAJobs.work

America's Job Portal

← Back to USA Jobs

Software Engineer, Inference - CUDA / Kernels

Company

OpenAI

Location

san francisco, ca

Posted

June 11, 2026

Position Overview

About the Team
We’re building high-performance infrastructure to serve OpenAI’s frontier models at massive scale. As part of the inference team, you’ll be responsible for unlocking every last FLOP from our GPUs by designing kernels, tuning memory layouts, and optimizing model execution at the lowest levels of the stack.

About the Role
We are looking for a kernel-focused engineer to lead efforts in writing, porting, and optimizing GPU kernels used in inference workloads. This role requires deep familiarity with CUDA or equivalent kernel programming environments, and a strong intuition for performance tuning across modern GPU architectures.

In this role, you will:

  • Design, implement, and optimize CUDA kernels for inference-critical operations (e.g., fused matmuls, custom activation functions, memory layout transforms).

  • Analyze performance bottlenecks and optimize kernel executi...

Ready to Apply?

Join thousands of Americans building their careers

Apply Now