Featherless AI
Machine Learning Engineer — Inference Optimization
Rol remoto de AI Optimization Engineer con fit claro de ubicación del candidato.
Publicado25 jul 2026
Países elegibles5 países aceptados
Señal de seniorityMiddle
Modelo de trabajoRemoto
Ubicaciones aceptadas para candidatos
CanadáAlemaniaIndiaReino UnidoEstados Unidos
Resumen del rol
Machine Learning Engineer — Inference Optimization
Requisitos y responsabilidades
Contenido del rol extraído en secciones para revisar más rápido.
What You’ll Do
- Optimize inference latency, throughput, and cost for large-scale ML models in production
- Profile and bottleneck GPU/CPU inference pipelines (memory, kernels, batching, IO)
- Implement and tune techniques such as:Quantization (fp16, bf16, int8, fp8)KV-cache optimization & reuseSpeculative decoding, batching, and streamingModel pruning or architectural simplifications for inference
- Quantization (fp16, bf16, int8, fp8)
- KV-cache optimization & reuse
- Speculative decoding, batching, and streaming
- Model pruning or architectural simplifications for inference
- Collaborate with research engineers to productionize new model architectures
- Build and maintain inference-serving systems (e.g. Triton, custom runtimes, or bespoke stacks)
- Benchmark performance across hardware (NVIDIA / AMD GPUs, CPUs) and cloud setups
- Improve system reliability, observability, and cost efficiency under real workloads
Implement and tune techniques such as:
- Quantization (fp16, bf16, int8, fp8)
- KV-cache optimization & reuse
- Speculative decoding, batching, and streaming
- Model pruning or architectural simplifications for inference
What We’re Looking For
- Strong experience in ML inference optimization or high-performance ML systems
- Solid understanding of deep learning internals (attention, memory layout, compute graphs)
- Hands-on experience with PyTorch (or similar) and model deployment
- Familiarity with GPU performance tuning (CUDA, ROCm, Triton, or kernel-level optimizations)
- Experience scaling inference for real users (not just research benchmarks)
- Comfortable working in fast-moving startup environments with ownership and ambiguity
Nice to haves
- Experience with LLM or long-context model inference
- Knowledge of inference frameworks (TensorRT, ONNX Runtime, vLLM, Triton)
- Experience optimizing across different hardware vendors
- Open-source contributions in ML systems or inference tooling
- Background in distributed systems or low-latency services
Why Join Us
- Real ownership over performance-critical systems
- Direct impact on product reliability and unit economics
- Close collaboration with research, infra, and product
- Competitive compensation + meaningful equity at Series A
- A team that cares about engineering quality, not hype
Roles similares
Mantén una lista de respaldo.
Stack
Usa estas tags para comparar roles remotos similares.
Elegibilidad de ubicación
Candidatos deberían aplicar solo cuando el país del perfil aparece aquí.
Tu perfilPaís no definidoInicia sesión para comparar tu país con este rol.
Flujo de contratación
WithMira muestra el rol y luego envía candidatos a la aplicación de la empresa.
1Revisa fit del rol, stack y elegibilidad de ubicación en WithMira.
2Abre la página de aplicación de la empresa desde el link rastreado.
3Guarda el rol o suscríbete a oportunidades similares antes de salir.