Instacart
Staff Software Engineer, Data Infrastructure
Vaga remota de Software Engineering com fit claro de localização do candidato.
PublicadaAdicionada recentemente
Países elegíveis2 países aceitos
Sinal de senioridadeLead
Modelo de trabalhoRemoto
Locais aceitos para candidatos
CanadáEstados Unidos
Resumo da vaga
Staff Software Engineer, Data Infrastructure
Requisitos e responsabilidades
Conteúdo da vaga extraído em seções para revisão mais rápida.
About the Job
- Translate Instacart’s data strategy (e.g., monetization, federated access, real-time) into an actionable multi-year architecture roadmap; align with leadership while evolving the platform for scale, maturity, and cost efficiency.
- Own the open lakehouse foundation: define and deliver unified table formats, storage governance, and a multi-engine compute portfolio (interactive, batch, streaming) that enables portability and prevents lock-in.
- Drive real-time and streaming infrastructure for critical use cases (Ads, Fraud, ML): set deployment patterns, SLAs, and operational practices that balance performance, availability, and spend.
- Pioneer AI-native data infrastructure engineering by applying LLM/AI tools to the platform lifecycle—accelerating development, automation, observability, and cost optimization—and partnering to embed AI-powered capabilities into the platform.
- Elevate engineering excellence: lead architecture reviews, mentor senior/staff engineers, influence hiring, and clearly communicate complex trade-offs to both technical and executive audiences to ensure cross-org alignment.
Minimum Qualifications
- 10+ years of software engineering experience building and operating data infrastructure or distributed systems at production scale.
- Hands-on expertise with modern data lakehouse architectures and open table formats (e.g., Apache Iceberg, Delta Lake, Hudi) and with distributed query/compute engines (e.g., Trino, Spark, ClickHouse), including performance tuning and production reliability.
- Experience with event-driven and streaming infrastructure (e.g., Kafka, Flink) for real-time pipelines and serving systems.
- Proven ownership of major platform transitions or migrations (build vs. buy, migration design, risk management) delivered to production.
- Ability to build cost/benefit and TCO models for infrastructure investments and to drive alignment via clear architecture docs and strategy memos across multiple teams and leadership levels.
Preferred Qualifications
- Experience designing platform-level governance controls and familiarity with compliance frameworks (e.g., SOX, CPRA, GDPR).
- FinOps experience optimizing data platform spend, including managing multi-million dollar infrastructure budgets and negotiating vendor contracts.
- Deep SQL proficiency and strong skills in Python or Scala for systems-level development.
- Experience with orchestration (e.g., Apache Airflow) and data transformation pipelines (e.g., dbt) in large-scale production environments.
- Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.
Vagas similares
Mantenha uma lista reserva.
Stack
Use estas tags para comparar vagas remotas similares.
Elegibilidade de localização
Candidatos devem aplicar apenas quando o país do perfil estiver listado aqui.
Seu perfilPaís não definidoEntre para comparar seu país com esta vaga.
Fluxo de contratação
O WithMira mostra a vaga e depois envia candidatos para a aplicação da empresa.
1Confira fit da vaga, stack e elegibilidade de localização no WithMira.
2Abra a página de aplicação da empresa pelo link rastreado.
3Salve a vaga ou assine oportunidades similares antes de sair.