Vagas remotas de Spark com elegibilidade clara.

Design and implement the orchestration layer that turns natural-language intent into reliable execution.

• Senior
• REST
• Spark

Improve Baseten SRE Practices, by instrumenting SLOs and SLIs, improving alerting and observability for all services.

• Kubernetes
• Spark

Build and own the platform that powers all of Spacelift - from CI/CD to observability to incident response

• Senior
• AWS
• CI/CD
• PostgreSQL
• +1

Lead the design and implementation of complex data ingestion pipelines using PySpark, Databricks Intelligence Platform, and AWS services (S3, IAM roles and policies), including Kafka/streaming architectures, schema evolution

• Senior
• AWS
• CI/CD
• Python
• +2

Pipeline Automation: Design, implement, and manage automated CI/CD and Continuous Training (CT) pipelines for machine learning model development, evaluation, and delivery.

• Senior
• AWS
• CI/CD
• Docker
• +5

Platform Modernization & Legacy Replacement – Reducing reliance on legacy systems through scalable service development

• Senior
• Azure
• CI/CD
• Python
• +3

Lead reliability initiatives across multiple Ads domains including ad serving, auctions, targeting, reporting, measurement, and billing.

• Lead
• Kubernetes
• Python
• Spark

Lead reliability initiatives across multiple Ads domains including ad serving, auctions, targeting, reporting, measurement, and billing.

• Lead
• Kubernetes
• Python
• Spark

Lead reliability initiatives across multiple Ads domains including ad serving, auctions, targeting, reporting, measurement, and billing.

• Lead
• Kubernetes
• Python
• Spark

Multi-cloud capacity management

• CI/CD
• Kubernetes
• Spark

Build and maintain data pipelines that generate training datasets for machine learning models and experimentation

• Junior
• Python
• Spark

Lead the technical strategy, architecture, and implementation of Reddit’s next-generation ML Indexing & Retrieval engine, integrating capabilities across lexical and vector indexing, low-latency retrieval

• Lead
• AWS
• Docker
• GCP
• +4

Design, build, and operate distributed, data-intensive backend systems that power Data Platform capabilities across Experimentation, Metrics, Release Guardian, Observability, Agent Control, and other product areas.

• Senior
• Python
• Spark
• SQL

5+ years of relevant experience, and 3+ years of search expertise (Elasticsearch (ELK Stack), Lucene, Solr or similar)

• Senior
• AWS
• Azure
• Kubernetes
• +2

5+ years of relevant experience, and 3+ years of search expertise (Elasticsearch (ELK Stack), Lucene, Solr or similar)

• Senior
• AWS
• Azure
• Kubernetes
• +2

Continuously monitor Claude and ChatGPT product roadmaps, release notes, and vendor communications to anticipate platform changes before they land

• Lead
• CI/CD
• GCP
• Python
• +3

Continuously monitor Claude and ChatGPT product roadmaps, release notes, and vendor communications to anticipate platform changes before they land

• Lead
• CI/CD
• GCP
• Python
• +3

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Make engineers more productive every day. Continuously improve the systems, workflows, and tooling that support software development across Chainguard.

• Lead
• CI/CD
• Kubernetes
• Snowflake
• +1

Define and execute sales plans for your assigned territory

• AWS
• Azure
• Docker
• +3

Databricks-Native ML Development: Design, develop, and deploy machine learning solutions using Databricks technologies including PySpark, Spark SQL, MLflow, Feature Store, AutoML

• Senior
• Azure
• CI/CD
• LLM
• +3

• AWS or other cloud certifications • Experience with Agile methodologies (Scrum/Kanban) • Knowledge of databases (Oracle or other RDBMS) and data migration tools • Exposure to big data technologies like Hadoop or Spark • Experience

• Senior
• AWS
• Azure
• Docker
• +3

Design, build, and continuously refine scalable batch and real-time data pipelines using Python, SQL, Spark, Scala, or equivalent technologies, ensuring reliable, efficient

• Senior
• AWS
• Azure
• CI/CD
• +9

End to end ownership of our database and data warehousing infrastructure, its KPIs and its SLAs, including MySQL, Postgres, CDC capture, and Redshift.

• Senior
• AWS
• CI/CD
• Golang
• +8

System Ownership: Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies.

• Senior
• AWS
• Azure
• CI/CD
• +7

System Ownership: Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies.

• Lead
• AWS
• Azure
• CI/CD
• +7

Design & Build Pipelines: Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines.

• Middle
• AWS
• CI/CD
• Docker
• +7

Security architecture and design: Collaborate with engineering teams to design and implement secure systems and infrastructure, including cloud (AWS/GCP) environments and container orchestration platforms.

• AWS
• CI/CD
• GCP
• +1

Strategic Technical Discovery: When you are pulled into complex deals, you join as the expert closer. You run deep discovery on their stack and constraints, then design the winning technical strategy.

• AWS
• Azure
• CI/CD
• +4

Strategic Technical Discovery: When you are pulled into complex deals, you join as the expert closer. You run deep discovery on their stack and constraints, then design the winning technical strategy.

• AWS
• Azure
• CI/CD
• +4

Define the architecture and contracts governing how models move from development to production — feature store design, model schema management, online/offline inference consistency, and multi-version support.

• Lead
• Java
• Python
• Spark

Translate Instacart’s data strategy (e.g., monetization, federated access, real-time) into an actionable multi-year architecture roadmap; align with leadership while evolving the platform for scale, maturity, and cost efficiency.

• Lead
• AWS
• Python
• Snowflake
• +2

Translate Instacart’s data strategy (e.g., monetization, federated access, real-time) into an actionable multi-year architecture roadmap; align with leadership while evolving the platform for scale, maturity, and cost efficiency.

• Lead
• AWS
• Python
• Snowflake
• +2

Design end-to-end model lifecycle patterns (MLOps) to boost velocity of development for ML engineers, including data preparation, model management, experiment tracking, and more

• Lead
• GCP
• Kubernetes
• Python
• +1

7+ years of professional software engineering experience, with at least 3+ years focused on ML-driven systems at scale

• Lead
• Spark

Design and build large-scale offline ML experimentation platforms that enable reproducible research, model development, evaluation, and promotion workflows.

• Senior
• Spark

Design end-to-end model lifecycle patterns (MLOps) to boost velocity of development for ML engineers, including data preparation, model management, experiment tracking, and more

• Senior
• GCP
• Kubernetes
• Python
• +1

Architect and evolve Affirm's lakehouse analytics platform, driving strategy around Snowflake, Apache Iceberg, and Spark to deliver scalable, high-performance analytical infrastructure.

• Lead
• AWS
• CI/CD
• Python
• +4

Architect and evolve Affirm's lakehouse analytics platform, driving strategy around Snowflake, Apache Iceberg, and Spark to deliver scalable, high-performance analytical infrastructure.

• Lead
• AWS
• CI/CD
• Python
• +4

You want to impact the industries that run our world: Your efforts will result in real-world impact — helping keep the lights on, get food into grocery stores, reduce emissions, and ensure workers return home safely.

• Senior
• AWS
• Azure
• GCP
• +6

You want to impact the industries that run our world: Your efforts will result in real-world impact — helping keep the lights on, get food into grocery stores, reduce emissions, and ensure workers return home safely.

• Senior
• AWS
• Azure
• GCP
• +6

You want to impact the industries that run our world: The software, firmware, and hardware you build will result in real-world impact—helping to keep the lights on, get food into grocery stores, and most importantly

• Lead
• Kubernetes
• Spark

You want to impact the industries that run our world: The software, firmware, and hardware you build will result in real-world impact—helping to keep the lights on, get food into grocery stores, and most importantly

• Lead
• Kubernetes
• Spark

Drive Revenue Growth

• Lead
• Spark

Drive Revenue Growth

• Lead
• Spark

Act as a subject matter expert for data observability on behalf of the Datadog advocacy and engineering teams

• Senior
• Java
• Python
• Snowflake
• +2

Observability platform engineeringBuild and operate scalable observability and telemetry platforms that process logs, metrics, traces, and events across production environments.

• Senior
• AWS
• CI/CD
• Docker
• +4

Build production ready time series models to predict real time KPIs as well as build optimal decision actions to manage the provider network for clinical operations business optimization

• Senior
• CI/CD
• Python
• REST
• +2

Own a revenue target and all aspects of the sales cycle from prospecting to close, including outbounding and engaging Tier 1 accounts in your assigned verticals

• Spark

Drive the Enterprise Readiness customer experience end to end: Partner with GTM and Enterprise Engineering to make "enterprise-ready" a platform-wide capability, not a deal-by-deal scramble.

• Lead
• Spark

Real-time telemetry engine — Build the ingestion, reduction, storage, and query path for high-cardinality fabric, host, GPU, and workload telemetry.

• Kubernetes
• Spark

Own the design, architecture, and implementation of complex data engineering initiatives on the team — including advanced pipeline development, data platform architecture

• Senior
• AWS
• Azure
• GCP
• +5

Design and implement modern data platforms leveraging Microsoft Fabric (OneLake, Lakehouse, Data Factory, Power BI) and Databricks (Spark, Delta Lake, SQL Warehouses)

• Middle
• Azure
• CI/CD
• Spark
• +1

einleitung Unser Kunde: Bei uns erwartet dich ein moderner Techstack, spannende Herausforderungen in unterschiedlichen Branchen und ein junges, dynamisches Team, das mit Begeisterung und Teamgeist gemeinsam Ziele erreicht.

• Senior
• CI/CD
• Kubernetes
• Python
• +1

Build revenue pipeline by setting introductory meetings with potential businesses and key decision makers.

• Spark

Maintain Ajua’s platform uptime, performance, stability and scalability

• Senior
• AWS
• Docker
• Java
• +2

Rolling Deployments

• Next.js
• React
• Spark
• +1

Own the Capacity product end to end: scoping, design, implementation, and iteration based on feedback from internal stakeholders

• AWS
• JavaScript
• Spark

You will collapse time-to-production — take a developer from first sign-up to a running, maintained production deployment, and drive down the time it takes to get there.

• Lead
• Spark

Own complex migrations end to end. Lead large-scale infrastructure migrations across teams and domains. This will involve scoping the work, sequencing dependencies, managing risk, and driving them to completion without surprises.

• Lead
• Spark

Recruit, hire, and grow a high-performing team of cloud platform engineers; provide ongoing coaching, feedback, and career development through regular 1:1s.

• Lead
• CI/CD
• Kubernetes
• Spark

Recruit, hire, and develop a high-performing team of platform engineers.

• Lead
• CI/CD
• Docker
• Kubernetes
• +2

Recruit, hire, and develop a high-performing team of systems engineers with deep container and Linux expertise.

• Lead
• Spark

Develop infrastructure and orchestration systems for deploying and managing large-scale distributed LLM inference

• CI/CD
• Kubernetes
• Spark

Cluster fabric design — Define InfiniBand or Ethernet-based architectures for GPU clusters.

• Spark

Lead, grow, and develop team leads across the Cloud Platform and Site Reliability Engineering orgs, building a culture of ownership, technical excellence, and continuous improvement.

• Lead
• CI/CD
• Kubernetes
• Spark

Model APIs for frontier models

• Lead
• Spark

Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).

• Lead
• Spark

Forward Deployed Engineering on the frontier of AI

• Lead
• Docker
• Python
• Spark