Vagas remotas de Spark com elegibilidade clara.

Design and implement the orchestration layer that turns natural-language intent into reliable execution.

• Senior
• REST
• Spark

Improve Baseten SRE Practices, by instrumenting SLOs and SLIs, improving alerting and observability for all services.

• Kubernetes
• Spark

Build and own the platform that powers all of Spacelift - from CI/CD to observability to incident response

• Senior
• AWS
• CI/CD
• PostgreSQL
• +1

Lead the design and implementation of complex data ingestion pipelines using PySpark, Databricks Intelligence Platform, and AWS services (S3, IAM roles and policies), including Kafka/streaming architectures, schema evolution

• Senior
• AWS
• CI/CD
• Python
• +2

Pipeline Automation: Design, implement, and manage automated CI/CD and Continuous Training (CT) pipelines for machine learning model development, evaluation, and delivery.

• Senior
• AWS
• CI/CD
• Docker
• +5

Platform Modernization & Legacy Replacement – Reducing reliance on legacy systems through scalable service development

• Senior
• Azure
• CI/CD
• Python
• +3

Lead reliability initiatives across multiple Ads domains including ad serving, auctions, targeting, reporting, measurement, and billing.

• Lead
• Kubernetes
• Python
• Spark

Lead reliability initiatives across multiple Ads domains including ad serving, auctions, targeting, reporting, measurement, and billing.

• Lead
• Kubernetes
• Python
• Spark

Lead reliability initiatives across multiple Ads domains including ad serving, auctions, targeting, reporting, measurement, and billing.

• Lead
• Kubernetes
• Python
• Spark

Multi-cloud capacity management

• CI/CD
• Kubernetes
• Spark

Build and maintain data pipelines that generate training datasets for machine learning models and experimentation

• Junior
• Python
• Spark

Lead the technical strategy, architecture, and implementation of Reddit’s next-generation ML Indexing & Retrieval engine, integrating capabilities across lexical and vector indexing, low-latency retrieval

• Lead
• AWS
• Docker
• GCP
• +4

Design, build, and operate distributed, data-intensive backend systems that power Data Platform capabilities across Experimentation, Metrics, Release Guardian, Observability, Agent Control, and other product areas.

• Senior
• Python
• Spark
• SQL

5+ years of relevant experience, and 3+ years of search expertise (Elasticsearch (ELK Stack), Lucene, Solr or similar)

• Senior
• AWS
• Azure
• Kubernetes
• +2

5+ years of relevant experience, and 3+ years of search expertise (Elasticsearch (ELK Stack), Lucene, Solr or similar)

• Senior
• AWS
• Azure
• Kubernetes
• +2

Continuously monitor Claude and ChatGPT product roadmaps, release notes, and vendor communications to anticipate platform changes before they land

• Lead
• CI/CD
• GCP
• Python
• +3

Continuously monitor Claude and ChatGPT product roadmaps, release notes, and vendor communications to anticipate platform changes before they land

• Lead
• CI/CD
• GCP
• Python
• +3

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Make engineers more productive every day. Continuously improve the systems, workflows, and tooling that support software development across Chainguard.

• Lead
• CI/CD
• Kubernetes
• Snowflake
• +1

Define and execute sales plans for your assigned territory

• AWS
• Azure
• Docker
• +3

Databricks-Native ML Development: Design, develop, and deploy machine learning solutions using Databricks technologies including PySpark, Spark SQL, MLflow, Feature Store, AutoML

• Senior
• Azure
• CI/CD
• LLM
• +3

• AWS or other cloud certifications • Experience with Agile methodologies (Scrum/Kanban) • Knowledge of databases (Oracle or other RDBMS) and data migration tools • Exposure to big data technologies like Hadoop or Spark • Experience

• Senior
• AWS
• Azure
• Docker
• +3

Design, build, and continuously refine scalable batch and real-time data pipelines using Python, SQL, Spark, Scala, or equivalent technologies, ensuring reliable, efficient

• Senior
• AWS
• Azure
• CI/CD
• +9

End to end ownership of our database and data warehousing infrastructure, its KPIs and its SLAs, including MySQL, Postgres, CDC capture, and Redshift.

• Senior
• AWS
• CI/CD
• Golang
• +8

System Ownership: Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies.

• Senior
• AWS
• Azure
• CI/CD
• +7

System Ownership: Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies.

• Lead
• AWS
• Azure
• CI/CD
• +7

Design & Build Pipelines: Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines.

• Middle
• AWS
• CI/CD
• Docker
• +7

Security architecture and design: Collaborate with engineering teams to design and implement secure systems and infrastructure, including cloud (AWS/GCP) environments and container orchestration platforms.

• AWS
• CI/CD
• GCP
• +1

Strategic Technical Discovery: When you are pulled into complex deals, you join as the expert closer. You run deep discovery on their stack and constraints, then design the winning technical strategy.

• AWS
• Azure
• CI/CD
• +4

Strategic Technical Discovery: When you are pulled into complex deals, you join as the expert closer. You run deep discovery on their stack and constraints, then design the winning technical strategy.

• AWS
• Azure
• CI/CD
• +4

Define the architecture and contracts governing how models move from development to production — feature store design, model schema management, online/offline inference consistency, and multi-version support.

• Lead
• Java
• Python
• Spark

Translate Instacart’s data strategy (e.g., monetization, federated access, real-time) into an actionable multi-year architecture roadmap; align with leadership while evolving the platform for scale, maturity, and cost efficiency.

• Lead
• AWS
• Python
• Snowflake
• +2

Translate Instacart’s data strategy (e.g., monetization, federated access, real-time) into an actionable multi-year architecture roadmap; align with leadership while evolving the platform for scale, maturity, and cost efficiency.

• Lead
• AWS
• Python
• Snowflake
• +2

Design end-to-end model lifecycle patterns (MLOps) to boost velocity of development for ML engineers, including data preparation, model management, experiment tracking, and more

• Lead
• GCP
• Kubernetes
• Python
• +1

7+ years of professional software engineering experience, with at least 3+ years focused on ML-driven systems at scale

• Lead
• Spark

Design and build large-scale offline ML experimentation platforms that enable reproducible research, model development, evaluation, and promotion workflows.

• Senior
• Spark

Design end-to-end model lifecycle patterns (MLOps) to boost velocity of development for ML engineers, including data preparation, model management, experiment tracking, and more

• Senior
• GCP
• Kubernetes
• Python
• +1

Architect and evolve Affirm's lakehouse analytics platform, driving strategy around Snowflake, Apache Iceberg, and Spark to deliver scalable, high-performance analytical infrastructure.

• Lead
• AWS
• CI/CD
• Python
• +4

Architect and evolve Affirm's lakehouse analytics platform, driving strategy around Snowflake, Apache Iceberg, and Spark to deliver scalable, high-performance analytical infrastructure.

• Lead
• AWS
• CI/CD
• Python
• +4

You want to impact the industries that run our world: Your efforts will result in real-world impact — helping keep the lights on, get food into grocery stores, reduce emissions, and ensure workers return home safely.

• Senior
• AWS
• Azure
• GCP
• +6

You want to impact the industries that run our world: Your efforts will result in real-world impact — helping keep the lights on, get food into grocery stores, reduce emissions, and ensure workers return home safely.

• Senior
• AWS
• Azure
• GCP
• +6

You want to impact the industries that run our world: The software, firmware, and hardware you build will result in real-world impact—helping to keep the lights on, get food into grocery stores, and most importantly

• Lead
• Kubernetes
• Spark

You want to impact the industries that run our world: The software, firmware, and hardware you build will result in real-world impact—helping to keep the lights on, get food into grocery stores, and most importantly

• Lead
• Kubernetes
• Spark

Drive Revenue Growth

• Lead
• Spark

Drive Revenue Growth

• Lead
• Spark