Vagas remotas de Spark para candidatos em Estados Unidos.

Design and implement the orchestration layer that turns natural-language intent into reliable execution.

• Senior
• REST
• Spark

Improve Baseten SRE Practices, by instrumenting SLOs and SLIs, improving alerting and observability for all services.

• Kubernetes
• Spark

Build and own the platform that powers all of Spacelift - from CI/CD to observability to incident response

• Senior
• AWS
• CI/CD
• PostgreSQL
• +1

Lead the design and implementation of complex data ingestion pipelines using PySpark, Databricks Intelligence Platform, and AWS services (S3, IAM roles and policies), including Kafka/streaming architectures, schema evolution

• Senior
• AWS
• CI/CD
• Python
• +2

Pipeline Automation: Design, implement, and manage automated CI/CD and Continuous Training (CT) pipelines for machine learning model development, evaluation, and delivery.

• Senior
• AWS
• CI/CD
• Docker
• +5

Platform Modernization & Legacy Replacement – Reducing reliance on legacy systems through scalable service development

• Senior
• Azure
• CI/CD
• Python
• +3

Multi-cloud capacity management

• CI/CD
• Kubernetes
• Spark

Build and maintain data pipelines that generate training datasets for machine learning models and experimentation

• Junior
• Python
• Spark

Lead the technical strategy, architecture, and implementation of Reddit’s next-generation ML Indexing & Retrieval engine, integrating capabilities across lexical and vector indexing, low-latency retrieval

• Lead
• AWS
• Docker
• GCP
• +4

Design, build, and operate distributed, data-intensive backend systems that power Data Platform capabilities across Experimentation, Metrics, Release Guardian, Observability, Agent Control, and other product areas.

• Senior
• Python
• Spark
• SQL

5+ years of relevant experience, and 3+ years of search expertise (Elasticsearch (ELK Stack), Lucene, Solr or similar)

• Senior
• AWS
• Azure
• Kubernetes
• +2

5+ years of relevant experience, and 3+ years of search expertise (Elasticsearch (ELK Stack), Lucene, Solr or similar)

• Senior
• AWS
• Azure
• Kubernetes
• +2

Continuously monitor Claude and ChatGPT product roadmaps, release notes, and vendor communications to anticipate platform changes before they land

• Lead
• CI/CD
• GCP
• Python
• +3

Continuously monitor Claude and ChatGPT product roadmaps, release notes, and vendor communications to anticipate platform changes before they land

• Lead
• CI/CD
• GCP
• Python
• +3

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Drive enterprise account strategy - Work alongside AEs to map target accounts and identify the right entry points across security, platform, and engineering teams.

• CI/CD
• Salesforce
• Snowflake
• +1

Make engineers more productive every day. Continuously improve the systems, workflows, and tooling that support software development across Chainguard.

• Lead
• CI/CD
• Kubernetes
• Snowflake
• +1

Define and execute sales plans for your assigned territory

• AWS
• Azure
• Docker
• +3

Databricks-Native ML Development: Design, develop, and deploy machine learning solutions using Databricks technologies including PySpark, Spark SQL, MLflow, Feature Store, AutoML

• Senior
• Azure
• CI/CD
• LLM
• +3

Design, build, and continuously refine scalable batch and real-time data pipelines using Python, SQL, Spark, Scala, or equivalent technologies, ensuring reliable, efficient

• Senior
• AWS
• Azure
• CI/CD
• +9

Design & Build Pipelines: Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines.

• Middle
• AWS
• CI/CD
• Docker
• +7

Security architecture and design: Collaborate with engineering teams to design and implement secure systems and infrastructure, including cloud (AWS/GCP) environments and container orchestration platforms.

• AWS
• CI/CD
• GCP
• +1