Resumo da vaga

Data Engineer

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

What You'll be Doing:

  • Design, build, and maintain scalable data pipelines using Databricks and Apache Spark
  • Develop and optimize ETL/ELT processes to ingest, transform, and load data from diverse source systems
  • Implement Change Data Capture (CDC) solutions to enable real-time and near-real-time data synchronization
  • Write clean, efficient, and maintainable code in Python for data processing and automation
  • Collaborate with data architects and analysts to translate business requirements into robust data pipeline designs
  • Monitor, troubleshoot, and optimize data pipeline performance, reliability, and cost efficiency
  • Ensure data quality, consistency, and integrity across ingestion, transformation, and storage layers
  • Support integration of structured and unstructured data sources into unified data platforms
  • Participate in code reviews and promote data engineering best practices across the team
  • Document data pipelines, transformations, and architecture for team visibility and maintainability
  • Collaborate with cross-functional teams to support analytics, reporting, and downstream AI/ML use cases

What You'll Need to Be Successful:

  • 3+ years of experience in data engineering or a related field
  • Strong hands-on experience with Databricks for data processing and analytics workloads
  • Proficiency with Apache Spark for large-scale distributed data processing
  • Experience implementing CDC solutions and tools (e.g., Debezium or similar)
  • Strong programming skills in Python for data engineering tasks
  • Solid understanding of SQL and relational database concepts
  • Experience building and maintaining ETL/ELT pipelines in production environments
  • Understanding of data modeling principles and data warehousing concepts
  • Strong analytical and problem-solving skills
  • Good communication skills, with the ability to work across technical and business teams

Preferred Qualifications:

  • Experience with cloud platforms (AWS, Azure) and their data services
  • Familiarity with orchestration tools (e.g., Airflow, Databricks Workflows)
  • Knowledge of data governance and cataloging practices
  • Experience with streaming data technologies (e.g., Kafka)
  • Experience working in Agile/Scrum environments
Vagas similares

Mantenha uma lista reserva.

Ver stack
FocoData EngineeringÁrea da vaga
Sinal de senioridadeMiddleNível do candidato
StackAWS, Azure, PythonSkills principais
Localização24 países aceitosElegibilidade

Stack

Use estas tags para comparar vagas remotas similares.

Elegibilidade de localização

Candidatos devem aplicar apenas quando o país do perfil estiver listado aqui.

Fluxo de contratação

O WithMira mostra a vaga e depois envia candidatos para a aplicação da empresa.

1Confira fit da vaga, stack e elegibilidade de localização no WithMira.
2Abra a página de aplicação da empresa pelo link rastreado.
3Salve a vaga ou assine oportunidades similares antes de sair.