Resumo da vaga

Senior Data Engineer

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

What You’ll Do:

  • Build infrastructure and data automation pipelines to ingest, process, and load data from various sources. Automate and integrate new components into the data pipeline.
  • Collaborate with stakeholders and data science teams to develop data products, including entity resolution and best selection, to efficiently execute product vision and strategy in alignment with organizational goals and priorities.
  • Create unit and stress-test components to monitor technical performance and ensure that identified issues are resolved.
  • Develop data analysis tools to provide data insights and capture key metrics.
  • Research solutions and maintain technical documentation.
  • Follow best practices for data governance, quality, cleansing, and other ETL-related activities.

Who You Are:

  • 7+ years of development experience in data engineering within a production environment (internships and academic settings excluded).
  • Proven experience working with large datasets exceeding 100M+ records or multiple terabytes.
  • 2+ years of development experience in highly scalable, distributed systems and cluster architectures using AWS and utilizing EMR.
  • 5+ years of hands-on programming experience with Python.
  • 5+ years of professional experience working in big data ecosystems; Spark is required; PySpark is preferable.
  • 3+ years of experience with SQL, schema design, and dimensional data modeling.
  • 2+ years of professional experience working with dataflow orchestration tools, such as Airflow.
  • 2+ years of experience with non-relational databases (e.g., DynamoDB, Elasticsearch, etc.).
  • A bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field is required.
Vagas similares

Mantenha uma lista reserva.

Ver stack
FocoSenior Data EngineerÁrea da vaga
Sinal de senioridadeSeniorNível do candidato
StackAWS, Python, SparkSkills principais
Localização1 país aceitoElegibilidade

Stack

Use estas tags para comparar vagas remotas similares.

Elegibilidade de localização

Candidatos devem aplicar apenas quando o país do perfil estiver listado aqui.

Seu perfilPaís não definidoEntre para comparar seu país com esta vaga.

Fluxo de contratação

O WithMira mostra a vaga e depois envia candidatos para a aplicação da empresa.

1Confira fit da vaga, stack e elegibilidade de localização no WithMira.
2Abra a página de aplicação da empresa pelo link rastreado.
3Salve a vaga ou assine oportunidades similares antes de sair.
Aplicar no site da empresaSite da empresaAbrir link