Resumo da vaga

Lead Data Engineer

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

About the Role

  • Lead the design, development, and optimization of scalable data platforms and pipelines.
  • Design, build, and maintain production-grade ETL/ELT workflows for batch and near real-time data processing.
  • Drive the migration and modernization of data assets from BigQuery and other analytical platforms into Snowflake.
  • Develop robust integrations with enterprise applications, APIs, and external data providers.
  • Build and optimize Snowflake data models, schemas, Snowpipe ingestion processes, and query performance.
  • Collaborate with business stakeholders, analysts, and engineering teams to translate business requirements into scalable data solutions.
  • Implement data quality, validation, monitoring, and observability frameworks.
  • Establish and promote best practices for data governance, lineage tracking, metadata management, and security.
  • Support both batch and streaming data architectures using technologies such as Kafka, Event Hub, or equivalent.
  • Mentor other engineers and contribute to architectural decisions, technical standards, and engineering best practices.

About the Role

  • 7+ years of experience in data engineering within cloud or hybrid environments.
  • Strong experience designing, building, and maintaining production-scale ETL/ELT pipelines.
  • Advanced SQL skills and proficiency with data transformation techniques.
  • Strong Python programming skills for data processing and automation.
  • Hands-on experience with Snowflake, including:Data modelingSnowpipeQuery optimizationSchema design
  • Data modeling
  • Snowpipe
  • Query optimization
  • Schema design
  • Experience migrating from BigQuery or similar columnar data warehouse technologies.
  • Experience with batch and streaming data processing platforms such as Kafka, Event Hub, or equivalent.
  • Experience building enterprise-grade API and source-system integrations.
  • Experience implementing data quality and validation frameworks.
  • Good understanding of:Data governanceData lineageAccess control and security best practices
  • Data governance
  • Data lineage
  • Access control and security best practices
  • Strong problem-solving and communication skills.
  • Ability to work effectively in a collaborative, cross-functional environment.

Details

  • Data modeling
  • Snowpipe
  • Query optimization
  • Schema design

Good understanding of:

  • Data governance
  • Data lineage
  • Access control and security best practices

Nice to haves

  • Experience with Databricks, including:Delta LakeUnity CatalogSpark-based pipelines
  • Delta Lake
  • Unity Catalog
  • Spark-based pipelines
  • Experience with Spark, Scala, or PySpark.
  • Familiarity with Tableau.
  • Understanding of HIPAA and HITRUST data handling practices.
  • Experience with dbt (data build tool) for transformation layer management.
  • Experience working within healthcare, insurance, or regulated industries.

Experience with Databricks, including:

  • Delta Lake
  • Unity Catalog
  • Spark-based pipelines

Working Conditions

  • Full-time, 40h/week
  • US-based — US citizenship is required
  • Remote
  • Contract or B2B arrangement
Vagas similares

Mantenha uma lista reserva.

Ver stack
FocoLead Data EngineerÁrea da vaga
Sinal de senioridadeSeniorNível do candidato
StackPython, Snowflake, SparkSkills principais
Localização1 país aceitoElegibilidade

Stack

Use estas tags para comparar vagas remotas similares.

Elegibilidade de localização

Candidatos devem aplicar apenas quando o país do perfil estiver listado aqui.

Seu perfilPaís não definidoEntre para comparar seu país com esta vaga.

Fluxo de contratação

O WithMira mostra a vaga e depois envia candidatos para a aplicação da empresa.

1Confira fit da vaga, stack e elegibilidade de localização no WithMira.
2Abra a página de aplicação da empresa pelo link rastreado.
3Salve a vaga ou assine oportunidades similares antes de sair.
Aplicar no site da empresaSite da empresaAbrir link