Resumen del rol

Lead Data Engineer

Requisitos y responsabilidades

Contenido del rol extraído en secciones para revisar más rápido.

About the Role

  • Lead the design, development, and optimization of scalable data platforms and pipelines.
  • Design, build, and maintain production-grade ETL/ELT workflows for batch and near real-time data processing.
  • Drive the migration and modernization of data assets from BigQuery and other analytical platforms into Snowflake.
  • Develop robust integrations with enterprise applications, APIs, and external data providers.
  • Build and optimize Snowflake data models, schemas, Snowpipe ingestion processes, and query performance.
  • Collaborate with business stakeholders, analysts, and engineering teams to translate business requirements into scalable data solutions.
  • Implement data quality, validation, monitoring, and observability frameworks.
  • Establish and promote best practices for data governance, lineage tracking, metadata management, and security.
  • Support both batch and streaming data architectures using technologies such as Kafka, Event Hub, or equivalent.
  • Mentor other engineers and contribute to architectural decisions, technical standards, and engineering best practices.

About the Role

  • 7+ years of experience in data engineering within cloud or hybrid environments.
  • Strong experience designing, building, and maintaining production-scale ETL/ELT pipelines.
  • Advanced SQL skills and proficiency with data transformation techniques.
  • Strong Python programming skills for data processing and automation.
  • Hands-on experience with Snowflake, including:Data modelingSnowpipeQuery optimizationSchema design
  • Data modeling
  • Snowpipe
  • Query optimization
  • Schema design
  • Experience migrating from BigQuery or similar columnar data warehouse technologies.
  • Experience with batch and streaming data processing platforms such as Kafka, Event Hub, or equivalent.
  • Experience building enterprise-grade API and source-system integrations.
  • Experience implementing data quality and validation frameworks.
  • Good understanding of:Data governanceData lineageAccess control and security best practices
  • Data governance
  • Data lineage
  • Access control and security best practices
  • Strong problem-solving and communication skills.
  • Ability to work effectively in a collaborative, cross-functional environment.

Details

  • Data modeling
  • Snowpipe
  • Query optimization
  • Schema design

Good understanding of:

  • Data governance
  • Data lineage
  • Access control and security best practices

Nice to haves

  • Experience with Databricks, including:Delta LakeUnity CatalogSpark-based pipelines
  • Delta Lake
  • Unity Catalog
  • Spark-based pipelines
  • Experience with Spark, Scala, or PySpark.
  • Familiarity with Tableau.
  • Understanding of HIPAA and HITRUST data handling practices.
  • Experience with dbt (data build tool) for transformation layer management.
  • Experience working within healthcare, insurance, or regulated industries.

Experience with Databricks, including:

  • Delta Lake
  • Unity Catalog
  • Spark-based pipelines

Working Conditions

  • Full-time, 40h/week
  • US-based — US citizenship is required
  • Remote
  • Contract or B2B arrangement
Roles similares

Mantén una lista de respaldo.

Ver stack
FocoLead Data EngineerÁrea del rol
Señal de senioritySeniorNivel del candidato
StackPython, Snowflake, SparkSkills principales
Ubicación1 país aceptadoElegibilidad

Stack

Usa estas tags para comparar roles remotos similares.

Elegibilidad de ubicación

Candidatos deberían aplicar solo cuando el país del perfil aparece aquí.

Tu perfilPaís no definidoInicia sesión para comparar tu país con este rol.

Flujo de contratación

WithMira muestra el rol y luego envía candidatos a la aplicación de la empresa.

1Revisa fit del rol, stack y elegibilidad de ubicación en WithMira.
2Abre la página de aplicación de la empresa desde el link rastreado.
3Guarda el rol o suscríbete a oportunidades similares antes de salir.
Aplicar en el sitio de la empresaSitio de la empresaAbrir link