Resumen del rol

Senior Data Engineer

Requisitos y responsabilidades

Contenido del rol extraído en secciones para revisar más rápido.

What You’ll Do:

  • Build infrastructure and data automation pipelines to ingest, process, and load data from various sources. Automate and integrate new components into the data pipeline.
  • Collaborate with stakeholders and data science teams to develop data products, including entity resolution and best selection, to efficiently execute product vision and strategy in alignment with organizational goals and priorities.
  • Create unit and stress-test components to monitor technical performance and ensure that identified issues are resolved.
  • Develop data analysis tools to provide data insights and capture key metrics.
  • Research solutions and maintain technical documentation.
  • Follow best practices for data governance, quality, cleansing, and other ETL-related activities.

Who You Are:

  • 7+ years of development experience in data engineering within a production environment (internships and academic settings excluded).
  • Proven experience working with large datasets exceeding 100M+ records or multiple terabytes.
  • 2+ years of development experience in highly scalable, distributed systems and cluster architectures using AWS and utilizing EMR.
  • 5+ years of hands-on programming experience with Python.
  • 5+ years of professional experience working in big data ecosystems; Spark is required; PySpark is preferable.
  • 3+ years of experience with SQL, schema design, and dimensional data modeling.
  • 2+ years of professional experience working with dataflow orchestration tools, such as Airflow.
  • 2+ years of experience with non-relational databases (e.g., DynamoDB, Elasticsearch, etc.).
  • A bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field is required.
Roles similares

Mantén una lista de respaldo.

Ver stack
FocoSenior Data EngineerÁrea del rol
Señal de senioritySeniorNivel del candidato
StackAWS, Python, SparkSkills principales
Ubicación1 país aceptadoElegibilidad

Stack

Usa estas tags para comparar roles remotos similares.

Elegibilidad de ubicación

Candidatos deberían aplicar solo cuando el país del perfil aparece aquí.

Tu perfilPaís no definidoInicia sesión para comparar tu país con este rol.

Flujo de contratación

WithMira muestra el rol y luego envía candidatos a la aplicación de la empresa.

1Revisa fit del rol, stack y elegibilidad de ubicación en WithMira.
2Abre la página de aplicación de la empresa desde el link rastreado.
3Guarda el rol o suscríbete a oportunidades similares antes de salir.
Aplicar en el sitio de la empresaSitio de la empresaAbrir link