Resumo da vaga

Data Engineer

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

ESSENTIAL FUNCTIONS AND RESPONSIBILITIES

  • Designs, builds, and maintains resilient ETL/ELT pipelines that ingest data from on‑premise systems, AWS services (S3, RDS), and Azure platforms (Blob Storage, Azure SQL), centralizing and curating data for consumption in Snowflake and downstream AI services.
  • Develops and maintains feature stores and analytically optimized datasets that support machine learning workflows, ensuring data is clean, versioned, reproducible, and statistically valid for Data Science teams.
  • Engineers data pipelines that enable generative AI use cases, including the automated extraction, transformation, chunking, and loading of structured and unstructured data into vector databases across AWS and Azure environments.
  • Acts as a Snowflake power user and technical lead, implementing advanced data modeling patterns, Snowpipe automation, and compute and storage optimization to support high‑concurrency analytics and AI workloads.
  • Executes non‑invasive data extraction strategies to unlock mission‑critical data from decades‑old legacy systems while preserving system stability and avoiding disruption to core business operations.
  • Designs and manages complex, cross‑platform data workflows using orchestration tools such as Airflow, AWS Step Functions, and Azure Data Factory to ensure reliable, synchronized data movement across the organization’s multi‑cloud architecture.
  • Partners closely with central IT, database administrators, infrastructure, and security teams to resolve connectivity and access challenges—including PrivateLink, IAM, network segmentation, and firewall controls—while securing production approval for new data integrations.
  • Implements automated data quality, validation, and observability frameworks to detect data drift, anomalies, and integrity issues that could negatively impact production analytics, machine learning, or AI systems.
  • Drives efficiency across the data ecosystem by optimizing storage, compute usage, and query performance in Snowflake, AWS, and Azure, ensuring responsible cost management and measurable ROI for Transformation Office initiatives.
  • Operates as a dedicated engineering partner to MLOps, Data Science, and AI teams, rapidly iterating on evolving data requirements and translating experimental use cases into scalable, production‑ready data solutions.

ADDITIONAL FUNCTIONS and RESPONSIBILITIES

  • Performs other duties as assigned.
  • Travel as required.

Skills & Knowledge

  • Expert-level proficiency in Snowflake architecture, including data sharing, performance tuning, and the integration of Snowflake with external cloud AI services
  • Advanced, hands-on knowledge of AWS (S3, Glue, Lambda) and Azure (Data Factory, Synapse) data services
  • Mastery of Python, SQL, and PySpark. Deep experience with data orchestration and containerization (Docker)
  • Proven ability to interface with "old world" tech (on-premise SQL, Mainframe extracts, flat files) and transform it for modern cloud consumption
  • A strong understanding of the specific data needs for Machine Learning (feature engineering) and Generative AI (vectorization and embedding pipelines)
  • A "get-it-done" attitude, capable of navigating enterprise bureaucracy and technical debt to ship code at the speed required by a Transformation Office
  • Ability to work in a team environment
  • Ability to meet or exceed Performance Competencies
Vagas similares

Mantenha uma lista reserva.

Ver stack
FocoData EngineeringÁrea da vaga
Sinal de senioridadeSeniorNível do candidato
StackAWS, Azure, DockerSkills principais
Localização1 país aceitoElegibilidade

Stack

Use estas tags para comparar vagas remotas similares.

Elegibilidade de localização

Candidatos devem aplicar apenas quando o país do perfil estiver listado aqui.

Seu perfilPaís não definidoEntre para comparar seu país com esta vaga.

Fluxo de contratação

O WithMira mostra a vaga e depois envia candidatos para a aplicação da empresa.

1Confira fit da vaga, stack e elegibilidade de localização no WithMira.
2Abra a página de aplicação da empresa pelo link rastreado.
3Salve a vaga ou assine oportunidades similares antes de sair.