Fasset

Senior Data Engineer

Vaga remota de Data Engineering com fit claro de localização do candidato.

Publicada24 de jul. de 2026

Países elegíveis1 país aceito

Sinal de senioridadeSenior

Modelo de trabalhoRemoto

Locais aceitos para candidatos

Paquistão

AWS CI/CD Python SQL

Resumo da vaga

Senior Data Engineer

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

Key Responsibilities

Platform & Infrastructure Management: Own the deployment, scaling, and orchestration of our core data stack using AWS Managed Workflows for Apache Airflow (MWAA). Design and evolve the overall data platform architecture, making thoughtful tradeoffs around scalability, reliability, cost, and maintainability.
Lakehouse Engineering: Configure and optimize raw data storage in S3, managing Redshift external schemas (Spectrum) and AWS Glue Data Catalog. Define efficient partitioning strategies, leverage columnar file formats (Parquet), and optimize storage layouts for query performance, scalability, and cost.
Data Architecture & Modeling (lakehouse, dimensional models, Redshift). Design scalable analytical data models using dimensional modeling and lakehouse best practices to support reporting, analytics, and downstream consumers.
Data Transformation: Manage and optimize dbt to ensure all raw data from external schemas is efficiently transformed, tested, and materialized strictly as processed data within Amazon Redshift.
Data Reliability & Operations (monitoring, testing, incident response). Build observability into the data platform through monitoring, logging, alerting, and operational dashboards.
Performance & Cost Optimization (Redshift tuning, S3 layout, workloads)
Governance & Collaboration (security, documentation, working with stakeholders)
Modernization Pipeline: Help design and implement the transition toward event-based ingestion into S3.
CI/CD & DevOps: Implement and maintain robust CI/CD deployment pipelines for our dbt projects, Airflow DAGs, and infrastructure.
BI Support: Ensure high performance, access control, and uptime for Metabase connecting to Redshift.

Technical Skills & Requirements

Core AWS Stack: Extensive hands-on experience deploying and managing AWS data services, specifically MWAA (Airflow), Redshift / Redshift Spectrum, S3, IAM, and Glue.
Data Transformation: Advanced proficiency with dbt (structuring dbt projects, configuring sources, writing custom macros, and optimizing incremental models).
Infrastructure as Code (IaC): Solid hands-on experience deploying AWS data platform components using Terraform or AWS CloudFormation.
SQL & Performance Tuning: Expert-level SQL skills, with a deep understanding of Redshift distribution/sort keys and optimizing queries across external schemas.
Programming: Strong Python experience for developing Airflow DAGs, automation, integrations, and data engineering tooling
Data Storage & Lakehouse: Experience designing efficient data lakes using Parquet, partitioning strategies, metadata catalogs, and external table technologies such as Redshift Spectrum..
Modern Lakehouse Technologies: Experience with open table formats such as Apache Iceberg, Delta Lake, or Apache Hudi, including an understanding of ACID transactions, schema evolution, time travel, and metadata management.

Bonus / Nice-to-Have

Experience with Apache Kafka or AWS MSK for event-driven data streaming and real-time ingestion into S3.
Streaming & Event-Driven Architecture: Experience designing resilient streaming pipelines with appropriate delivery guarantees, reconciliation, backfill strategies, and schema contract management.
Familiarity with modern analytical query engines such as DuckDB or MotherDuck is a plus.

Vagas similares