Resumen del rol

Data Engineer

Requisitos y responsabilidades

Contenido del rol extraído en secciones para revisar más rápido.

DATA PIPELINE DEVELOPMENT

  • Design and build extraction, transformation, and loading (ETL) pipelines using Microsoft Fabric (Dataflow Gen2, Notebooks, or equivalent tools)
  • Write optimized SQL queries and transformations for data ingestion from designated source systems
  • Apply data quality rules and validation logic at each pipeline stage
  • Implement incremental loads and manage refresh schedules for performance
  • Escalate to Lead for architectural decisions or complex transformation patterns

DATA QUALITY & VALIDATION

  • Define and implement data quality checks at ingestion, transformation, and output stages
  • Perform ongoing data validation to ensure pipeline outputs align with business logic and source system expectations
  • Identify, document, and escalate data quality issues with root cause analysis
  • Maintain data quality dashboards and SLA monitoring
  • Support UAT for new data sources or transformation logic

TRANSFORMATION & MODELING

  • Build and maintain data transformations using Power Query, SQL, or Python as appropriate
  • Develop dimensional models and define aggregation logic aligned with analytics requirements
  • Optimize data structures for performance and maintainability
  • Document transformation logic, lineage, and assumptions per team standards
  • Collaborate with Lead to define semantic models and calculated metrics

OPERATIONAL SUPPORT

  • Troubleshoot pipeline failures and performance issues; coordinate resolution with IT/Engineering
  • Respond to data discrepancy reports from business users and analysts
  • Maintain documentation of data sources, data dictionaries, and transformation specifications
  • Support capacity planning and optimization of Fabric environments and pipelines

Technical

  • Advanced SQL — query optimization, window functions, performance tuning, debugging complex transformations
  • Proficient with Microsoft Fabric — (Dataflow Gen2, Notebooks, Lakehouse) OR equivalent ETL tools (Python, dbt, Talend, Informatica)
  • Strong understanding of relational database design and dimensional modeling
  • Power Query / M — complex data shaping, merging, error handling, and transformation logic
  • Python or similar scripting language — data manipulation, pipeline automation
  • Git/version control basics — able to collaborate on code and track changes
  • Data quality and testing frameworks — unit tests, assertions, validation rules

Functional

  • Ability to interpret business requirements and design efficient data solutions
  • Data governance mindset — understands data lineage, documentation, and quality standards
  • Proactive about identifying edge cases and potential data issues
  • Mortgage/lending domain familiarity preferred; willingness to learn domain required
  • Works effectively within defined standards and escalates architectural questions to Lead
  • Able to balance speed with quality; advocates for technical excellence

Analytics / BI Team

  • Translate analytical requirements into robust data solutions
  • Communicate data lineage and transformation logic clearly
  • Document assumptions and limitations of data sources and transforms
  • Set realistic timelines for new pipelines or data source onboarding

Data Lead

  • Provide detailed status updates on assigned pipelines; flag performance or quality concerns early
  • Document design decisions and trade-offs for Lead review — escalate architecture questions rather than assume
  • Demonstrate commitment to code quality and maintainability; accept technical feedback constructively

IT / Engineering

  • Communicate data requirements precisely — schema details, volume expectations, refresh frequency
  • Escalate data access or infrastructure needs through Lead; provide business context
  • Provide detailed defect reports with query examples and expected vs. actual results

Business / Operations

  • Explain data quality issues and timelines in business terms; avoid over-technical language
  • Ask clarifying questions about data requirements and business logic expectations
  • Set expectations transparently; communicate delays or blockers early through Lead
Roles similares

Mantén una lista de respaldo.

Ver stack
FocoData EngineeringÁrea del rol
Señal de seniorityMiddleNivel del candidato
StackPython, SQLSkills principales
UbicaciónGlobalElegibilidad

Stack

Usa estas tags para comparar roles remotos similares.

Elegibilidad de ubicación

Este rol aparece como abierto para candidatos en cualquier país.

Tu perfilPaís no definidoInicia sesión para comparar tu país con este rol.
Global

Flujo de contratación

WithMira muestra el rol y luego envía candidatos a la aplicación de la empresa.

1Revisa fit del rol, stack y elegibilidad de ubicación en WithMira.
2Abre la página de aplicación de la empresa desde el link rastreado.
3Guarda el rol o suscríbete a oportunidades similares antes de salir.
Aplicar en el sitio de la empresaSitio de la empresaAbrir link